-- Logs begin at Tue 2022-03-08 03:29:49 UTC, end at Tue 2022-03-08 05:05:14 UTC. -- Mar 08 04:10:23.862471 dv-cinder-733062-29-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 04:10:23.871326 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 04:10:23 2022] *** Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: nodename: dv-cinder-733062-29-iscsi Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: machine: x86_64 Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: clock source: unix Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: pcre jit disabled Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: detected number of CPU cores: 4 Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: current working directory: / Mar 08 04:10:23.873272 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: detected binary path: /usr/bin/uwsgi-core Mar 08 04:10:23.874055 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: your processes number limit is 47680 Mar 08 04:10:23.874055 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: your memory page size is 4096 bytes Mar 08 04:10:23.874055 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: detected max file descriptor number: 2048 Mar 08 04:10:23.874055 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: lock engine: pthread robust mutexes Mar 08 04:10:23.874055 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: thunder lock: enabled Mar 08 04:10:23.874055 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 04:10:23.874055 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 04:10:23.919779 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: Python main interpreter initialized at 0x56467b75d9c0 Mar 08 04:10:23.919779 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: python threads support enabled Mar 08 04:10:23.919779 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: your server socket listen backlog is limited to 100 connections Mar 08 04:10:23.919779 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: your mercy for graceful operations on workers is 90 seconds Mar 08 04:10:23.920125 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 04:10:23.920213 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: *** Operational MODE: preforking *** Mar 08 04:10:23.920435 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: *** uWSGI is running in multiple interpreter mode *** Mar 08 04:10:23.920435 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: spawned uWSGI master process (pid: 102325) Mar 08 04:10:23.920631 dv-cinder-733062-29-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 04:10:23.921225 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: spawned uWSGI worker 1 (pid: 102326, cores: 1) Mar 08 04:10:23.922262 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: spawned uWSGI worker 2 (pid: 102327, cores: 1) Mar 08 04:10:23.922262 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 04:10:25.752215 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 04:10:25.752215 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: from cryptography.utils import int_from_bytes Mar 08 04:10:25.752895 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 04:10:25.752895 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: from cryptography.utils import int_from_bytes Mar 08 04:10:25.755017 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 04:10:25.755017 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: from cryptography.utils import int_from_bytes Mar 08 04:10:25.755509 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 04:10:25.755509 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: from cryptography.utils import int_from_bytes Mar 08 04:10:28.306913 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 04:10:28.307451 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 04:10:28.307658 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 04:10:28.308015 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 04:10:28.308234 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 04:10:28.308607 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 04:10:28.308701 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 04:10:28.308784 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.308962 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.309059 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 04:10:28.309285 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.309386 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 04:10:28.309586 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 04:10:28.309693 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.309949 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.310036 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.310260 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.310357 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.310584 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.310671 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.310904 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.311001 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.311233 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.311322 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.311490 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.311579 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.311808 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.311917 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.312136 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-29-iscsi {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.312244 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.312459 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.312547 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.312757 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.312846 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.313067 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.313152 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.313402 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.313541 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-29-iscsi {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.313699 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.313829 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.314025 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.314165 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.314332 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.314463 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.314654 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.314831 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.316123 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.316259 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.316385 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.316527 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.316661 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.316783 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.316917 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.317050 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.317188 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.317304 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.317427 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.317566 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.317714 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.317841 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.317979 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.318105 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.318234 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.318360 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.318484 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.318607 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.318744 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.318867 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-29-iscsi {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.319507 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.319631 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.319765 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.319889 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.320004 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.320134 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.320259 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-29-iscsi {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.320391 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.320523 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.320646 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.320771 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.320978 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.321112 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.321251 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.321471 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.321608 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.321805 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.321936 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.322184 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.322322 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.322447 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.322581 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.322749 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.322890 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.323069 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.323203 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.323372 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.323508 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.323684 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.323813 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.323994 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.324131 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.324314 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.324446 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.324620 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.324750 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.324925 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.325055 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.325189 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.325316 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.325470 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.325607 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.325819 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.325965 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.326142 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.326274 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.326399 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.326523 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.326704 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.326842 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.326977 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.327112 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.327260 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.327394 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.327582 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.327726 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.327893 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.328030 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.328158 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.328284 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.328452 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.328584 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.328778 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.328918 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.329090 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.329220 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.329399 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.329529 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.329727 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.329859 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.330038 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.330179 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.330348 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.330484 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.330660 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.330790 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.330971 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.331102 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.331276 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.331405 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.331596 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.331727 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.331912 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.332049 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.332297 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.332436 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.332570 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.332704 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.332837 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.332975 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.333167 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.333297 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.333474 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.333603 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.333817 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.333959 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.334144 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.334274 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.334453 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.335160 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.335398 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.335543 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.335714 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.335873 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.336039 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.336209 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.336379 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.336511 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.336686 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.336816 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.336942 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.337132 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.337271 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.337462 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.337600 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.337839 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.337984 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.338149 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.338287 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.338414 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.338541 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.338700 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.338829 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.339012 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.339151 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.339339 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.339467 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.339648 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.339787 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.339957 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.340087 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.340265 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.340402 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.340570 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.340700 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.340874 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.341003 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.341184 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.341321 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.341491 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.341628 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.341877 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.342013 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.342139 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.342271 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.342483 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.342620 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.342761 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.342888 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.343013 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.343145 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.343319 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.343447 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.343625 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.343756 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.343948 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.344079 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.344259 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.344388 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.344563 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.344699 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.344876 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.345005 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.345181 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.345316 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.345488 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.345627 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.345835 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.345965 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.346141 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.346269 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.346472 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.346608 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.346742 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.346874 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.347038 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.347180 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.347347 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.347477 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.347664 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.347794 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.347972 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.348111 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.348283 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.348414 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.348586 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.348716 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.348890 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.349029 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.349193 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.349324 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.349497 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.349634 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.349833 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.349982 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.350155 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.350334 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.350542 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.350718 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.350847 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.350984 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.351113 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.351239 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.351371 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.351506 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.351641 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.351817 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.351954 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.352125 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.352262 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.352530 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.352680 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.352808 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.352945 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.353072 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.353205 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.353388 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.353531 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.353732 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.353865 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.354062 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:10:28.354193 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.354402 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.354533 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.354740 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.354870 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.355066 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.355194 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.355391 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.355523 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.355703 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.355833 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.356015 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.356144 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.356326 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.356458 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.356643 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.356773 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.356962 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.357091 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.357291 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.357421 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.357621 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.357798 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.357946 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.358093 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.358260 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.358408 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.358567 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.358696 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.358885 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.359022 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.359214 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.359345 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.359532 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.359661 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.359838 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.359974 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.360165 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.360294 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.360483 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.360615 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.360805 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.360941 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.361128 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.361259 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.361448 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.361585 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.361780 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.361924 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.362091 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.362221 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.362401 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.362531 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.362745 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.362887 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.363040 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.363170 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.363351 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.363481 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.363670 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.363801 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.363981 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.364110 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.364291 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.364419 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.364600 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.364730 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.364913 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.365043 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.365225 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.365358 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.365559 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.365737 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.365915 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.366138 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.366384 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.366514 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.366652 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.366784 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.366914 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.367040 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.367204 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.367333 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.367468 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.367596 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.367723 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.367856 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.367985 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.368119 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.368295 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.368426 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.368600 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.368730 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.368909 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.369112 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.369241 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.369368 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.369517 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.369647 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.369867 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.370014 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.370173 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.370304 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.370503 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.370633 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.370805 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.370945 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.371115 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.371247 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.371424 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.371555 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.371732 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.371863 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.372038 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.372169 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.372347 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.372478 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.372654 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.372864 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.373003 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.373134 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.373261 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.373394 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.373557 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.373740 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.373878 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.374006 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.374193 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.374332 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.374496 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.374628 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.374799 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.374930 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.375113 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.375253 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.375426 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.375555 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.375732 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.375861 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.376044 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.376187 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.376353 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.376484 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.376663 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.376801 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.376968 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.377107 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.377278 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.377410 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.377593 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.377741 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.377938 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.378081 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.378249 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.378386 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.378572 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.378703 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.378884 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.379022 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.379196 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.379331 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.379500 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.379637 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.379806 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.379938 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.380107 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.380244 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.380409 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.380541 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.380711 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.380849 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.381018 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.381148 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.381318 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.381985 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.382252 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.382384 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.382566 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.382698 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.382879 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.383028 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.383184 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.383283 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.383495 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.383591 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.383805 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.383910 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.384109 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.384221 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.384415 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.384509 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.384715 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.384815 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.385020 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.385110 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.385345 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.385440 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.385685 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.385793 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.385990 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.386076 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.386298 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.386393 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.386609 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.386769 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.386940 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.387094 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.387237 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.387382 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.387553 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.387701 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.387850 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.388002 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.388167 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.388315 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.388464 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.388605 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.388783 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.388939 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.389081 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.389227 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.389380 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.389522 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.389708 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.389859 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.390014 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.390167 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.390309 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.390449 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.390632 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.390787 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.390929 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.391082 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.391224 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.391370 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.391558 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.391706 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.391890 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.392058 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.392208 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.392347 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.392510 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.392658 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.392799 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.392972 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.393186 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.393332 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.393471 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.393610 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.393816 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.393972 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.394126 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.394299 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.394452 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.394594 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.394742 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.394883 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.395023 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.395171 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.395311 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.395450 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.395603 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.395743 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.395883 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.396032 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.396173 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.396314 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.396463 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.396604 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.396743 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.396883 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.397074 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.397262 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.397425 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.397675 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.397846 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.398033 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.398191 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.398409 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.398553 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.398700 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.398848 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.398995 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.399137 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.399285 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.399428 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.399568 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.399708 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.399847 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.400006 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.400157 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.400298 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.400440 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.400580 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.400748 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.400896 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.401056 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.401199 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.401339 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.401486 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.401628 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.401823 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.401981 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.402123 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.402264 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.402404 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.402546 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.402694 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.402836 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.402976 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.403123 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.403349 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.403496 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.403646 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.403788 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.403938 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.404078 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.404225 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.404365 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.404514 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.404656 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.404796 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.404936 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.405076 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.405239 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.405395 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.405544 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.405720 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.405867 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.406036 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.406194 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.406335 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.406482 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.406623 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.406773 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.406915 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.407067 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.407208 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.407348 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.407515 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.407703 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.407863 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.408019 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.408161 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.408302 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.408442 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.408581 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.408730 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.408880 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.409029 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.409170 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.409591 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.409791 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.409962 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.410132 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.410277 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.410417 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.410558 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.410698 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.410847 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.410996 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.411141 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.411289 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.411436 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.411578 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.411749 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.411910 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.412076 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.412218 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.412358 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.412505 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.413255 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.413611 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.413992 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.414312 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.414635 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.414877 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.414977 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.415207 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.415297 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.415527 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.415616 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.415850 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.415939 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.416162 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.416439 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.416537 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.416777 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.416888 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.417097 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.417347 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.417435 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.417709 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.417836 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.418037 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.418134 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.418365 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.418452 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.418694 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.418790 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.419019 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.419113 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.419332 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.419426 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.419646 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.419742 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.419956 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.420052 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.420263 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.420350 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.420575 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.420671 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.420880 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.420974 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.421186 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.421274 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.421492 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.421578 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.421822 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.421946 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.422129 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.422223 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.422437 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.422523 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.422740 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.422833 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.423045 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.423132 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.423351 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.423437 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.423657 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.423899 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.424061 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.424203 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.424345 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.424483 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.424631 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.424781 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.424923 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.425063 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.425203 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.425350 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.425514 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.425718 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.425877 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.426019 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.426160 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.426307 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.426462 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.426611 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.426760 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.426900 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.427040 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.427179 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.427329 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.427479 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.427620 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.427766 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.427908 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.428057 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.428199 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.428421 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.428567 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.428821 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.428982 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.429138 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.429281 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.429432 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.429573 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.429729 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.429877 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.430031 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.430181 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.430323 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.430464 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.430604 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.430751 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.430902 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.431051 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.431193 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.431343 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.431484 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.431637 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.431778 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.431919 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.432059 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.432206 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.432347 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.432499 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.432640 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.432788 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.432930 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.433070 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.433232 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.433383 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.433525 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.433697 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.433847 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.433990 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.434140 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.434291 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.434433 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.434574 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.434713 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.434854 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.435003 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.435155 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.435296 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.435436 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.435576 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.435716 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.435864 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.436006 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.436148 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.436288 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.436428 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.436567 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.436715 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.436857 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.437008 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.437150 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.437316 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.437465 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.437619 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.437789 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.437941 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.438083 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.438260 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.438408 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.438558 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.438699 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.438850 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.438997 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.439149 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.439300 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.439441 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.439582 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.439722 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.439862 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.440033 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.440191 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.440334 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.440475 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.440628 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.440779 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.440920 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.441073 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.441215 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.441355 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.441496 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.441636 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.441821 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.441964 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.442111 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.442252 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.442394 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.442542 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.442701 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.442844 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.442985 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.443131 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.443273 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.443420 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.443570 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.443718 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.444370 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.444645 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.444797 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.444938 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.445088 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.445243 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.445385 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.445527 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.445687 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.445851 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.445993 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.446133 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.446288 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.446430 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.446571 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.446724 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.446873 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.447023 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.447198 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.447354 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.447496 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.447646 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.447788 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.447934 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.448076 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.448216 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.448390 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.448547 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.448691 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.448831 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.448982 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.449122 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.449270 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.449423 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.449572 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.449753 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.449896 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.450037 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.450189 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.450332 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.450495 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.450644 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.450816 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.450984 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.451135 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.451277 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.451458 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.451607 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.451749 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.451891 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.452108 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.452252 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.452393 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.452534 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.452675 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.452817 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.452981 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.453124 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.453266 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.453407 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.453547 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.453759 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.453919 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.454062 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.454203 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.454344 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.454485 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.454633 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.454775 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.454927 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.455076 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.455217 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.455365 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.455514 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.455656 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.455796 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.455936 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.456078 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.456218 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.456367 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.456509 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.456659 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.456801 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.456941 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.457100 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.457243 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.457384 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.457525 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.457687 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.457846 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.458001 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.458153 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.458404 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.458553 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.458713 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.458862 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.459013 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.459155 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.459296 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.459437 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.459680 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.459935 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.460161 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.460314 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.460456 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.460597 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.460748 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.460909 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.461052 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.461193 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.461334 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.461475 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.461616 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.461827 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.461972 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.462113 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.462260 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.462402 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.462543 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.462691 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.462858 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.463006 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.463154 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.463303 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.463458 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.463615 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.463763 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.463909 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.464064 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.464211 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.464368 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.464517 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.464674 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.464822 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.464977 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.465125 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.465280 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.465430 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.465582 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.465758 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.465909 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.466066 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.466223 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.466370 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.466518 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.466676 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.466824 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.467018 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.467272 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.467438 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.467589 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.467736 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.467889 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.468049 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.468195 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.468343 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.468495 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.468645 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.468803 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.468971 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.469119 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.469275 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.469421 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.469649 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.469854 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.470005 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.470153 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.470309 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.470458 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.470605 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.470754 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.470914 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.471063 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.471219 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.471368 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.471515 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.471670 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.471827 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.471975 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.472131 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.472285 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.472432 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.472581 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.472738 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.472894 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.473050 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.473198 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.473344 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.473491 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.473638 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.473853 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.474005 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.474167 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.474316 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.474462 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.474609 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.474776 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.474927 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.475075 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.475752 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.475969 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.476123 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.476281 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.476437 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.476585 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.476733 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.476880 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.477037 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.477192 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.477358 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.477507 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.477741 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.477900 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.478061 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.478061 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.478350 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.478506 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.478661 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.478816 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.478974 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.479123 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.479282 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.479438 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.479593 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.479763 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.479922 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.480080 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.480234 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.480393 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.480542 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.480697 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.480845 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.480993 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.481150 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.481308 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.481456 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.481613 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.481830 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.481989 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.482137 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.482286 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.482433 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.482589 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.482746 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.482893 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.483057 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.483205 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.483368 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.483529 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.483688 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.483836 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.483999 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.484147 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.484314 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.484464 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.484611 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.484759 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.484915 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.485069 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.485233 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.485395 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.485552 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.485734 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.485897 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.486053 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.486219 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.486375 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.486523 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.486671 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.486834 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.486982 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.487141 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.487301 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.487458 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.487606 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.487762 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.487917 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.488074 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.488222 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.488376 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.488525 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.488704 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.488864 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.489021 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.489175 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.489343 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.489492 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.489640 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.489853 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.490010 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.490159 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.490317 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.490465 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.490613 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.490833 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.490990 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.491139 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.491287 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.491447 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.491675 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.491826 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.491987 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.492136 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.492283 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.492431 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.492587 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.492737 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.492884 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.493030 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.493178 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.493343 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.493505 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.493683 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.493840 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.493999 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.494155 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.494304 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.494469 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.494617 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.494773 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.494928 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.495077 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.495379 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.495549 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.495707 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.495857 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.496012 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.496169 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.496328 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.496477 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.496477 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.496766 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.496915 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.497062 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.497218 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.497367 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.497525 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.497719 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.497887 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.498037 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.498202 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.498351 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.498351 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.498639 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.498788 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.498948 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.499098 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.499246 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.499402 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.499559 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.499716 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.499876 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.500035 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.500192 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.500353 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.500501 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.500649 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.500805 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.500954 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.501110 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.501303 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.501471 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.501630 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.501809 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.501960 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.502120 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.502278 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.502427 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.502585 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.502745 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.502894 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.503041 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.503201 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.503359 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.503509 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.503657 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.503805 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.503952 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.504100 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.504269 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.504419 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.504567 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.504726 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.504874 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.505040 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.505199 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.505350 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.505498 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.505645 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.505824 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.505985 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.506143 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.506299 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.506480 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.506630 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.506777 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.506991 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.507155 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.507313 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.507463 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.507611 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.507759 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.507935 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.508085 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.508233 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.508381 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.508530 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.508690 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.508839 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.508998 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.509147 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.509294 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.509443 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.509600 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.509799 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.509960 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.510116 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.510284 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.510434 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.510597 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.510771 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.510923 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.511091 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.511240 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.511396 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.511546 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.511701 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.511856 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.512004 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.512152 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.512308 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.512308 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.512589 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.512744 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.512902 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.513051 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.513211 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.513367 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.513515 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.513683 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.513838 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.513997 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.514155 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.514155 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.514438 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.514587 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.514736 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.515066 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.515248 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.515400 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.515548 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.515696 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.515845 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.516008 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.516159 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.516308 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.516455 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.516604 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.516751 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.516751 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.517057 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.517207 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.517354 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.517502 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.517650 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.517874 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.518024 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.518173 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.518329 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.518485 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.518643 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.518791 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.518961 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.519111 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.519258 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.519417 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.519574 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.519723 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.519870 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.520019 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.520179 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.520333 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.520489 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.520638 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.520785 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.520954 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.521112 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.521261 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.521417 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.521573 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.521756 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.521909 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.522581 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.522881 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.523040 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.523189 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.523344 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.523494 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.523660 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.523865 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.524029 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.524180 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.524335 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.524483 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.524631 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.524788 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.524968 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.525129 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.525288 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.525436 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.525584 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.525799 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.525993 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.526150 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.526299 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.526447 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.526607 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.526764 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.526914 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.527062 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.527209 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.527365 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.527522 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.527671 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.527842 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.528002 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.528151 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.528310 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.528477 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.528627 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.528775 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.528922 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.529070 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.529218 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.529379 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.529529 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.529718 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.529718 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.530015 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.530015 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.530376 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.530376 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.530664 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.530816 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.530964 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.530964 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.531266 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.531415 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.531564 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.531723 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.531871 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.532029 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.532179 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.532336 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.532336 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.532626 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.532775 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.532936 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.533086 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.533234 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.533393 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.533554 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.533742 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.533898 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.534047 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.534443 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.534599 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.534749 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.534905 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.535055 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.535203 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.535352 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.535507 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.535658 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.535829 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.535980 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.536134 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.536296 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.536445 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.536601 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.536759 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.536914 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.537070 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.537229 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.537378 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.537540 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.537816 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.537971 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.538131 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.538282 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.538438 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.538595 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.538751 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.538908 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.539058 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.539206 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.539363 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.539513 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.539669 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.539831 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.539993 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.540143 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.540299 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.540449 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.540597 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.540762 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.540914 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.541068 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.541226 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.541376 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.541523 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.541721 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.541891 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.542057 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.542214 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.542363 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.542512 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.542661 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.542819 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.542976 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.543131 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.543287 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.543435 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.543597 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.543747 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.543904 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.544060 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.544209 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.544357 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.544512 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.544668 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.544817 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.544966 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.545122 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.545272 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.545424 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.545591 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.545810 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.545975 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.546125 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.546273 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.546429 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.546587 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.546736 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.546884 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.547031 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.547185 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.547185 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.547498 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.547650 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.547797 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.547945 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.548099 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.548257 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.548406 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.548560 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.548708 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.548864 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.549019 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.549176 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.549326 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.549485 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.549633 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.549847 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.549998 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.550156 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.550305 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.550460 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.550623 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.550785 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.550935 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.551091 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.551240 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.551395 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.551554 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.551711 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.551868 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.552017 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.552170 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.552319 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.552468 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.552628 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.552786 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.552941 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.553090 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.553781 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.553941 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.554114 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.554318 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.554487 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.554638 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.554786 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.554933 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.555091 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.555240 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.555388 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.555536 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.555536 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.555818 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.555984 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.556134 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.556290 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.556439 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.556439 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.556719 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.556719 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.557058 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.557058 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.557351 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.557500 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.557647 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.557859 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.558021 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.558177 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.558331 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.558480 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.558637 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.558787 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.558943 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.559091 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.559239 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.559387 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.559609 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.559760 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.559914 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.560084 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.560242 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.560391 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.560549 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.560699 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.560859 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.561016 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.561175 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.561325 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.561490 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.561640 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.561833 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.561996 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.562153 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.562315 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.562465 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.562622 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.562776 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.562926 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.563074 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.563234 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.563384 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.563532 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.563680 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.563839 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.563989 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.564159 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.564310 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.564458 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.564606 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.564766 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.564928 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.565079 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.565227 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.565376 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.565525 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.565709 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.565891 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.566043 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.566193 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.566193 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.566483 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.566483 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.566776 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.566926 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567082 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567272 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567458 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567620 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 04:10:28.567786 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567786 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567786 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567786 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567786 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567786 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.567786 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.568861 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.568861 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:10:28.568861 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 04:10:28.588772 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG oslo_db.sqlalchemy.engines [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:10:28.597870 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_db.sqlalchemy.engines [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:10:28.652226 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.context [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33a7eb4f-1be8-4bb2-b607-698804ce5c66(cell1) {{(pid=102326) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 04:10:28.656370 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG oslo_concurrency.lockutils [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:10:28.657968 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG oslo_concurrency.lockutils [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:10:28.658764 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG oslo_concurrency.lockutils [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:10:28.660944 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG oslo_concurrency.lockutils [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:10:28.661343 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.context [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33a7eb4f-1be8-4bb2-b607-698804ce5c66(cell1) {{(pid=102327) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 04:10:28.666492 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:10:28.668074 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:10:28.668894 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:10:28.670882 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:10:28.673026 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG oslo_db.sqlalchemy.engines [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:10:28.676115 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG oslo_db.sqlalchemy.engines [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:10:28.684750 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_db.sqlalchemy.engines [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:10:28.687690 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_db.sqlalchemy.engines [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:10:28.831935 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG oslo_db.sqlalchemy.engines [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:10:28.845391 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_db.sqlalchemy.engines [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:10:29.175465 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: WARNING keystonemiddleware.auth_token [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 04:10:29.180272 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: WARNING keystonemiddleware.auth_token [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 04:10:29.182360 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: WARNING keystonemiddleware.auth_token [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 04:10:29.186989 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: WARNING keystonemiddleware.auth_token [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 04:10:29.522530 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: WARNING keystonemiddleware.auth_token [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 04:10:29.527778 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: WARNING keystonemiddleware.auth_token [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 04:10:29.529088 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: WARNING keystonemiddleware.auth_token [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 04:10:29.532903 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56467b75d9c0 pid: 102326 (default app) Mar 08 04:10:29.534756 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: WARNING keystonemiddleware.auth_token [None req-8200ca2a-071d-4a93-b882-ed48beb68354 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 04:10:29.535265 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:10:29.536445 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002019 Mar 08 04:10:29.536859 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Tue Mar 8 04:10:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:10:29.540050 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56467b75d9c0 pid: 102327 (default app) Mar 08 04:11:50.911265 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:11:50.912248 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Mar 08 04:11:50.912644 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:11:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:11:51.335207 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-ad641d0c-9ccd-471f-9500-59a1ec33eb2d admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:11:51.364260 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-ad641d0c-9ccd-471f-9500-59a1ec33eb2d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.445210 Mar 08 04:11:51.364993 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Mar 8 04:11:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:11:53.754327 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:11:53.756026 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-afc4131c-6fe6-450c-99ef-12b2db2e8cd9 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003579 Mar 08 04:11:53.757615 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:11:53 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:11:53.823839 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-38265ec2-2ecd-41af-bc78-04f3cf32cd94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "name": "cirros256", "ram": 256}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:11:53.843475 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 04:11:53.843475 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: warnings.warn(msg) Mar 08 04:11:53.874335 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-38265ec2-2ecd-41af-bc78-04f3cf32cd94 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111413 Mar 08 04:11:53.875100 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:11:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 04:11:54.091011 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-e5490d13-a464-4c19-8e07-c809fc344f9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:11:54.093461 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 04:11:54.093461 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: warnings.warn(msg) Mar 08 04:11:54.142244 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-e5490d13-a464-4c19-8e07-c809fc344f9e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.258757 Mar 08 04:11:54.157690 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 04:11:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:11:56.520713 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-38265ec2-2ecd-41af-bc78-04f3cf32cd94 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:11:56.521771 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-38265ec2-2ecd-41af-bc78-04f3cf32cd94 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Mar 08 04:11:56.522177 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:11:56.633885 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-b4d658fa-6026-4e41-a455-8e8ee73a9029 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:11:56.652506 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 04:11:56.652506 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: warnings.warn(msg) Mar 08 04:11:56.676501 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-b4d658fa-6026-4e41-a455-8e8ee73a9029 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148251 Mar 08 04:11:56.681742 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:11:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 04:11:56.689946 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-a5dc8d63-b6a0-4b49-81e2-09d3c7aacad0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:11:56.692746 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 04:11:56.692746 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: warnings.warn(msg) Mar 08 04:11:56.730121 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-a5dc8d63-b6a0-4b49-81e2-09d3c7aacad0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044780 Mar 08 04:11:56.737773 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 04:11:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:11:59.096887 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-b4d658fa-6026-4e41-a455-8e8ee73a9029 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:11:59.099003 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-b4d658fa-6026-4e41-a455-8e8ee73a9029 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002611 Mar 08 04:11:59.099556 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:11:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:11:59.159871 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-fe819c92-8222-473b-8ce5-92e01ccdf664 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "vcpus": 1, "name": "ds1G", "disk": 10}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:11:59.178138 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-fe819c92-8222-473b-8ce5-92e01ccdf664 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072464 Mar 08 04:11:59.178765 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:11:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:11:59.191745 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-725219bd-ed52-44c3-9d84-614ba488a20f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:11:59.215688 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-725219bd-ed52-44c3-9d84-614ba488a20f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028869 Mar 08 04:11:59.225238 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 04:11:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:12:01.573209 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-fe819c92-8222-473b-8ce5-92e01ccdf664 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:01.574254 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-fe819c92-8222-473b-8ce5-92e01ccdf664 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Mar 08 04:12:01.574659 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:12:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:01.635910 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-6f36c145-b26c-4dee-b6e2-c26317b80f9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:01.653889 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-6f36c145-b26c-4dee-b6e2-c26317b80f9d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073046 Mar 08 04:12:01.654785 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:12:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:12:01.666550 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-a39af10f-b210-4143-b9e0-0c9f8c24f91f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:01.689627 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-a39af10f-b210-4143-b9e0-0c9f8c24f91f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026584 Mar 08 04:12:01.690157 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 04:12:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:12:04.081966 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-6f36c145-b26c-4dee-b6e2-c26317b80f9d admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:04.083003 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-6f36c145-b26c-4dee-b6e2-c26317b80f9d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Mar 08 04:12:04.083394 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:12:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:04.143461 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-3104988c-ff30-4a60-bdd6-f18b603fb450 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:04.162669 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-3104988c-ff30-4a60-bdd6-f18b603fb450 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073656 Mar 08 04:12:04.163213 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:12:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 04:12:04.175886 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-90e4c464-15ea-4f9b-9201-876a19ddfacf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:04.197759 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-90e4c464-15ea-4f9b-9201-876a19ddfacf admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026286 Mar 08 04:12:04.198307 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 04:12:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:12:06.559729 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-3104988c-ff30-4a60-bdd6-f18b603fb450 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:06.560774 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-3104988c-ff30-4a60-bdd6-f18b603fb450 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Mar 08 04:12:06.561584 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:06.627976 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-cd0ffb11-b7e5-421e-adcc-466f93200471 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:06.651747 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-cd0ffb11-b7e5-421e-adcc-466f93200471 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083149 Mar 08 04:12:06.652502 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Mar 8 04:12:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:12:09.062513 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-3104988c-ff30-4a60-bdd6-f18b603fb450 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:09.063546 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-3104988c-ff30-4a60-bdd6-f18b603fb450 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Mar 08 04:12:09.063954 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:12:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:12:09.134389 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-abedd98d-1ecb-4bd5-a23b-3c2b5b1196cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "ram": 512, "vcpus": 1}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:09.152195 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-abedd98d-1ecb-4bd5-a23b-3c2b5b1196cd admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082412 Mar 08 04:12:09.152844 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:12:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:12:09.164975 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-066c83e8-3bc5-4bb2-a6af-94a38a853f7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:09.187890 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-066c83e8-3bc5-4bb2-a6af-94a38a853f7b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026599 Mar 08 04:12:09.188464 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 04:12:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:12:11.594016 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-abedd98d-1ecb-4bd5-a23b-3c2b5b1196cd admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:11.595034 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-abedd98d-1ecb-4bd5-a23b-3c2b5b1196cd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Mar 08 04:12:11.595478 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:12:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:11.663049 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-23fc503d-81d7-461b-a494-e67e037bc728 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:11.680859 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-23fc503d-81d7-461b-a494-e67e037bc728 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079038 Mar 08 04:12:11.681643 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:12:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:12:11.693982 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-1f1e2610-8af1-4c29-85a1-22b19448ffe3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:11.718745 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-1f1e2610-8af1-4c29-85a1-22b19448ffe3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028964 Mar 08 04:12:11.719334 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 04:12:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:12:14.390644 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-23fc503d-81d7-461b-a494-e67e037bc728 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:14.391647 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-23fc503d-81d7-461b-a494-e67e037bc728 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Mar 08 04:12:14.392043 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:12:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:14.448521 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-5009dc0e-3694-41e3-94fa-1d12f088ed29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:14.467311 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-5009dc0e-3694-41e3-94fa-1d12f088ed29 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069378 Mar 08 04:12:14.468083 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:12:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:12:14.479826 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-61121bc4-ae04-43bd-aa9f-e651121cd00c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:14.502203 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-61121bc4-ae04-43bd-aa9f-e651121cd00c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026111 Mar 08 04:12:14.502786 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 04:12:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:12:16.842643 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-5009dc0e-3694-41e3-94fa-1d12f088ed29 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:16.843645 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-5009dc0e-3694-41e3-94fa-1d12f088ed29 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Mar 08 04:12:16.844040 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:12:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:16.907484 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-ad512516-dd3e-49bb-be9b-a97e2f136b57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "swap": 0}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:16.928440 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-ad512516-dd3e-49bb-be9b-a97e2f136b57 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076537 Mar 08 04:12:16.929010 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:12:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:12:16.940673 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-deb3f0ca-eed6-444f-a310-a9b2ac3c2e3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:16.963352 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-deb3f0ca-eed6-444f-a310-a9b2ac3c2e3f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026371 Mar 08 04:12:16.966049 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 04:12:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:12:19.374192 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-ad512516-dd3e-49bb-be9b-a97e2f136b57 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:19.375214 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-ad512516-dd3e-49bb-be9b-a97e2f136b57 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Mar 08 04:12:19.375882 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:19.437598 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-0b19e317-2853-438a-862b-1f299b372fa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "name": "m1.xlarge"}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:19.458315 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-0b19e317-2853-438a-862b-1f299b372fa3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076453 Mar 08 04:12:19.458863 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 04:12:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:12:19.470668 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-1f3d5e85-7d35-452b-8aa8-3ee4f9cb0ca9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:19.496174 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-1f3d5e85-7d35-452b-8aa8-3ee4f9cb0ca9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029396 Mar 08 04:12:19.509690 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 04:12:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:12:42.700330 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-0b19e317-2853-438a-862b-1f299b372fa3 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:42.701342 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-0b19e317-2853-438a-862b-1f299b372fa3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Mar 08 04:12:42.701775 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:42.758154 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-23240c48-4fd2-4f4a-a9c2-3b5d0055d9c8 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:42.774861 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-23240c48-4fd2-4f4a-a9c2-3b5d0055d9c8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066643 Mar 08 04:12:42.775399 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Mar 8 04:12:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:12:44.147999 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-0b19e317-2853-438a-862b-1f299b372fa3 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:44.149000 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-0b19e317-2853-438a-862b-1f299b372fa3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Mar 08 04:12:44.149396 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:44.368576 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-ba306d16-5acf-46d0-af7d-4ad5c26a6d99 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:44.374006 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.wsgi [None req-ba306d16-5acf-46d0-af7d-4ad5c26a6d99 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 04:12:44.374568 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-ba306d16-5acf-46d0-af7d-4ad5c26a6d99 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:12:44.375352 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-ba306d16-5acf-46d0-af7d-4ad5c26a6d99 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057349 Mar 08 04:12:44.375853 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Mar 8 04:12:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 04:12:44.386949 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-ab50a261-28fb-424c-b9b9-aa1625137969 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:44.407272 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-ab50a261-28fb-424c-b9b9-aa1625137969 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023948 Mar 08 04:12:44.407832 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 04:12:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:12:44.417579 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-88de1ddc-eda4-4ee3-baf5-3c2a5ef139f3 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:44.438727 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-88de1ddc-eda4-4ee3-baf5-3c2a5ef139f3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024690 Mar 08 04:12:44.439245 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 04:12:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:12:44.449048 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-5d6448ce-3e80-4214-b1b5-7f70b4e4c2e7 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:44.454398 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.wsgi [None req-5d6448ce-3e80-4214-b1b5-7f70b4e4c2e7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 04:12:44.454958 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-5d6448ce-3e80-4214-b1b5-7f70b4e4c2e7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:12:44.455780 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-5d6448ce-3e80-4214-b1b5-7f70b4e4c2e7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010226 Mar 08 04:12:44.456397 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Mar 8 04:12:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 04:12:45.704026 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-88de1ddc-eda4-4ee3-baf5-3c2a5ef139f3 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:45.705038 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-88de1ddc-eda4-4ee3-baf5-3c2a5ef139f3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Mar 08 04:12:45.705435 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:45.895645 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-f6dea8ec-84ef-44bd-8fcc-225a3c5d7baf admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:45.900850 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.wsgi [None req-f6dea8ec-84ef-44bd-8fcc-225a3c5d7baf admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 04:12:45.901407 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-f6dea8ec-84ef-44bd-8fcc-225a3c5d7baf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:12:45.902229 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-f6dea8ec-84ef-44bd-8fcc-225a3c5d7baf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058889 Mar 08 04:12:45.902738 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Mar 8 04:12:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 04:12:45.920373 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-63e0b572-085b-48bd-bab8-3540623cb284 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:45.934681 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-63e0b572-085b-48bd-bab8-3540623cb284 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018001 Mar 08 04:12:45.935213 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 04:12:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:12:45.945332 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-d60349cf-405b-4a09-b84b-5e4420a71b5a admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:45.958743 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-d60349cf-405b-4a09-b84b-5e4420a71b5a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016876 Mar 08 04:12:45.959254 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 04:12:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:12:45.968299 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-f509b2c2-987e-4d12-b8b7-f0a5c06af0fe admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:45.973684 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.wsgi [None req-f509b2c2-987e-4d12-b8b7-f0a5c06af0fe admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 04:12:45.974245 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-f509b2c2-987e-4d12-b8b7-f0a5c06af0fe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:12:45.975013 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-f509b2c2-987e-4d12-b8b7-f0a5c06af0fe admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010213 Mar 08 04:12:45.975492 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Mar 8 04:12:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 04:12:47.236749 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-d60349cf-405b-4a09-b84b-5e4420a71b5a admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:47.238588 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-d60349cf-405b-4a09-b84b-5e4420a71b5a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002242 Mar 08 04:12:47.238981 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:47.428076 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-f2d1ce5e-f284-4509-ab08-41f60d2d3d70 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:47.433406 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.wsgi [None req-f2d1ce5e-f284-4509-ab08-41f60d2d3d70 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 04:12:47.434000 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-f2d1ce5e-f284-4509-ab08-41f60d2d3d70 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:12:47.434795 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-f2d1ce5e-f284-4509-ab08-41f60d2d3d70 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057925 Mar 08 04:12:47.435306 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 04:12:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 04:12:47.445348 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-f54dfd1c-3401-4917-af85-6dc946a74d55 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:47.458744 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-f54dfd1c-3401-4917-af85-6dc946a74d55 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016860 Mar 08 04:12:47.459275 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 04:12:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:12:47.470096 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:47.482798 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017939 Mar 08 04:12:47.483316 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 04:12:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:12:47.492873 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-a34e4a9b-b18f-4f60-b4fd-d39dfb2124a2 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:47.497951 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.wsgi [None req-a34e4a9b-b18f-4f60-b4fd-d39dfb2124a2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 04:12:47.498511 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-a34e4a9b-b18f-4f60-b4fd-d39dfb2124a2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:12:47.499279 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-a34e4a9b-b18f-4f60-b4fd-d39dfb2124a2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009911 Mar 08 04:12:47.499755 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 04:12:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 04:12:48.790684 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:48.791682 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Mar 08 04:12:48.792068 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:48.979094 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-3cca4c40-e5fa-4941-a5f7-4da377578aa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:48.997786 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-3cca4c40-e5fa-4941-a5f7-4da377578aa3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068899 Mar 08 04:12:48.998317 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Mar 8 04:12:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:12:50.267678 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:50.269213 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Mar 08 04:12:50.269607 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:12:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:50.464329 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-60fdcb75-18cf-4608-aa39-9489b29e7494 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:50.481420 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-60fdcb75-18cf-4608-aa39-9489b29e7494 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.076124 Mar 08 04:12:50.481942 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Mar 8 04:12:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:12:51.747712 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:51.748733 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Mar 08 04:12:51.749159 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:51.938365 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-b8f54578-d38e-49d2-96de-ae41ed1c2ec2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:51.956180 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-b8f54578-d38e-49d2-96de-ae41ed1c2ec2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068280 Mar 08 04:12:51.956642 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Mar 8 04:12:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:12:53.238685 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:53.239676 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Mar 08 04:12:53.240068 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:12:53.429331 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-3282dfee-4349-408a-a0b4-a0887e9f598d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:12:53.446907 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-3282dfee-4349-408a-a0b4-a0887e9f598d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069589 Mar 08 04:12:53.447377 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Mar 8 04:12:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 04:12:54.714144 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:54.715390 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Mar 08 04:12:54.715587 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:12:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:12:54.902483 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-8655a405-5847-433b-8297-7625679aa7d7 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:12:54.921764 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-8655a405-5847-433b-8297-7625679aa7d7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068867 Mar 08 04:12:54.922283 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Mar 8 04:12:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:13:45.469302 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:13:45.470356 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-623354f7-126f-4fb3-b130-0e9afa0b4a72 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Mar 08 04:13:45.470752 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 04:13:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:13:45.527837 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-b9387990-ea65-4401-8d06-8a9e226298e3 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:13:45.546977 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-b9387990-ea65-4401-8d06-8a9e226298e3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069848 Mar 08 04:13:45.547499 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Mar 8 04:13:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:13:45.569636 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-5dd28f63-ce67-4260-8c73-88120ce0afa9 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:13:45.577117 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-5dd28f63-ce67-4260-8c73-88120ce0afa9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011185 Mar 08 04:13:45.577618 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Tue Mar 8 04:13:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:13:45.588682 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-c13f1f18-1b98-4556-a341-8e9e2c760386 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:13:45.595962 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-c13f1f18-1b98-4556-a341-8e9e2c760386 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010721 Mar 08 04:13:45.596968 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Tue Mar 8 04:13:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:13:45.608079 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-55fab2f6-e3d4-4e01-baae-5c94d46f4bc5 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:13:45.616000 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-55fab2f6-e3d4-4e01-baae-5c94d46f4bc5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011472 Mar 08 04:13:45.616510 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Tue Mar 8 04:13:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:13:45.627192 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:13:45.634769 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010921 Mar 08 04:13:45.635289 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Tue Mar 8 04:13:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:15:16.279496 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-26545c81-5048-4645-b359-3a84f032a0f4 tempest-verify_tempest_config-2117160120 tempest-verify_tempest_config-2117160120-project] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:15:16.281562 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-26545c81-5048-4645-b359-3a84f032a0f4 tempest-verify_tempest_config-2117160120 tempest-verify_tempest_config-2117160120-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105471 Mar 08 04:15:16.282125 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1133 bytes} [Tue Mar 8 04:15:16 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:16:53.343511 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:16:53.344550 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Mar 08 04:16:53.344912 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:16:53.600097 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-64aa4568-6466-46ce-90bc-6114178e3fd6 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:16:53.601247 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 04:16:53.601247 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: warnings.warn(msg) Mar 08 04:16:53.602476 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-64aa4568-6466-46ce-90bc-6114178e3fd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:16:53.602943 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-64aa4568-6466-46ce-90bc-6114178e3fd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:16:53.603717 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-64aa4568-6466-46ce-90bc-6114178e3fd6 admin admin] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:16:53.604133 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-64aa4568-6466-46ce-90bc-6114178e3fd6 admin admin] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:16:53.637930 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-64aa4568-6466-46ce-90bc-6114178e3fd6 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.149426 Mar 08 04:16:53.638481 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 35/71] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 04:16:53 2022] GET /compute/v2.1/os-services => generated 794 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:16:54.916427 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:16:54.917432 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Mar 08 04:16:54.917854 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:16:55.111062 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-b963bd34-6d3f-4549-bb76-0611f8f7c2ba admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:16:55.112304 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 04:16:55.112304 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: warnings.warn(msg) Mar 08 04:16:55.114027 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-b963bd34-6d3f-4549-bb76-0611f8f7c2ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:16:55.114468 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-b963bd34-6d3f-4549-bb76-0611f8f7c2ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:16:55.115402 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-b963bd34-6d3f-4549-bb76-0611f8f7c2ba admin admin] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:16:55.115831 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-b963bd34-6d3f-4549-bb76-0611f8f7c2ba admin admin] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:16:55.135361 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-b963bd34-6d3f-4549-bb76-0611f8f7c2ba admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077244 Mar 08 04:16:55.135938 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 36/73] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 04:16:55 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:17:06.847570 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:17:06.848855 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001727 Mar 08 04:17:06.849252 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 38/74] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:17:07.040171 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-759cc2af-4853-46cf-81d3-491f7d40e567 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:17:07.041395 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 04:17:07.041395 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: warnings.warn(msg) Mar 08 04:17:07.042611 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-759cc2af-4853-46cf-81d3-491f7d40e567 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:17:07.043048 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-759cc2af-4853-46cf-81d3-491f7d40e567 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:17:07.043824 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-759cc2af-4853-46cf-81d3-491f7d40e567 admin admin] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:17:07.044244 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-759cc2af-4853-46cf-81d3-491f7d40e567 admin admin] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:17:07.069011 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-759cc2af-4853-46cf-81d3-491f7d40e567 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080148 Mar 08 04:17:07.069484 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 37/75] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 04:17:06 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:17:08.349424 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: DEBUG nova.api.openstack.wsgi [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] Calling method '>' {{(pid=102326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:17:08.350450 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: INFO nova.api.openstack.requestlog [None req-52c8253c-0d53-49c6-a37a-8f2b59db62f9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Mar 08 04:17:08.350842 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: [pid: 102326|app: 0|req: 39/76] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 04:17:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:17:08.541343 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG nova.api.openstack.wsgi [None req-5305f359-1fc8-415e-935d-0657eeb01497 admin admin] Calling method '>' {{(pid=102327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:17:08.542528 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 04:17:08.542528 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: warnings.warn(msg) Mar 08 04:17:08.543719 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-5305f359-1fc8-415e-935d-0657eeb01497 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:17:08.544187 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-5305f359-1fc8-415e-935d-0657eeb01497 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:17:08.544971 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-5305f359-1fc8-415e-935d-0657eeb01497 admin admin] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:17:08.545399 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: DEBUG oslo_concurrency.lockutils [None req-5305f359-1fc8-415e-935d-0657eeb01497 admin admin] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:17:08.566290 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: INFO nova.api.openstack.requestlog [None req-5305f359-1fc8-415e-935d-0657eeb01497 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076023 Mar 08 04:17:08.566922 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: [pid: 102327|app: 0|req: 38/77] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 04:17:08 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:18:08.325287 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: Tue Mar 8 04:18:08 2022 - graceful shutdown triggered... Mar 08 04:18:08.325857 dv-cinder-733062-29-iscsi devstack@n-api.service[102327]: Gracefully killing worker 2 (pid: 102327)... Mar 08 04:18:08.325534 dv-cinder-733062-29-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 08 04:18:08.326687 dv-cinder-733062-29-iscsi devstack@n-api.service[102326]: Gracefully killing worker 1 (pid: 102326)... Mar 08 04:18:09.325774 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: worker 1 buried after 1 seconds Mar 08 04:18:09.325774 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: worker 2 buried after 1 seconds Mar 08 04:18:09.325774 dv-cinder-733062-29-iscsi devstack@n-api.service[102325]: goodbye to uWSGI. Mar 08 04:18:09.327304 dv-cinder-733062-29-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 08 04:18:09.327880 dv-cinder-733062-29-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 08 04:18:09.330627 dv-cinder-733062-29-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 04:18:09.344902 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 04:18:09 2022] *** Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: nodename: dv-cinder-733062-29-iscsi Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: machine: x86_64 Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: clock source: unix Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: pcre jit disabled Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: detected number of CPU cores: 4 Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: current working directory: / Mar 08 04:18:09.359981 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: detected binary path: /usr/bin/uwsgi-core Mar 08 04:18:09.360784 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: your processes number limit is 47680 Mar 08 04:18:09.360784 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: your memory page size is 4096 bytes Mar 08 04:18:09.360784 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: detected max file descriptor number: 2048 Mar 08 04:18:09.360784 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: lock engine: pthread robust mutexes Mar 08 04:18:09.360784 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: thunder lock: enabled Mar 08 04:18:09.360784 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 04:18:09.360784 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 04:18:09.406714 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: Python main interpreter initialized at 0x5575809e39c0 Mar 08 04:18:09.406714 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: python threads support enabled Mar 08 04:18:09.406714 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: your server socket listen backlog is limited to 100 connections Mar 08 04:18:09.406714 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: your mercy for graceful operations on workers is 90 seconds Mar 08 04:18:09.407169 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 04:18:09.407169 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: *** Operational MODE: preforking *** Mar 08 04:18:09.407413 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: *** uWSGI is running in multiple interpreter mode *** Mar 08 04:18:09.407413 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: spawned uWSGI master process (pid: 116754) Mar 08 04:18:09.407616 dv-cinder-733062-29-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 04:18:09.408179 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: spawned uWSGI worker 1 (pid: 116774, cores: 1) Mar 08 04:18:09.410039 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: spawned uWSGI worker 2 (pid: 116775, cores: 1) Mar 08 04:18:09.410039 dv-cinder-733062-29-iscsi devstack@n-api.service[116754]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 04:18:11.320009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 04:18:11.320009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: from cryptography.utils import int_from_bytes Mar 08 04:18:11.320702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 04:18:11.320702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: from cryptography.utils import int_from_bytes Mar 08 04:18:11.333517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 04:18:11.333517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: from cryptography.utils import int_from_bytes Mar 08 04:18:11.334067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 04:18:11.334067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: from cryptography.utils import int_from_bytes Mar 08 04:18:13.739221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 04:18:13.739820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 04:18:13.740120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 04:18:13.740348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 04:18:13.740609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 04:18:13.741005 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.741422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.741934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.742261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.742597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.742925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.743236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.743562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.743898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.744214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.744484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.744814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-29-iscsi {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.745140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.745452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.745806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.746132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.746441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.746765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.747074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.747584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.749067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.749067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.749067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.749067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.749404 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.749635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.749910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.750222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.750547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.750872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.751264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-29-iscsi {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.751587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.751905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.752219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.752642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.752968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.753282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.753605 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.753978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.754299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.754624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.754953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.755268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.755590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.755897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.756213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.756528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.756852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.757826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.758142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.758399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.758714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.759041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.759371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.759701 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.759961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.760217 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.761321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.761321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.761321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.761875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.761875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.762191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.762390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.762699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.763012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.763326 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.763663 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.763980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.764317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.764626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.764953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.765361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.765615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.765971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.766324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.766651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.766967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.767295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.767624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.767939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.768254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.768583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.768897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.769240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.769554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.769834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.770147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.770456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.770779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.771091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.771401 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.771712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.772092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.772314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.773293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.774156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.774156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.774519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.774781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.775080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.775386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.775701 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.776030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.776359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.776676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.776989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.777303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.777618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.777972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.778285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.778597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.778923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.779233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.779543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.779866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.780178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.780490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.780814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.781120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.781431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.781774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.782087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.782400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.782708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.783017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.783325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.783648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.783963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.784255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.784812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.785136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.785459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.785801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.786116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.786426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.786752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.787097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.787433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.787782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.788122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.788464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.788805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.789126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.789441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.789801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.790136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.790452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.790767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.791082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.791405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.791728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.792062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.792381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.792701 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.793025 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.793341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.793702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.794024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.794354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.794667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.795012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.795360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.795676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.796004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.796332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.796647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.796786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 04:18:13.797210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.797300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 04:18:13.797385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.797553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 04:18:13.797646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.797928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.798023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 04:18:13.798198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 04:18:13.798296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.798560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.798652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.798878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.798980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.799196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.799289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.799511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.799607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.799825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.799918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.800161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.800255 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.800481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.800574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.800801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.800890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.801124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.801215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.801404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.801499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.801752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.801839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.802088 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-29-iscsi {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.802171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.802404 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.802494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.802721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.802809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.803029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.803118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.803337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.803432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.803646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.803785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.804101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.804242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.804584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.804687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.804924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.805203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.805316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.805527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.805633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.805943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.806059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.806214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.806296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.806531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.806621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.806848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.806931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.807208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.807302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.807550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.807644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.807785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.807887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.808105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.808217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.808509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.808625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.808724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.808846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-29-iscsi {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.809038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.809172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.809343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.809504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.809681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.809850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.810000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.810289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.810389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.810610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.810776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.810932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.811040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.811224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.811318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.811541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.811651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.811855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.812020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.812244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.812347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.812486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.812580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.812802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.812948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.813140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.813234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.813458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.813556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.813798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.813948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.814167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.814308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.814429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.814638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.814771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.814883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.815043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.815170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.815283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.815402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.815617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.815752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.815967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.816182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.816308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.816426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.816551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.816671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.816811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.816940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.817060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.817193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.817419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.817572 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.817762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.817892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.818046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.818185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.818315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.818443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.818631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.818765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.818941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.819082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.819247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.819912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.820089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.820231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.820621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.820763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.820937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.821128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.821290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.821462 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.821632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.821889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.821986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.822227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.822319 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.822548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.822650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.822878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.822981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.823217 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.823354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.823526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.823632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.823842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.823941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.824155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.824260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.824482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.824614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.824802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.824903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.825129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.825221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.825444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.825546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.825812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.825932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.826115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.826239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.826435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.826563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.826743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.826907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.827046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.827207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.827653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.827808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.827808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.828081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.828224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.828355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.828454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.828540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.828625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.828709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.828858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.829002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.829180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.829281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.829496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.829597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.829831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.829938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.830147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.830248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.830464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.830564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.830778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.830883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.831092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.831183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.831404 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.831495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.831719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.831867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.832029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.832136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.832333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.832475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.832641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.832957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.833067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.833285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.833402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.833625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.833963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.834133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.834293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.834448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.834695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.834845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.835087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.835828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.835828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.836405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.836580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.836741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.836902 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.837050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.837203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.837361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.837513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.837719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.837881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.838035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.838187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.838345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.838496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.838651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.838756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.838852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.838946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.839092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.839190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.839285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.839370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.839519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.839650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.839836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.839968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.840163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.840379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.840472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.840621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.840783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.840914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.841097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.841241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.841412 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.841553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.841748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.842868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.843215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.843312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.843408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.843577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.843674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.843768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.843861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.843947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.844031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.844131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.844226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.844312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.844405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.844491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.844585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.844697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.844785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.844870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.844962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 04:18:13.845049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.845142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.845356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.845485 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.845690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.845863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.846010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.846192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.846331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.846537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.846649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.846878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.846995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.847207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.847313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.847529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.847677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.847839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.847987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.848154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.848276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.848469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.848593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.848786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.848915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.849133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.849260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.849409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.849529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.849754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.849958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.850082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.850203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.850366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.850491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.850748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.850889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.851332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.851490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.851750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.851891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.852071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.852212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.852393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.852527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.852784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.852936 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.853080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.853218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.853355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.853491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.853718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.853868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.854523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.854616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.854710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.854797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.854896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.854990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.855076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.855160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.855252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.855355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.855533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.855673 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.855844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.855963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.856155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.856308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.856456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.856616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.856771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.856947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.857078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.857271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.857371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.857595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.857745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.857940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.858039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.858262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.858359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.858584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.858687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.858898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.859000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.859204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.859300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.859528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.859624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.859840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.859937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.860147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.860243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.860457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.860560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.860765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.860866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.861093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.861203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.861406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.861510 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.861740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.861851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.862054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.862149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.862372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.862481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.862687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.862849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.863015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.863112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.863340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.863444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.863648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.863743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.863956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.864054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.864262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.864374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.864579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.864674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.864893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.864996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.865199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.865297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.865508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.865609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.865849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.865945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.866164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.866302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.866615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.866778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.866926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.867157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.867267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.867491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.867595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.867815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.867919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.868143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.868295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.868452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.868580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.868758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.868880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.869071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.869204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.869388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.869514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.869696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.869833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.870015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.870257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.870500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.870651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.870770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.870890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.871017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.871132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.871253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.871366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.871508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.871640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.871822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.871944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.872135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.872257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.872442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.872579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.872768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.872891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.873139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.873271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.873394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.873523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.873696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.873823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.874011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.874146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.874322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.874528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.874645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.874758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.874929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.875051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.875253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.875387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.875573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.875765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.875904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.876001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.876180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.876276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.876485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.876661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.876812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.876910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.877087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.877184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.877384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.877481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.877713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.877847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.878026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.878126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.878320 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.878423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.878626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.878730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.878931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.879059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.879257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.879431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.879637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.879808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.879959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.880103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.880196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.880365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.880461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.880688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.880792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.881006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.881174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.881342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.881549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.882380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.882577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.882700 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.882795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.883038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.883359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.883491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.883677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.883779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.883997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.884100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.884315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.884536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.884689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.884833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.884973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.885126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.885279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.885441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.885596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.885943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.886142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.886318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.886520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.886674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.886824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.886970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.887117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.887259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.887478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.887671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.887825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.887986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.888164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.888335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.888501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.888646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.888822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.888992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.889144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.889144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.889432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.889577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.889801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.889948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.890092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.890260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.890414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.890568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.890714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.890854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.891006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.891163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.891387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.891538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.891692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.891835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.891977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.892129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.892272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.892432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.892582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.892727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.892880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.893029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.893180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.893350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.893442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.893625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.893752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.893842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.893937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.894031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.894126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.894220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.894316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.894403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.894555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.894797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.894901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.895115 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.895220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.895432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.895547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.895740 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.895844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.896054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.896150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.896368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.896463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.896687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.896782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.897004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.897097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.897315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.897456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.898254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.898385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.898714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.898839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.899035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.899178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.899354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.899518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.899666 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.899847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.899975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.900182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.900274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.900518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.900618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.900835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.900935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.901152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.901243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.901486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.901586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.901835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.901940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.902146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.902247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.902460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.902558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.902776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.902868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.903130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.903222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.903453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.903562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.903768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.903859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.904095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.904200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.904427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.904519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.904746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.904838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.905071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.905171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.905390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.905505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.905742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.905841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.906041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.906164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.906355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.906455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.906670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.906768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.906991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.907092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.907308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.907489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.907651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.907803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.907970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.908121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.908295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.908444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.908590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.908734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.908963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.909126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.909270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.909693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.909802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.909891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.910057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.910163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.910385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.910488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.910764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.910972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.911076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.911315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.911413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.911678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.911778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.911979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.912320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.912646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.912738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.912984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.913069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.913387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.913845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.914050 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.914179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.914369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.914545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.914687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.914868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.915004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.915193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.915316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.915513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.915614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.916106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.916293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.916609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.916927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.917042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.917239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.917350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.917600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.917718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.917884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.918199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.918320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.918434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.918659 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.918767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.918855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.919034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.919135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.919369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.919503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.919692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.919791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.920010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.920102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.920324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.920425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.920637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.920729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.920949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.921049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.921263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.921363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.921576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.921763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.921955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.922061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.922276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.922460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.922622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.922768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.922912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.923071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.923225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.923377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.923555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.923701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.923877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.923987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.924211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.924359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.924512 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.924654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.924805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.924949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.925110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.925264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.925407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.925553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.925734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.925841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.926033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.926168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.926390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.926504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.926657 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.926826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.926970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.927067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.927278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.927386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.927592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.927761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.927903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.928006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.928213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.928573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.928573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.929336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.929478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.929570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.929769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.929968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.930070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.930353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.930448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.930676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.930777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.930997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.931114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.931315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.931485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.931631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.931787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.931942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.932097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.932249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.932394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.932548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.932694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.932847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.933006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.933149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.933293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.933445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.933592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.933812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.933974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.934118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.934263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.934415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.934568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.934734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.934887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.935038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.935192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.935344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.935495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.935652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.935806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.935951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.936171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.936328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.936472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.936615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.936794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.936892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.937117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.937214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.937428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.937532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.937772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.937897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.938083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.938200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.938394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.938500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.938706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.938828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.939023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.939184 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.939331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.939433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.939637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.939740 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.939965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.940103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.940278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.940373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.940586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.940734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.940915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.941002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.941230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.941323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.941542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.941628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.941887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.942265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.942565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.942680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.942883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.943007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.943194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.943371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.943513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.943693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.943834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.944068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.944161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.944969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.945068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.945408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.945625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.946008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.946360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.946699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.947033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.947373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.947713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.948061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.948414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.948752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.949088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.949414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.949774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.950027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.950331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.950502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.950651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.950798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.950996 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.951158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.951334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.951504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.951658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.951811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.951987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.952139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.952317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.952469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.952655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.952816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.952961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.953121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.953266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.953421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.953568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.953785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.953947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.954122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.954281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.954463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.954622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.954845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.955002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.955159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.955305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.955457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.955627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.955781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.955926 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.956205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.956437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.956722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.956893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.957039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.957181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.957330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.957481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.957634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.957820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.958059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.958216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.958362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.958522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.958750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.958921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.959066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.959210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.959353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.959504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.959647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.959939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.960134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.960357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.960518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.960680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.960837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.961013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.961214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.961364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.961515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.961731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.961956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.962162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.962316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.962472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.962618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.962769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.962923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.963068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.963224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.963369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.963558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.963726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.963872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.964023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.964174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.964327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.964491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.964647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.964791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.964943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.965088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.966165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.966346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.966346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.966739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.966993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.966993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.967287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.967439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.967605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.967759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.967916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.968080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.968309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.968472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.968618 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.968783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.968783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.969148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.969295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.969453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.969607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.969836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.969984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.970137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.970283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.970283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.970653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.970803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.970963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.971120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.971272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.971426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.971579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.971735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.971919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.972256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.972681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.973010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.973172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.973319 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.973472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.974184 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.974363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.974363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.974655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.974801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.974956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.975101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.975254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.975254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.975530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.975770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.975956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.976114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.976270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.976430 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.976674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.976898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.977157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.977339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.977487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.977649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.977855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.978010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.978164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.978341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.978572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.978729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.978883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.979052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.979272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.979499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.979654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.979800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.979800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.980083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.980235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.980380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.980523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.980523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.980805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.980951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.981114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.981267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.981432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.981577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.981805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.981956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.982121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.982267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.982411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.982562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.982707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.982859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.983019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.983163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.983318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.983470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.983659 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.983821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.983978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.984122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.984265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.984408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.984551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.984703 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.984847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.985000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.985151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.985304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.985457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.985610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.985794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.985938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.986099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.986244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.986435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.986592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.986738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.986984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.987157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.987408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.987568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.987713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.987858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.988001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.988153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.988306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.988461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.988697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.988697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.988978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.989122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.989292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.989526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.989696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.989847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.990001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.990154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.990314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.990467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.990612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.990755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.990755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.991047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.991722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.991932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.992169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.992374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.992523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.992669 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.992822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.992967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.993111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.993263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.993408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.993561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.993735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.993895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.994058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.994058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.994465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.994629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.994775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.994919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.995063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.995213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.995365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.995519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.995663 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.995814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.995969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.996128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.996273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.996429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.996576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.996728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.996874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.997035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.997035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.997423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.997701 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.997868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.998014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.998159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.998328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.998482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.998629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.998866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.999025 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.999171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.999328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.999498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.999724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:13.999887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.000047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.000192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.000349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.000349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.000644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.000798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.000958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.001107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.001266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.001412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.001564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.001729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.001889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.002047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.002192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.002347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.002493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.002645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.002792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.002945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.002945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.003239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.003384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.003528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.003672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.003831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.003975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.004119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.004280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.004426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.004578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.004730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.004887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.005040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.005184 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.005327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.005483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.005636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.005803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.005960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.006115 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.006261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.006413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.006565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.006778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.007569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.007962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.008118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.008281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.008428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.008581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.008734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.008903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.009142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.009299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.009453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.009604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.009902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.010059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.010059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.010427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.010572 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.010716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.010868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.011020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.011190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.011343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.011488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.011642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.011794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.011948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.012093 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 04:18:14.012241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.012392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.012665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.012993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.013325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.013651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.014043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.014369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.014684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.015075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.015411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.015877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.016208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.016530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.016855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.017287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.017611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.018027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.018282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.018607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.019061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.019415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.019744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.020244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.020575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.020906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.021451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.021801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.022148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.023147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.023147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.023566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.023736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.023956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.024273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.024849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.025220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.025550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.026128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.026469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.026794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.027112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.027553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.027912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.028471 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.028881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.029185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.029714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.031180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.031436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.031668 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.031955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.032272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.032597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.032931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.033263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.033578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.033924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.034249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.034838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.035149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.035471 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.035709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_db.sqlalchemy.engines [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:18:14.035894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.036190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.036417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.036750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.037045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.037396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.037913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.038092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.038545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.038735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.039061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.039631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.039802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.040402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.040402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.040714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.040995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.041374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.041737 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.042056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.042431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.042701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.043021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.043361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.043683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.044002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.044364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.044690 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.045281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.045623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.045981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.046332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.046674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.046989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.047301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.047613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.048001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.048326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.048721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.048952 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.049272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.049587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.050014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.050333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.050829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.051017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.051259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.051576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.051892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.052217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.052568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.052894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.054396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.054396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.054703 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.054872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.055200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.055519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.055837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.056165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.056508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.056831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.057145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.057600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.057937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.058267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.058599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.058917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.059246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.059576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.059911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.060216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.060534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.060865 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.061235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.061541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.061900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.062215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.062528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.062840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.063313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.063651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.063970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.064279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.064591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.064908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.065221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.065534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.065886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.066199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.066588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.066815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.067124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.067434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.067745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.068051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.068359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.068671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.068981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.069288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.070895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.071196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.071998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.071998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.072301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.072505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.072838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.073162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.073495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.073857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.074191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.074523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.074851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.075171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.075514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.075834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.076156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.076477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.076797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.077112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.077430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.077831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.078140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.078454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.078787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.079122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.079438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.079762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.080082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.080443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.080727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.081051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.081366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.081697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.082024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.082349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.082673 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.083009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.083343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.084069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.084069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.084389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.084665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.085562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.086033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.089142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.089142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.089142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 04:18:14.089142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 04:18:14.105932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.context [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33a7eb4f-1be8-4bb2-b607-698804ce5c66(cell1) {{(pid=116774) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 04:18:14.110273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:18:14.112250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:18:14.113109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:18:14.115130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:18:14.117472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_db.sqlalchemy.engines [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:18:14.128776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_db.sqlalchemy.engines [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:18:14.129629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_db.sqlalchemy.engines [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:18:14.186029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.context [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33a7eb4f-1be8-4bb2-b607-698804ce5c66(cell1) {{(pid=116775) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 04:18:14.190301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:18:14.191862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:18:14.192683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:18:14.195798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:18:14.206671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_db.sqlalchemy.engines [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:18:14.210807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_db.sqlalchemy.engines [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:18:14.300670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_db.sqlalchemy.engines [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:18:14.370942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_db.sqlalchemy.engines [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 04:18:14.689226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: WARNING keystonemiddleware.auth_token [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 04:18:14.736687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: WARNING keystonemiddleware.auth_token [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 04:18:14.743691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: WARNING keystonemiddleware.auth_token [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 04:18:14.809039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: WARNING keystonemiddleware.auth_token [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 04:18:14.982156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: WARNING keystonemiddleware.auth_token [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 04:18:14.987268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: WARNING keystonemiddleware.auth_token [None req-e1a96fe1-fd30-48d2-b1e7-b9b72da1e0cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 04:18:14.992691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5575809e39c0 pid: 116774 (default app) Mar 08 04:18:15.037606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: WARNING keystonemiddleware.auth_token [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 04:18:15.043406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: WARNING keystonemiddleware.auth_token [None req-2153af91-1ee8-4613-85b0-f258b8fbce4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 04:18:15.048751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5575809e39c0 pid: 116775 (default app) Mar 08 04:18:54.744042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-276bb66f-6600-4c55-ad83-5ae441058606 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Action: 'create', calling method: .version_select at 0x7fe83440ac10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-580197187"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:18:55.781116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-15a05506-f04f-4f7d-be26-322651fc8ca7 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Action: 'create', calling method: .version_select at 0x7fe83439d1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-889061636", "metadata": {"Type": "work"}}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:18:57.268975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-276bb66f-6600-4c55-ad83-5ae441058606 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.584262 Mar 08 04:18:57.276546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1154 bytes} [Tue Mar 8 04:18:53 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3593 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 08 04:18:57.441481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-15a05506-f04f-4f7d-be26-322651fc8ca7 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.839145 Mar 08 04:18:57.448843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1/2] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Mar 8 04:18:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2842 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 08 04:18:57.448843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a2f4f47d-af12-4b95-be93-ac64059e737b tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe8342741f0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:57.576996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a2f4f47d-af12-4b95-be93-ac64059e737b tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6" status: 200 len: 344 microversion: 2.1 time: 0.133126 Mar 08 04:18:57.577884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:18:57 2022] GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:18:57.582418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b2f564a4-c2df-4b81-860c-4dac2607c3bb tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Calling method '.version_select at 0x7fe834274310>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:57.619312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1606842669", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "networks": [{"uuid": "a9ec9460-77f3-4ecc-83ef-778c34aba933"}]}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:18:57.718064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b2f564a4-c2df-4b81-860c-4dac2607c3bb tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77" status: 200 len: 352 microversion: 2.1 time: 0.139045 Mar 08 04:18:57.719279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:18:57 2022] GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77 => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:18:57.797356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] validate_networks() for [('a9ec9460-77f3-4ecc-83ef-778c34aba933', None, None, None, None, None)] {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:18:58.589342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-19ab7f1e-1a70-4ed9-9398-32a9b9b183ba tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe8342749d0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:58.687717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-19ab7f1e-1a70-4ed9-9398-32a9b9b183ba tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6" status: 200 len: 345 microversion: 2.1 time: 0.102040 Mar 08 04:18:58.688283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 4/5] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:18:58 2022] GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6 => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:18:58.701176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bed155c7-022b-4ff4-b169-e8c923cc4d22 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Action: 'create', calling method: .version_select at 0x7fe83427f040>, body: {"snapshot": {"volume_id": "1232988c-ea88-476f-b592-635326031cb6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-961300829"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:18:59.000372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bed155c7-022b-4ff4-b169-e8c923cc4d22 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.303498 Mar 08 04:18:59.001241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 5/6] 10.222.0.30 () {60 vars in 1161 bytes} [Tue Mar 8 04:18:58 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:18:59.006232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c8f41ac3-d254-4f62-adb2-cbd241f00a33 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Calling method '.version_select at 0x7fe834274d30>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:59.101310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c8f41ac3-d254-4f62-adb2-cbd241f00a33 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77" status: 200 len: 353 microversion: 2.1 time: 0.098916 Mar 08 04:18:59.109182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 6/7] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:18:59 2022] GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:18:59.114935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6f613edf-7721-4361-bef6-6908a6fa1549 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe834274670>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:59.167154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6f613edf-7721-4361-bef6-6908a6fa1549 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076" status: 200 len: 286 microversion: 2.1 time: 0.056607 Mar 08 04:18:59.173176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 7/8] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 04:18:59 2022] GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:18:59.178296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-99ced820-9988-47e4-967f-e98992060ede tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Calling method '.version_select at 0x7fe83427f700>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:59.262905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-99ced820-9988-47e4-967f-e98992060ede tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77" status: 200 len: 353 microversion: 2.1 time: 0.088548 Mar 08 04:18:59.264020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 8/9] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:18:59 2022] GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:18:59.280972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-00482f39-730b-429d-93a6-0540b4ab0aae tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe834274310>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:59.386816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-00482f39-730b-429d-93a6-0540b4ab0aae tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.111290 Mar 08 04:18:59.393046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 9/10] 10.222.0.30 () {58 vars in 1139 bytes} [Tue Mar 8 04:18:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:18:59.393046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a318ac16-beac-4cec-87fa-5b9b3b3f17a9 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Calling method '.version_select at 0x7fe83427f430>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:59.510826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a318ac16-beac-4cec-87fa-5b9b3b3f17a9 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77" status: 202 len: 0 microversion: 2.1 time: 0.121116 Mar 08 04:18:59.514084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 10/11] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:18:59 2022] DELETE /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:18:59.518566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4a70f50a-0f8e-48b0-8d31-25e77a0b91d2 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe83427f310>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:59.584782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4a70f50a-0f8e-48b0-8d31-25e77a0b91d2 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076" status: 200 len: 286 microversion: 2.1 time: 0.071805 Mar 08 04:18:59.589300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 11/12] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 04:18:59 2022] GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:18:59.600397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ffc517d2-ecf9-49cb-87db-98bf6ada4458 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Calling method '.version_select at 0x7fe834274e50>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:59.616319 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:18:59.616836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:18:59.617690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:18:59.618321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:18:59.619416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:18:59.655221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:18:59.655993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:18:59.656963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:18:59.665993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:18:59.712294 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ffc517d2-ecf9-49cb-87db-98bf6ada4458 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77" status: 200 len: 352 microversion: 2.1 time: 0.121528 Mar 08 04:18:59.713167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 12/13] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:18:59 2022] GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77 => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:18:59.722636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Getting quotas for project 6e054c47af804378914e7f89707e2245. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:18:59.731084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Getting quotas for user 138970b8b01540b5a50e7ab56d39d436 and project 6e054c47af804378914e7f89707e2245. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:18:59.748764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:18:59.751992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:18:59.907370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-32648db5-d491-437d-a13e-df2611d642f7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.629440 Mar 08 04:18:59.908580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 2/14] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:18:59.919680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6c914d3f-b749-4ab0-9f14-900ca2bd4b24 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:18:59.926558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6c914d3f-b749-4ab0-9f14-900ca2bd4b24 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:00.363594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6c914d3f-b749-4ab0-9f14-900ca2bd4b24 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:00.393433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6c914d3f-b749-4ab0-9f14-900ca2bd4b24 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1215 microversion: 2.1 time: 0.477476 Mar 08 04:19:00.397606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 13/15] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:18:59 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1215 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:00.601903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b39d32b6-790c-4526-8f7a-9560ab6850ca tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe8339815e0>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:00.724963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d29ac46d-ebc0-4abe-b389-c084497cdf12 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Calling method '.version_select at 0x7fe834274dc0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:00.792244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b39d32b6-790c-4526-8f7a-9560ab6850ca tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076" status: 200 len: 286 microversion: 2.1 time: 0.195210 Mar 08 04:19:00.793169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 3/16] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 04:19:00 2022] GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:00.909342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d29ac46d-ebc0-4abe-b389-c084497cdf12 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77" status: 200 len: 352 microversion: 2.1 time: 0.188597 Mar 08 04:19:00.910504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 14/17] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:19:00 2022] GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77 => generated 352 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:01.429383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-97fa312a-0640-4658-9101-8a7ed13554f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:01.431070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-97fa312a-0640-4658-9101-8a7ed13554f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:01.634733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-97fa312a-0640-4658-9101-8a7ed13554f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:01.662163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-97fa312a-0640-4658-9101-8a7ed13554f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1215 microversion: 2.1 time: 0.245248 Mar 08 04:19:01.674386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 4/18] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:01 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:01.805205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9d7d84b4-9471-47b4-b84d-a2a80bc31cfd tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe834241e50>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:01.881653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9d7d84b4-9471-47b4-b84d-a2a80bc31cfd tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076" status: 200 len: 286 microversion: 2.1 time: 0.081356 Mar 08 04:19:01.882237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 15/19] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 04:19:01 2022] GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:01.924046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-86909440-8702-4d37-bdbe-7c17a466fc27 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Calling method '.version_select at 0x7fe83398c4c0>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:02.069972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-86909440-8702-4d37-bdbe-7c17a466fc27 tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77" status: 200 len: 352 microversion: 2.1 time: 0.150632 Mar 08 04:19:02.074709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 5/20] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:19:01 2022] GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77 => generated 352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:02.682897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e16f313c-b129-4c8e-b694-21e43e48e30e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:02.689046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e16f313c-b129-4c8e-b694-21e43e48e30e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:02.710195 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e16f313c-b129-4c8e-b694-21e43e48e30e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:02.711672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e16f313c-b129-4c8e-b694-21e43e48e30e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:02.714048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e16f313c-b129-4c8e-b694-21e43e48e30e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:02.716761 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e16f313c-b129-4c8e-b694-21e43e48e30e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:02.895137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5b555264-e07a-4d32-aaf5-ce0cf2591207 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe83312bd30>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:02.964877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5b555264-e07a-4d32-aaf5-ce0cf2591207 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076" status: 200 len: 287 microversion: 2.1 time: 0.073587 Mar 08 04:19:02.966284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 6/21] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 04:19:02 2022] GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:02.976784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-eae2c742-5eaa-4299-9caf-521e5df46037 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe8331354c0>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:03.140587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-eae2c742-5eaa-4299-9caf-521e5df46037 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076" status: 202 len: 0 microversion: 2.1 time: 0.167670 Mar 08 04:19:03.141187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 7/22] 10.222.0.30 () {58 vars in 1253 bytes} [Tue Mar 8 04:19:02 2022] DELETE /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 04:19:03.149546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2f259626-d8d4-4192-ad4f-4861cddcc2ea tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Calling method '.version_select at 0x7fe83312bc10>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:03.211445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-2f259626-d8d4-4192-ad4f-4861cddcc2ea tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] HTTP exception thrown: Volume 2be10f7c-577f-46b7-b374-f33e83c9aa77 could not be found. Mar 08 04:19:03.212953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2f259626-d8d4-4192-ad4f-4861cddcc2ea tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] Returning 404 to user: Volume 2be10f7c-577f-46b7-b374-f33e83c9aa77 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:19:03.214057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2f259626-d8d4-4192-ad4f-4861cddcc2ea tempest-VolumesGetTestJSON-1185034607 tempest-VolumesGetTestJSON-1185034607-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77" status: 404 len: 109 microversion: 2.1 time: 0.071802 Mar 08 04:19:03.215195 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 8/23] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:19:03 2022] GET /compute/v2.1/os-volumes/2be10f7c-577f-46b7-b374-f33e83c9aa77 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:19:03.240722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e2740635-13c4-42e1-aec9-4b8ec0e5772e tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe834bf94c0>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:03.339484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e16f313c-b129-4c8e-b694-21e43e48e30e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:03.355317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e2740635-13c4-42e1-aec9-4b8ec0e5772e tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076" status: 200 len: 286 microversion: 2.1 time: 0.136625 Mar 08 04:19:03.356073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 9/24] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 04:19:03 2022] GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:03.372380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e16f313c-b129-4c8e-b694-21e43e48e30e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1267 microversion: 2.1 time: 0.694375 Mar 08 04:19:03.386938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 16/25] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:02 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1267 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:04.368031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2f46c4c1-eea2-4fae-99ff-5902bb58b607 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe83312bee0>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:04.395330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-58a6c69c-a648-43f0-9ceb-415718676cdd tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:04.396557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-58a6c69c-a648-43f0-9ceb-415718676cdd tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:04.407888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58a6c69c-a648-43f0-9ceb-415718676cdd tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:04.410277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58a6c69c-a648-43f0-9ceb-415718676cdd tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:04.412960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-2f46c4c1-eea2-4fae-99ff-5902bb58b607 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] HTTP exception thrown: Snapshot 06ecd131-6f80-40fe-933d-0ba090eb9076 could not be found. Mar 08 04:19:04.413563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2f46c4c1-eea2-4fae-99ff-5902bb58b607 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Returning 404 to user: Snapshot 06ecd131-6f80-40fe-933d-0ba090eb9076 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:19:04.413998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58a6c69c-a648-43f0-9ceb-415718676cdd tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:04.414420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2f46c4c1-eea2-4fae-99ff-5902bb58b607 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076" status: 404 len: 111 microversion: 2.1 time: 0.050864 Mar 08 04:19:04.415031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58a6c69c-a648-43f0-9ceb-415718676cdd tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:04.418571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 10/26] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 04:19:04 2022] GET /compute/v2.1/os-snapshots/06ecd131-6f80-40fe-933d-0ba090eb9076 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:19:04.423707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3ba5eee9-fb89-4fa6-bba4-d5366499c0d7 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe833135a60>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:04.606931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-58a6c69c-a648-43f0-9ceb-415718676cdd tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:04.618574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-58a6c69c-a648-43f0-9ceb-415718676cdd tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1273 microversion: 2.1 time: 0.230249 Mar 08 04:19:04.630753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3ba5eee9-fb89-4fa6-bba4-d5366499c0d7 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6" status: 202 len: 0 microversion: 2.1 time: 0.210566 Mar 08 04:19:04.631725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 11/28] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:19:04 2022] DELETE /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 04:19:04.635146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 17/28] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:04 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:04.660894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5e12a09d-f2cb-44a9-bc26-c9348b4ac72f tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe834183b80>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:04.832855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5e12a09d-f2cb-44a9-bc26-c9348b4ac72f tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6" status: 200 len: 344 microversion: 2.1 time: 0.195951 Mar 08 04:19:04.839362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 18/29] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:19:04 2022] GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:04.941854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dcbed2b2-1588-4895-806a-97a12b02fcc3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'create', calling method: .version_select at 0x7fe83312ba60>, body: {"keypair": {"name": "tempest-keypair-1806070730"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:05.042618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-dcbed2b2-1588-4895-806a-97a12b02fcc3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:19:05.049490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-dcbed2b2-1588-4895-806a-97a12b02fcc3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for user d3686d5d0c5e43a29d52b8b39bbae64d and project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:19:05.639391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e1911856-efd8-428f-a82e-f1dfa605d0b0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:05.640382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e1911856-efd8-428f-a82e-f1dfa605d0b0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:05.663693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1911856-efd8-428f-a82e-f1dfa605d0b0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:05.666089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1911856-efd8-428f-a82e-f1dfa605d0b0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:05.667153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1911856-efd8-428f-a82e-f1dfa605d0b0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:05.668746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1911856-efd8-428f-a82e-f1dfa605d0b0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:05.798134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-dcbed2b2-1588-4895-806a-97a12b02fcc3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:19:05.811300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-dcbed2b2-1588-4895-806a-97a12b02fcc3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for user d3686d5d0c5e43a29d52b8b39bbae64d and project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:19:05.853907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dcbed2b2-1588-4895-806a-97a12b02fcc3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.220936 Mar 08 04:19:05.859656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 12/30] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 04:19:04 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:05.873017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7d6c5d54-10d1-403d-ab5f-57379c54d735 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe833135e50>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:06.022428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7d6c5d54-10d1-403d-ab5f-57379c54d735 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6" status: 200 len: 344 microversion: 2.1 time: 0.161005 Mar 08 04:19:06.023644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 13/31] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:19:05 2022] GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:06.089197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e1911856-efd8-428f-a82e-f1dfa605d0b0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:06.100278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e1911856-efd8-428f-a82e-f1dfa605d0b0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1273 microversion: 2.1 time: 0.463542 Mar 08 04:19:06.115450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 19/32] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:05 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1273 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:07.038057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1733605d-5c1a-4838-ae98-af6318ede64b tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe8328d8550>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:07.120153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-77c50ffb-85a7-4ac5-a043-a48a856f1a96 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:07.121579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-77c50ffb-85a7-4ac5-a043-a48a856f1a96 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:07.153892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-77c50ffb-85a7-4ac5-a043-a48a856f1a96 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:07.154392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-77c50ffb-85a7-4ac5-a043-a48a856f1a96 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:07.155276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-77c50ffb-85a7-4ac5-a043-a48a856f1a96 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:07.155810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-77c50ffb-85a7-4ac5-a043-a48a856f1a96 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:07.325082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1733605d-5c1a-4838-ae98-af6318ede64b tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6" status: 200 len: 344 microversion: 2.1 time: 0.292859 Mar 08 04:19:07.325870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 14/33] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:19:07 2022] GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6 => generated 344 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:08.189400 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-77c50ffb-85a7-4ac5-a043-a48a856f1a96 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:08.201951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-77c50ffb-85a7-4ac5-a043-a48a856f1a96 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1273 microversion: 2.1 time: 1.087465 Mar 08 04:19:08.213585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 20/34] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:07 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1273 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:08.342245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0b3a1229-011f-489f-baf1-a2eaa1438f42 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe8328d8c10>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:08.416198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-0b3a1229-011f-489f-baf1-a2eaa1438f42 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] HTTP exception thrown: Volume 1232988c-ea88-476f-b592-635326031cb6 could not be found. Mar 08 04:19:08.417365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0b3a1229-011f-489f-baf1-a2eaa1438f42 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Returning 404 to user: Volume 1232988c-ea88-476f-b592-635326031cb6 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:19:08.418644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0b3a1229-011f-489f-baf1-a2eaa1438f42 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6" status: 404 len: 109 microversion: 2.1 time: 0.081959 Mar 08 04:19:08.419634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 15/35] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:19:08 2022] GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:19:08.443478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dd84aee4-8708-40c6-8f75-eb380c5c1906 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe83411d430>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:08.510918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-dd84aee4-8708-40c6-8f75-eb380c5c1906 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] HTTP exception thrown: Volume 1232988c-ea88-476f-b592-635326031cb6 could not be found. Mar 08 04:19:08.512210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dd84aee4-8708-40c6-8f75-eb380c5c1906 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Returning 404 to user: Volume 1232988c-ea88-476f-b592-635326031cb6 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:19:08.513269 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dd84aee4-8708-40c6-8f75-eb380c5c1906 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6" status: 404 len: 109 microversion: 2.1 time: 0.074899 Mar 08 04:19:08.514079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 21/36] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:19:08 2022] DELETE /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:19:08.528227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-15ea7e46-a4a8-480e-b3b2-22274f384358 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Calling method '.version_select at 0x7fe8328d8670>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:08.576161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-15ea7e46-a4a8-480e-b3b2-22274f384358 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] HTTP exception thrown: Volume 1232988c-ea88-476f-b592-635326031cb6 could not be found. Mar 08 04:19:08.577209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-15ea7e46-a4a8-480e-b3b2-22274f384358 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] Returning 404 to user: Volume 1232988c-ea88-476f-b592-635326031cb6 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:19:08.578426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-15ea7e46-a4a8-480e-b3b2-22274f384358 tempest-VolumesSnapshotsTestJSON-2117865742 tempest-VolumesSnapshotsTestJSON-2117865742-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6" status: 404 len: 109 microversion: 2.1 time: 0.059305 Mar 08 04:19:08.580290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 16/37] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:19:08 2022] GET /compute/v2.1/os-volumes/1232988c-ea88-476f-b592-635326031cb6 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:19:09.220815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6dbe2f26-ff16-4ab9-b387-74b979f63106 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:09.221418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6dbe2f26-ff16-4ab9-b387-74b979f63106 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:09.246139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6dbe2f26-ff16-4ab9-b387-74b979f63106 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:09.251686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6dbe2f26-ff16-4ab9-b387-74b979f63106 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:09.256488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6dbe2f26-ff16-4ab9-b387-74b979f63106 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:09.259241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6dbe2f26-ff16-4ab9-b387-74b979f63106 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:10.933366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6dbe2f26-ff16-4ab9-b387-74b979f63106 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:10.946145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6dbe2f26-ff16-4ab9-b387-74b979f63106 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1315 microversion: 2.1 time: 1.727897 Mar 08 04:19:10.950748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 22/38] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:09 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1315 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:11.967182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-65debc7c-71c0-47c9-8de2-b60e28a658a7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:11.968493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-65debc7c-71c0-47c9-8de2-b60e28a658a7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:11.975693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65debc7c-71c0-47c9-8de2-b60e28a658a7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:11.984705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65debc7c-71c0-47c9-8de2-b60e28a658a7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:11.985565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65debc7c-71c0-47c9-8de2-b60e28a658a7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:11.986132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65debc7c-71c0-47c9-8de2-b60e28a658a7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:13.803177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-65debc7c-71c0-47c9-8de2-b60e28a658a7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:13.831842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-65debc7c-71c0-47c9-8de2-b60e28a658a7 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1315 microversion: 2.1 time: 1.868787 Mar 08 04:19:13.844079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 17/39] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:11 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1315 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:14.364365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1066107090", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:14.612862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.network.neutron [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] validate_networks() for [('f4697aaf-5768-47e1-8386-6b6531d89dbb', None, None, None, None, None)] {{(pid=116775) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:19:14.852319 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a962049c-009e-4e13-b742-2bb6122d5936 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:14.853022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a962049c-009e-4e13-b742-2bb6122d5936 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:14.867361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a962049c-009e-4e13-b742-2bb6122d5936 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:14.870414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a962049c-009e-4e13-b742-2bb6122d5936 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:14.871564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a962049c-009e-4e13-b742-2bb6122d5936 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:14.873088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a962049c-009e-4e13-b742-2bb6122d5936 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:16.422061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a962049c-009e-4e13-b742-2bb6122d5936 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:16.432369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a962049c-009e-4e13-b742-2bb6122d5936 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1315 microversion: 2.1 time: 1.584635 Mar 08 04:19:16.441046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 18/40] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:14 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1315 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:16.877961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-651a07c5-357d-486d-b223-fb723188271a req-db090e90-34a8-4960-a142-fb4823b690fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3529a1ca-d6bd-4e49-8297-7157eedc1909", "tag": "cbc6c216-6814-497d-a500-b1687e9e4ced"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:16.923373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-651a07c5-357d-486d-b223-fb723188271a req-db090e90-34a8-4960-a142-fb4823b690fc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:16.928088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-651a07c5-357d-486d-b223-fb723188271a req-db090e90-34a8-4960-a142-fb4823b690fc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:16.995359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-651a07c5-357d-486d-b223-fb723188271a req-db090e90-34a8-4960-a142-fb4823b690fc service nova] Creating event network-changed:cbc6c216-6814-497d-a500-b1687e9e4ced for instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 on hv-cinder-73306 Mar 08 04:19:16.997291 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-651a07c5-357d-486d-b223-fb723188271a req-db090e90-34a8-4960-a142-fb4823b690fc service nova] Acquired lock "compute-rpcapi-router" {{(pid=116774) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 04:19:16.998880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50640413-c37b-40f2-a399-ba0bd644a00c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:17.001237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50640413-c37b-40f2-a399-ba0bd644a00c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:17.003596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50640413-c37b-40f2-a399-ba0bd644a00c None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:17.004490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50640413-c37b-40f2-a399-ba0bd644a00c None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:17.049623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.compute.rpcapi [None req-50640413-c37b-40f2-a399-ba0bd644a00c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 04:19:17.053717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50640413-c37b-40f2-a399-ba0bd644a00c None None] Releasing lock "compute-rpcapi-router" {{(pid=116774) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 04:19:17.108227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-50640413-c37b-40f2-a399-ba0bd644a00c None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.662082 Mar 08 04:19:17.108227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 19/41] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:17.408910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1be26b42-f358-471a-89a7-7d057fa6efa6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: .version_select at 0x7fe83288a4c0>, body: {"keypair": {"name": "tempest-keypair-1774575763"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:17.466585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-1be26b42-f358-471a-89a7-7d057fa6efa6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:19:17.482898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-1be26b42-f358-471a-89a7-7d057fa6efa6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:19:18.290679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-1be26b42-f358-471a-89a7-7d057fa6efa6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:19:18.303528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-1be26b42-f358-471a-89a7-7d057fa6efa6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:19:18.350489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Flavor limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:19:18.355543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Image limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:19:18.356236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Flavor pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:19:18.357380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Image pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:19:18.358160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:19:18.359030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1be26b42-f358-471a-89a7-7d057fa6efa6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.249362 Mar 08 04:19:18.367649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 20/42] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 04:19:17 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:18.373635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-236e0a2a-c532-4ee2-8fc3-bb703be29911 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:18.375036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-236e0a2a-c532-4ee2-8fc3-bb703be29911 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:18.391560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-236e0a2a-c532-4ee2-8fc3-bb703be29911 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:18.391804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-236e0a2a-c532-4ee2-8fc3-bb703be29911 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:18.392597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-236e0a2a-c532-4ee2-8fc3-bb703be29911 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:18.393039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-236e0a2a-c532-4ee2-8fc3-bb703be29911 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:18.441220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:18.444993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:18.446371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:18.447102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:18.500834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Getting quotas for project f673612dac9a4f24976855c12beba590. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:19:18.517244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Getting quotas for user c9a95742d54d4f3d9a5e802e95d7c9f5 and project f673612dac9a4f24976855c12beba590. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:19:18.536642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Going to run 1 instances... {{(pid=116775) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:19:18.540121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:19:18.666072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b83cd373-6a31-4a4b-bd11-dc524cf6ef84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.217585 Mar 08 04:19:18.672412 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 23/43] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:19:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 5219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 04:19:18.673695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-593135010", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa7eb933-ce1c-4920-9f24-6c3ac1756130"}], "security_groups": [{"name": "tempest-securitygroup--434300460"}], "key_name": "tempest-keypair-1806070730", "user_data": "}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:19.586857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.network.neutron [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] validate_networks() for [('fa7eb933-ce1c-4920-9f24-6c3ac1756130', None, None, None, None, None)] {{(pid=116775) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:19:19.608727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-236e0a2a-c532-4ee2-8fc3-bb703be29911 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:19.618679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-236e0a2a-c532-4ee2-8fc3-bb703be29911 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1315 microversion: 2.1 time: 1.255478 Mar 08 04:19:19.620875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 21/44] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:18 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1315 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:19.630854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9146996c-0cb9-417c-ac09-b5a35f529856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:19.634350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9146996c-0cb9-417c-ac09-b5a35f529856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:19.924576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9146996c-0cb9-417c-ac09-b5a35f529856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:19.936577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9146996c-0cb9-417c-ac09-b5a35f529856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1222 microversion: 2.1 time: 0.312287 Mar 08 04:19:19.937851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 22/45] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1222 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:20.098947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-772242797", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:20.221108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] validate_networks() for [('f4697aaf-5768-47e1-8386-6b6531d89dbb', None, None, None, None, None)] {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:19:22.549817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Flavor limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:19:22.550343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Image limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:19:22.551402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Flavor pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:19:22.551942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Image pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:19:22.552575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:19:22.569597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:22.570206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:22.572542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:22.575125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:22.586145 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:19:22.588339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:19:22.589349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:19:22.590582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:19:22.591249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:19:22.602073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:19:22.606129 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for user d3686d5d0c5e43a29d52b8b39bbae64d and project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:19:22.607785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:22.608601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:22.610378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:22.611038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:22.637479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Getting quotas for project f673612dac9a4f24976855c12beba590. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:19:22.643713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Getting quotas for user c9a95742d54d4f3d9a5e802e95d7c9f5 and project f673612dac9a4f24976855c12beba590. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:19:22.666292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:19:22.669325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:19:22.678707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Going to run 1 instances... {{(pid=116775) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:19:22.685345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:19:22.782981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ca37e5da-c506-42fc-b34a-dc5449867730 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.679893 Mar 08 04:19:22.789732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:19:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 04:19:22.824603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-40b3d9a5-6c77-46f6-9500-2a1adabfb707 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:22.825274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-40b3d9a5-6c77-46f6-9500-2a1adabfb707 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:22.845539 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40b3d9a5-6c77-46f6-9500-2a1adabfb707 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:22.846033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40b3d9a5-6c77-46f6-9500-2a1adabfb707 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:22.846828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40b3d9a5-6c77-46f6-9500-2a1adabfb707 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:22.847266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40b3d9a5-6c77-46f6-9500-2a1adabfb707 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:22.860666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-afcb165f-645d-44b7-b5ce-f6ff9dd51cf9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.186342 Mar 08 04:19:22.864627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 24/47] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:19:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 4197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:19:22.887427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d7ce699b-ef4a-428e-840a-777be0894ed0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:22.888050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d7ce699b-ef4a-428e-840a-777be0894ed0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:23.026615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d7ce699b-ef4a-428e-840a-777be0894ed0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:23.034813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d7ce699b-ef4a-428e-840a-777be0894ed0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1221 microversion: 2.1 time: 0.168777 Mar 08 04:19:23.038807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 25/48] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:22 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:23.065164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8479cdeb-44c7-42bf-8135-4b9755784e31 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:23.067834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8479cdeb-44c7-42bf-8135-4b9755784e31 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:23.313638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8479cdeb-44c7-42bf-8135-4b9755784e31 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:23.327171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8479cdeb-44c7-42bf-8135-4b9755784e31 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1237 microversion: 2.1 time: 0.287010 Mar 08 04:19:23.328642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 26/49] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1237 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:23.770609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-40b3d9a5-6c77-46f6-9500-2a1adabfb707 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:23.786689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-40b3d9a5-6c77-46f6-9500-2a1adabfb707 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1315 microversion: 2.1 time: 0.987732 Mar 08 04:19:23.787438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 24/50] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:22 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1315 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:24.052659 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2bf61ed6-dfab-48de-92bf-49648c1e0d04 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:24.054590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2bf61ed6-dfab-48de-92bf-49648c1e0d04 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:24.063403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2bf61ed6-dfab-48de-92bf-49648c1e0d04 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:24.063861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2bf61ed6-dfab-48de-92bf-49648c1e0d04 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:24.064647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2bf61ed6-dfab-48de-92bf-49648c1e0d04 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:24.065089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2bf61ed6-dfab-48de-92bf-49648c1e0d04 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:24.328392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2bf61ed6-dfab-48de-92bf-49648c1e0d04 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:24.340640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2bf61ed6-dfab-48de-92bf-49648c1e0d04 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1225 microversion: 2.1 time: 0.291350 Mar 08 04:19:24.344753 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 27/51] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:24 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1225 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:24.363851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6fdb587f-8f1b-492e-a983-2df1f2469578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:24.366377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6fdb587f-8f1b-492e-a983-2df1f2469578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:24.390154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6fdb587f-8f1b-492e-a983-2df1f2469578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:24.392924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6fdb587f-8f1b-492e-a983-2df1f2469578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:24.395367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6fdb587f-8f1b-492e-a983-2df1f2469578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:24.396200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6fdb587f-8f1b-492e-a983-2df1f2469578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:24.571264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6fdb587f-8f1b-492e-a983-2df1f2469578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:24.580696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6fdb587f-8f1b-492e-a983-2df1f2469578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1233 microversion: 2.1 time: 0.238569 Mar 08 04:19:24.584314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 25/52] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1233 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:24.805089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a4f45d8c-cfb6-497c-adbe-72fcccf9aba0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:24.806028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a4f45d8c-cfb6-497c-adbe-72fcccf9aba0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:24.820800 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a4f45d8c-cfb6-497c-adbe-72fcccf9aba0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:24.821350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a4f45d8c-cfb6-497c-adbe-72fcccf9aba0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:24.822316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a4f45d8c-cfb6-497c-adbe-72fcccf9aba0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:24.822951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a4f45d8c-cfb6-497c-adbe-72fcccf9aba0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:25.286091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a4f45d8c-cfb6-497c-adbe-72fcccf9aba0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:25.300234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a4f45d8c-cfb6-497c-adbe-72fcccf9aba0 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1315 microversion: 2.1 time: 0.499452 Mar 08 04:19:25.302119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 28/53] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:24 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:25.364467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57587376-1d3c-4f73-8248-8ad4dbdd86d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:25.365622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-57587376-1d3c-4f73-8248-8ad4dbdd86d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:25.380224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57587376-1d3c-4f73-8248-8ad4dbdd86d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:25.380695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57587376-1d3c-4f73-8248-8ad4dbdd86d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:25.381498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57587376-1d3c-4f73-8248-8ad4dbdd86d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:25.381982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57587376-1d3c-4f73-8248-8ad4dbdd86d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:25.512823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-57587376-1d3c-4f73-8248-8ad4dbdd86d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:25.525932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-57587376-1d3c-4f73-8248-8ad4dbdd86d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1279 microversion: 2.1 time: 0.164794 Mar 08 04:19:25.528092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 26/54] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:25 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:25.601391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7858fc5c-9781-45f2-8cc1-3ad294e60bfe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:25.602184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7858fc5c-9781-45f2-8cc1-3ad294e60bfe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:25.618882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7858fc5c-9781-45f2-8cc1-3ad294e60bfe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:25.619817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7858fc5c-9781-45f2-8cc1-3ad294e60bfe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:25.627531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7858fc5c-9781-45f2-8cc1-3ad294e60bfe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:25.628484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7858fc5c-9781-45f2-8cc1-3ad294e60bfe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:25.784447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7858fc5c-9781-45f2-8cc1-3ad294e60bfe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:25.795269 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7858fc5c-9781-45f2-8cc1-3ad294e60bfe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1295 microversion: 2.1 time: 0.198379 Mar 08 04:19:25.796733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 29/55] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1295 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:25.905362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-a491e7ce-f659-4be6-9cec-ec004d8ee929 req-02bc7e45-399b-4c69-9d7e-9f26962cc5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f53eaeb-7b60-4548-bea0-fafe6e0c6a22", "tag": "1c2dfd82-b52c-4418-8169-51f288073d7b"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:25.936155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-a491e7ce-f659-4be6-9cec-ec004d8ee929 req-02bc7e45-399b-4c69-9d7e-9f26962cc5bc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:25.937942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-a491e7ce-f659-4be6-9cec-ec004d8ee929 req-02bc7e45-399b-4c69-9d7e-9f26962cc5bc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:25.961340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-a491e7ce-f659-4be6-9cec-ec004d8ee929 req-02bc7e45-399b-4c69-9d7e-9f26962cc5bc service nova] Creating event network-changed:1c2dfd82-b52c-4418-8169-51f288073d7b for instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 on hv-cinder-73306 Mar 08 04:19:26.008861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-a491e7ce-f659-4be6-9cec-ec004d8ee929 req-02bc7e45-399b-4c69-9d7e-9f26962cc5bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132790 Mar 08 04:19:26.014171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 27/56] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:26.319091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e18b0480-2d70-4c54-855c-b4069a17d093 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:26.320377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e18b0480-2d70-4c54-855c-b4069a17d093 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:26.344915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e18b0480-2d70-4c54-855c-b4069a17d093 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:26.345628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e18b0480-2d70-4c54-855c-b4069a17d093 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:26.347424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e18b0480-2d70-4c54-855c-b4069a17d093 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:26.350010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e18b0480-2d70-4c54-855c-b4069a17d093 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:26.383523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-757668971", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "551fbd03-e272-4e1c-ae72-e8d5eda5763a"}], "security_groups": [{"name": "tempest-securitygroup--1602165493"}], "key_name": "tempest-keypair-1774575763", "user_data": "}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:26.669253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] validate_networks() for [('551fbd03-e272-4e1c-ae72-e8d5eda5763a', None, None, None, None, None)] {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:19:26.870110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e18b0480-2d70-4c54-855c-b4069a17d093 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:26.882908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e18b0480-2d70-4c54-855c-b4069a17d093 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1315 microversion: 2.1 time: 0.569688 Mar 08 04:19:26.883501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 30/57] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:26 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:26.900697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e0009df4-5c8c-4b88-9094-b7c109048785 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:26.901866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e0009df4-5c8c-4b88-9094-b7c109048785 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:26.910321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0009df4-5c8c-4b88-9094-b7c109048785 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:26.910995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0009df4-5c8c-4b88-9094-b7c109048785 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:26.911987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0009df4-5c8c-4b88-9094-b7c109048785 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:26.912609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0009df4-5c8c-4b88-9094-b7c109048785 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:27.830614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e0009df4-5c8c-4b88-9094-b7c109048785 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:27.843465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e0009df4-5c8c-4b88-9094-b7c109048785 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.944678 Mar 08 04:19:27.844190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 31/58] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:26 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:27.854135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-69a948f5-c787-4700-9e73-65dd89b795de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:27.856001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-69a948f5-c787-4700-9e73-65dd89b795de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:27.867235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-69a948f5-c787-4700-9e73-65dd89b795de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:27.868037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-69a948f5-c787-4700-9e73-65dd89b795de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:27.869052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-69a948f5-c787-4700-9e73-65dd89b795de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:27.869782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-69a948f5-c787-4700-9e73-65dd89b795de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:28.356458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:19:28.356912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:19:28.357355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:19:28.357982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:19:28.358552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:19:28.377865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:28.383737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:28.386017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:28.390080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:28.461498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:19:28.466928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:19:28.481240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:19:28.483933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:19:28.554847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fda2b500-b66f-4cec-8f2c-6517142b2b05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.177419 Mar 08 04:19:28.556364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 28/59] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:19:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:19:28.901250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-69a948f5-c787-4700-9e73-65dd89b795de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:28.922097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-69a948f5-c787-4700-9e73-65dd89b795de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 1.074804 Mar 08 04:19:28.922804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 32/60] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:27 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:28.953456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b28de07e-773d-46d3-89b6-987fbdc2728e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:28.956495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b28de07e-773d-46d3-89b6-987fbdc2728e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:28.985335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b28de07e-773d-46d3-89b6-987fbdc2728e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:28.986706 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b28de07e-773d-46d3-89b6-987fbdc2728e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:28.991031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b28de07e-773d-46d3-89b6-987fbdc2728e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:28.992606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b28de07e-773d-46d3-89b6-987fbdc2728e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:28.996607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-8a42f78b-502f-4f33-ace1-8cc309fa49e7 req-9b228ea5-f192-4e26-8f89-0510549f4466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3529a1ca-d6bd-4e49-8297-7157eedc1909", "name": "network-vif-plugged", "status": "completed", "tag": "cbc6c216-6814-497d-a500-b1687e9e4ced"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:29.018462 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-8a42f78b-502f-4f33-ace1-8cc309fa49e7 req-9b228ea5-f192-4e26-8f89-0510549f4466 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:29.018940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-8a42f78b-502f-4f33-ace1-8cc309fa49e7 req-9b228ea5-f192-4e26-8f89-0510549f4466 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:29.062358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-8a42f78b-502f-4f33-ace1-8cc309fa49e7 req-9b228ea5-f192-4e26-8f89-0510549f4466 service nova] Creating event network-vif-plugged:cbc6c216-6814-497d-a500-b1687e9e4ced for instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 on hv-cinder-73306 Mar 08 04:19:29.075011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-8a42f78b-502f-4f33-ace1-8cc309fa49e7 req-9b228ea5-f192-4e26-8f89-0510549f4466 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.516913 Mar 08 04:19:29.075647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 29/61] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:29.102062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-864a0201-2de0-4374-a2e8-75324d790db6 req-1ea09ccb-faac-4caf-97e7-aae79fe35f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998094f1-0e7d-45da-8f63-429d4e948433", "tag": "150dc7cc-552b-4c7c-a610-2004d5fef4d0"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:29.145552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-864a0201-2de0-4374-a2e8-75324d790db6 req-1ea09ccb-faac-4caf-97e7-aae79fe35f5f service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:29.149220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-864a0201-2de0-4374-a2e8-75324d790db6 req-1ea09ccb-faac-4caf-97e7-aae79fe35f5f service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:29.181244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-864a0201-2de0-4374-a2e8-75324d790db6 req-1ea09ccb-faac-4caf-97e7-aae79fe35f5f service nova] Creating event network-changed:150dc7cc-552b-4c7c-a610-2004d5fef4d0 for instance 998094f1-0e7d-45da-8f63-429d4e948433 on hv-cinder-73306 Mar 08 04:19:29.199030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-864a0201-2de0-4374-a2e8-75324d790db6 req-1ea09ccb-faac-4caf-97e7-aae79fe35f5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120636 Mar 08 04:19:29.200526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 30/62] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:29.224426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a2fa4946-8f72-4cb3-a46b-4978b2ecd815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:29.225799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a2fa4946-8f72-4cb3-a46b-4978b2ecd815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:29.432683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a2fa4946-8f72-4cb3-a46b-4978b2ecd815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:29.441745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a2fa4946-8f72-4cb3-a46b-4978b2ecd815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1241 microversion: 2.1 time: 0.238025 Mar 08 04:19:29.460678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 31/63] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1241 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:29.469686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c36c325f-edf6-4a41-9019-8d6b5039a89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:29.474712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c36c325f-edf6-4a41-9019-8d6b5039a89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:29.491374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c36c325f-edf6-4a41-9019-8d6b5039a89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:29.497878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c36c325f-edf6-4a41-9019-8d6b5039a89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:29.499303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c36c325f-edf6-4a41-9019-8d6b5039a89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:29.500033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c36c325f-edf6-4a41-9019-8d6b5039a89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:29.845122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b28de07e-773d-46d3-89b6-987fbdc2728e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:29.855103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b28de07e-773d-46d3-89b6-987fbdc2728e tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1315 microversion: 2.1 time: 0.918380 Mar 08 04:19:29.868050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 33/64] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:28 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:29.939615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3488c9df-e867-4f04-ba34-1a950f8cc94c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:29.940235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3488c9df-e867-4f04-ba34-1a950f8cc94c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:30.008252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3488c9df-e867-4f04-ba34-1a950f8cc94c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:30.008740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3488c9df-e867-4f04-ba34-1a950f8cc94c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:30.009558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3488c9df-e867-4f04-ba34-1a950f8cc94c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:30.010031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3488c9df-e867-4f04-ba34-1a950f8cc94c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:30.260950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c36c325f-edf6-4a41-9019-8d6b5039a89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:30.269895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c36c325f-edf6-4a41-9019-8d6b5039a89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.807580 Mar 08 04:19:30.270500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 32/65] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:29 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:30.439831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3488c9df-e867-4f04-ba34-1a950f8cc94c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:30.455264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3488c9df-e867-4f04-ba34-1a950f8cc94c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.518396 Mar 08 04:19:30.464989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8fcfd2a7-2129-47dd-90a8-1ddeaf065176 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:30.465622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8fcfd2a7-2129-47dd-90a8-1ddeaf065176 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:30.466100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 34/66] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:30.481816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8fcfd2a7-2129-47dd-90a8-1ddeaf065176 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:30.482586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8fcfd2a7-2129-47dd-90a8-1ddeaf065176 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:30.498328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8fcfd2a7-2129-47dd-90a8-1ddeaf065176 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:30.500641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8fcfd2a7-2129-47dd-90a8-1ddeaf065176 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:30.649225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8fcfd2a7-2129-47dd-90a8-1ddeaf065176 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:30.659831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8fcfd2a7-2129-47dd-90a8-1ddeaf065176 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1293 microversion: 2.1 time: 0.199250 Mar 08 04:19:30.683528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 33/67] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1293 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:30.872289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b519a074-9851-4527-bdc4-cda49e96c40b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:30.872910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b519a074-9851-4527-bdc4-cda49e96c40b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:30.885395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b519a074-9851-4527-bdc4-cda49e96c40b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:30.885885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b519a074-9851-4527-bdc4-cda49e96c40b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:30.886684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b519a074-9851-4527-bdc4-cda49e96c40b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:30.887127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b519a074-9851-4527-bdc4-cda49e96c40b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:31.220732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-350f2f15-8ea2-4663-a8d2-e0c65e45125c req-95266ec2-f6ba-4360-bc25-41e414edab5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94db79bc-24f2-47d5-9d3b-f0a2c9da754f", "tag": "8ccbc290-b8ca-4eec-be1b-6073afa94896"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:31.235067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-350f2f15-8ea2-4663-a8d2-e0c65e45125c req-95266ec2-f6ba-4360-bc25-41e414edab5e service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:31.237588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-350f2f15-8ea2-4663-a8d2-e0c65e45125c req-95266ec2-f6ba-4360-bc25-41e414edab5e service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:31.261604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-350f2f15-8ea2-4663-a8d2-e0c65e45125c req-95266ec2-f6ba-4360-bc25-41e414edab5e service nova] Creating event network-changed:8ccbc290-b8ca-4eec-be1b-6073afa94896 for instance 94db79bc-24f2-47d5-9d3b-f0a2c9da754f on hv-cinder-73306 Mar 08 04:19:31.272858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-350f2f15-8ea2-4663-a8d2-e0c65e45125c req-95266ec2-f6ba-4360-bc25-41e414edab5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228216 Mar 08 04:19:31.275223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 34/68] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:19:31.294221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-f0328f18-938a-4b85-bfc1-153716810ba0 req-531fb54a-e115-4f43-bfb2-a829cc007a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f53eaeb-7b60-4548-bea0-fafe6e0c6a22", "name": "network-vif-plugged", "status": "completed", "tag": "1c2dfd82-b52c-4418-8169-51f288073d7b"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:31.310227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-f0328f18-938a-4b85-bfc1-153716810ba0 req-531fb54a-e115-4f43-bfb2-a829cc007a82 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:31.313598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-f0328f18-938a-4b85-bfc1-153716810ba0 req-531fb54a-e115-4f43-bfb2-a829cc007a82 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:31.344495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-f0328f18-938a-4b85-bfc1-153716810ba0 req-531fb54a-e115-4f43-bfb2-a829cc007a82 service nova] Creating event network-vif-plugged:1c2dfd82-b52c-4418-8169-51f288073d7b for instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 on hv-cinder-73306 Mar 08 04:19:31.354048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-f0328f18-938a-4b85-bfc1-153716810ba0 req-531fb54a-e115-4f43-bfb2-a829cc007a82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073427 Mar 08 04:19:31.355270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 35/69] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:31.373388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f71043e6-dbe9-4475-a07a-65bd1ae2e63c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:31.395644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f71043e6-dbe9-4475-a07a-65bd1ae2e63c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:31.398415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b519a074-9851-4527-bdc4-cda49e96c40b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:31.411797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f71043e6-dbe9-4475-a07a-65bd1ae2e63c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:31.414086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f71043e6-dbe9-4475-a07a-65bd1ae2e63c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:31.415057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f71043e6-dbe9-4475-a07a-65bd1ae2e63c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:31.416457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b519a074-9851-4527-bdc4-cda49e96c40b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1315 microversion: 2.1 time: 0.547880 Mar 08 04:19:31.417062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 35/70] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:30 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:31.417284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f71043e6-dbe9-4475-a07a-65bd1ae2e63c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:31.479241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-eb8f250e-50d5-457e-af6e-39ebc1749af4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:31.480798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eb8f250e-50d5-457e-af6e-39ebc1749af4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:31.495706 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb8f250e-50d5-457e-af6e-39ebc1749af4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:31.496169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb8f250e-50d5-457e-af6e-39ebc1749af4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:31.496985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb8f250e-50d5-457e-af6e-39ebc1749af4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:31.497402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb8f250e-50d5-457e-af6e-39ebc1749af4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:32.083645 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-eb8f250e-50d5-457e-af6e-39ebc1749af4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:32.092804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eb8f250e-50d5-457e-af6e-39ebc1749af4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.622424 Mar 08 04:19:32.094268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 36/71] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:31 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:32.099665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3adbc70b-6a4d-4740-bf20-289a2b0a2d1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:32.100606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3adbc70b-6a4d-4740-bf20-289a2b0a2d1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:32.103711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f71043e6-dbe9-4475-a07a-65bd1ae2e63c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:32.108689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3adbc70b-6a4d-4740-bf20-289a2b0a2d1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:32.109570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3adbc70b-6a4d-4740-bf20-289a2b0a2d1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:32.110754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3adbc70b-6a4d-4740-bf20-289a2b0a2d1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:32.111650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3adbc70b-6a4d-4740-bf20-289a2b0a2d1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:32.119422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f71043e6-dbe9-4475-a07a-65bd1ae2e63c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.760847 Mar 08 04:19:32.120050 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 36/72] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:31 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:32.256927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3adbc70b-6a4d-4740-bf20-289a2b0a2d1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:32.278696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3adbc70b-6a4d-4740-bf20-289a2b0a2d1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1299 microversion: 2.1 time: 0.177012 Mar 08 04:19:32.279540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 37/73] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:32.437744 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3d91a06f-cc80-4aa6-9659-73e3f6dfab0b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:32.438976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3d91a06f-cc80-4aa6-9659-73e3f6dfab0b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:32.447893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d91a06f-cc80-4aa6-9659-73e3f6dfab0b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:32.448628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d91a06f-cc80-4aa6-9659-73e3f6dfab0b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:32.449628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d91a06f-cc80-4aa6-9659-73e3f6dfab0b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:32.450429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d91a06f-cc80-4aa6-9659-73e3f6dfab0b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:33.115168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0bbad9d2-1a9c-4c44-9a46-fa6d5b4a67de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:33.116669 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0bbad9d2-1a9c-4c44-9a46-fa6d5b4a67de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:33.132006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0bbad9d2-1a9c-4c44-9a46-fa6d5b4a67de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:33.133925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0bbad9d2-1a9c-4c44-9a46-fa6d5b4a67de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:33.135050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0bbad9d2-1a9c-4c44-9a46-fa6d5b4a67de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:33.135702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0bbad9d2-1a9c-4c44-9a46-fa6d5b4a67de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:33.313072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3d91a06f-cc80-4aa6-9659-73e3f6dfab0b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:33.326975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3d91a06f-cc80-4aa6-9659-73e3f6dfab0b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1502 microversion: 2.1 time: 0.897924 Mar 08 04:19:33.327717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 37/74] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:32 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1502 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:33.350124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2bb0309e-ce3b-4335-af03-6c5cfe1dd066 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:33.350959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2bb0309e-ce3b-4335-af03-6c5cfe1dd066 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:33.380410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2bb0309e-ce3b-4335-af03-6c5cfe1dd066 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:33.382620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2bb0309e-ce3b-4335-af03-6c5cfe1dd066 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:33.384416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2bb0309e-ce3b-4335-af03-6c5cfe1dd066 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:33.387544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2bb0309e-ce3b-4335-af03-6c5cfe1dd066 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:33.890624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0bbad9d2-1a9c-4c44-9a46-fa6d5b4a67de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:33.905827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0bbad9d2-1a9c-4c44-9a46-fa6d5b4a67de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.797458 Mar 08 04:19:33.914509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 38/75] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:33.921243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-16b4e0a9-c317-427e-b9db-c5cafd230b65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:33.922133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-16b4e0a9-c317-427e-b9db-c5cafd230b65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:33.954204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-16b4e0a9-c317-427e-b9db-c5cafd230b65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:33.954671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-16b4e0a9-c317-427e-b9db-c5cafd230b65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:33.958289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-16b4e0a9-c317-427e-b9db-c5cafd230b65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:33.958719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-16b4e0a9-c317-427e-b9db-c5cafd230b65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:34.155949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2bb0309e-ce3b-4335-af03-6c5cfe1dd066 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:34.172277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2bb0309e-ce3b-4335-af03-6c5cfe1dd066 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.842555 Mar 08 04:19:34.176318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 38/76] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:33 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:34.185242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-3e2929b4-3299-4cc7-a9dd-94d27dbcd85f req-57ef146c-3eed-43a8-940e-e635e833f503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1088612f-57f5-4e1a-bf1a-5f218b6f9eb5", "tag": "f1b4d95e-df7d-4dd5-a257-db8b401c5084"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:34.231057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-3e2929b4-3299-4cc7-a9dd-94d27dbcd85f req-57ef146c-3eed-43a8-940e-e635e833f503 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:34.231539 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-3e2929b4-3299-4cc7-a9dd-94d27dbcd85f req-57ef146c-3eed-43a8-940e-e635e833f503 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:34.270631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-3e2929b4-3299-4cc7-a9dd-94d27dbcd85f req-57ef146c-3eed-43a8-940e-e635e833f503 service nova] Creating event network-changed:f1b4d95e-df7d-4dd5-a257-db8b401c5084 for instance 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 on hv-cinder-73306 Mar 08 04:19:34.282010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-3e2929b4-3299-4cc7-a9dd-94d27dbcd85f req-57ef146c-3eed-43a8-940e-e635e833f503 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103024 Mar 08 04:19:34.286949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 39/77] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:34.410145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-16b4e0a9-c317-427e-b9db-c5cafd230b65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:34.418925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-16b4e0a9-c317-427e-b9db-c5cafd230b65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.502779 Mar 08 04:19:34.420032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 39/78] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:34.928635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b78fa2c1-a752-4525-979e-d0030d155a99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:34.929328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b78fa2c1-a752-4525-979e-d0030d155a99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:34.935282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b78fa2c1-a752-4525-979e-d0030d155a99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:34.935921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b78fa2c1-a752-4525-979e-d0030d155a99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:34.936694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b78fa2c1-a752-4525-979e-d0030d155a99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:34.937127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b78fa2c1-a752-4525-979e-d0030d155a99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:35.083264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b78fa2c1-a752-4525-979e-d0030d155a99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:35.094351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b78fa2c1-a752-4525-979e-d0030d155a99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.167149 Mar 08 04:19:35.094945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 40/79] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:35.138591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e57d6cdd-9415-43b0-911a-43ef26b00d6b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "855de30f-94fc-4a8e-a988-f146ddbd501f"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:35.140366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e57d6cdd-9415-43b0-911a-43ef26b00d6b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:35.147262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e57d6cdd-9415-43b0-911a-43ef26b00d6b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:35.147711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e57d6cdd-9415-43b0-911a-43ef26b00d6b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:35.148480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e57d6cdd-9415-43b0-911a-43ef26b00d6b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:35.148945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e57d6cdd-9415-43b0-911a-43ef26b00d6b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:35.194191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-77a47da9-c0c5-456c-8678-f0d222958287 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:35.194975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-77a47da9-c0c5-456c-8678-f0d222958287 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:35.201390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77a47da9-c0c5-456c-8678-f0d222958287 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:35.201873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77a47da9-c0c5-456c-8678-f0d222958287 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:35.202641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77a47da9-c0c5-456c-8678-f0d222958287 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:35.203072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77a47da9-c0c5-456c-8678-f0d222958287 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:35.292940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e57d6cdd-9415-43b0-911a-43ef26b00d6b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Acquired lock "compute-rpcapi-router" {{(pid=116775) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 04:19:35.294252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-472fc974-ceed-4643-b610-89454e7c5a35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:35.295787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-472fc974-ceed-4643-b610-89454e7c5a35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:35.297112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-472fc974-ceed-4643-b610-89454e7c5a35 None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:35.297624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-472fc974-ceed-4643-b610-89454e7c5a35 None None] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:35.310995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.compute.rpcapi [None req-472fc974-ceed-4643-b610-89454e7c5a35 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 04:19:35.312411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-472fc974-ceed-4643-b610-89454e7c5a35 None None] Releasing lock "compute-rpcapi-router" {{(pid=116775) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 04:19:35.362078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-77a47da9-c0c5-456c-8678-f0d222958287 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:35.370099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-77a47da9-c0c5-456c-8678-f0d222958287 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.183626 Mar 08 04:19:35.371044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 41/80] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:35 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:35.436394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-873a9f6b-ee98-4239-8d56-1aa10c92c946 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:35.437081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-873a9f6b-ee98-4239-8d56-1aa10c92c946 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:35.443955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-873a9f6b-ee98-4239-8d56-1aa10c92c946 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:35.444419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-873a9f6b-ee98-4239-8d56-1aa10c92c946 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:35.445197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-873a9f6b-ee98-4239-8d56-1aa10c92c946 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:35.445827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-873a9f6b-ee98-4239-8d56-1aa10c92c946 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:35.635109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-873a9f6b-ee98-4239-8d56-1aa10c92c946 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:35.642961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-873a9f6b-ee98-4239-8d56-1aa10c92c946 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.210431 Mar 08 04:19:35.643619 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 42/81] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:36.111170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-373204f0-7028-4538-b813-13ba09d80548 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:36.111805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-373204f0-7028-4538-b813-13ba09d80548 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:36.118239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-373204f0-7028-4538-b813-13ba09d80548 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:36.118677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-373204f0-7028-4538-b813-13ba09d80548 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:36.120846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-373204f0-7028-4538-b813-13ba09d80548 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:36.121807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-373204f0-7028-4538-b813-13ba09d80548 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:36.265741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-373204f0-7028-4538-b813-13ba09d80548 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:36.273923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-373204f0-7028-4538-b813-13ba09d80548 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.166462 Mar 08 04:19:36.279581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 43/82] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:36 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:36.386677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d3c3de17-d45f-400a-a303-358bc7874af7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:36.387461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d3c3de17-d45f-400a-a303-358bc7874af7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:36.395532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d3c3de17-d45f-400a-a303-358bc7874af7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:36.395996 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d3c3de17-d45f-400a-a303-358bc7874af7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:36.396966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d3c3de17-d45f-400a-a303-358bc7874af7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:36.397408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d3c3de17-d45f-400a-a303-358bc7874af7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:36.536182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d3c3de17-d45f-400a-a303-358bc7874af7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:36.543984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d3c3de17-d45f-400a-a303-358bc7874af7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.161146 Mar 08 04:19:36.544555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 44/83] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:36 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:36.662481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-771f8eb1-74d5-46d8-ad1d-3e851a54c777 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:36.663090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-771f8eb1-74d5-46d8-ad1d-3e851a54c777 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:36.669939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-771f8eb1-74d5-46d8-ad1d-3e851a54c777 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:36.670392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-771f8eb1-74d5-46d8-ad1d-3e851a54c777 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:36.671170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-771f8eb1-74d5-46d8-ad1d-3e851a54c777 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:36.671606 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-771f8eb1-74d5-46d8-ad1d-3e851a54c777 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:36.806262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-771f8eb1-74d5-46d8-ad1d-3e851a54c777 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:36.813407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-771f8eb1-74d5-46d8-ad1d-3e851a54c777 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.156487 Mar 08 04:19:36.814004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 45/84] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:37.235697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-b77c6e51-317f-4804-a940-0e49f4ec730a req-7f66129b-9d61-4b78-83cf-8aa811595b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998094f1-0e7d-45da-8f63-429d4e948433", "name": "network-vif-plugged", "status": "completed", "tag": "150dc7cc-552b-4c7c-a610-2004d5fef4d0"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:37.246139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-b77c6e51-317f-4804-a940-0e49f4ec730a req-7f66129b-9d61-4b78-83cf-8aa811595b57 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:37.246691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-b77c6e51-317f-4804-a940-0e49f4ec730a req-7f66129b-9d61-4b78-83cf-8aa811595b57 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:37.263139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-472fc974-ceed-4643-b610-89454e7c5a35 None None] 10.222.0.30 "POST /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.128520 Mar 08 04:19:37.265595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 40/85] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:19:35 2022] POST /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909/os-volume_attachments => generated 194 bytes in 2132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:19:37.266634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-b77c6e51-317f-4804-a940-0e49f4ec730a req-7f66129b-9d61-4b78-83cf-8aa811595b57 service nova] Creating event network-vif-plugged:150dc7cc-552b-4c7c-a610-2004d5fef4d0 for instance 998094f1-0e7d-45da-8f63-429d4e948433 on hv-cinder-73306 Mar 08 04:19:37.289706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-b77c6e51-317f-4804-a940-0e49f4ec730a req-7f66129b-9d61-4b78-83cf-8aa811595b57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057854 Mar 08 04:19:37.292499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8f816b3e-58b3-454c-8ee9-7301c8d2df71 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:37.293550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8f816b3e-58b3-454c-8ee9-7301c8d2df71 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:37.293685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 46/86] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:19:37.306428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f816b3e-58b3-454c-8ee9-7301c8d2df71 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:37.306890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f816b3e-58b3-454c-8ee9-7301c8d2df71 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:37.312388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f816b3e-58b3-454c-8ee9-7301c8d2df71 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:37.312770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f816b3e-58b3-454c-8ee9-7301c8d2df71 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:37.517155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8f816b3e-58b3-454c-8ee9-7301c8d2df71 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:37.524770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8f816b3e-58b3-454c-8ee9-7301c8d2df71 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.236781 Mar 08 04:19:37.525772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 41/87] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:37 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:37.560903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-25a5b576-ecdd-4c30-8b01-ffa33dc10a85 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:37.561621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-25a5b576-ecdd-4c30-8b01-ffa33dc10a85 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:37.568044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25a5b576-ecdd-4c30-8b01-ffa33dc10a85 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:37.568497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25a5b576-ecdd-4c30-8b01-ffa33dc10a85 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:37.569533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25a5b576-ecdd-4c30-8b01-ffa33dc10a85 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:37.570009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25a5b576-ecdd-4c30-8b01-ffa33dc10a85 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:37.710426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-25a5b576-ecdd-4c30-8b01-ffa33dc10a85 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:37.717606 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-25a5b576-ecdd-4c30-8b01-ffa33dc10a85 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.161049 Mar 08 04:19:37.718390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 47/88] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:37 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:37.829865 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0cb7d381-baa1-460b-ba62-cebae02b8c4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:37.830477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0cb7d381-baa1-460b-ba62-cebae02b8c4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:37.837140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cb7d381-baa1-460b-ba62-cebae02b8c4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:37.837623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cb7d381-baa1-460b-ba62-cebae02b8c4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:37.838410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cb7d381-baa1-460b-ba62-cebae02b8c4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:37.838848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cb7d381-baa1-460b-ba62-cebae02b8c4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:37.968215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0cb7d381-baa1-460b-ba62-cebae02b8c4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:37.977195 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0cb7d381-baa1-460b-ba62-cebae02b8c4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.151133 Mar 08 04:19:37.977787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 42/89] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:38.543052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e93325ff-c5cc-4510-8afa-ba721ad6e4b2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:38.543694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e93325ff-c5cc-4510-8afa-ba721ad6e4b2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:38.549527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e93325ff-c5cc-4510-8afa-ba721ad6e4b2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:38.550013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e93325ff-c5cc-4510-8afa-ba721ad6e4b2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:38.550833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e93325ff-c5cc-4510-8afa-ba721ad6e4b2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:38.551267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e93325ff-c5cc-4510-8afa-ba721ad6e4b2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:38.680158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e93325ff-c5cc-4510-8afa-ba721ad6e4b2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:38.687438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e93325ff-c5cc-4510-8afa-ba721ad6e4b2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.148229 Mar 08 04:19:38.688039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 48/90] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:38 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:38.734882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0e3bdcfe-9b46-4b73-a2b0-4f36d60b89da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:38.735486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0e3bdcfe-9b46-4b73-a2b0-4f36d60b89da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:38.742380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e3bdcfe-9b46-4b73-a2b0-4f36d60b89da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:38.742832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e3bdcfe-9b46-4b73-a2b0-4f36d60b89da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:38.743601 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e3bdcfe-9b46-4b73-a2b0-4f36d60b89da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:38.744046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e3bdcfe-9b46-4b73-a2b0-4f36d60b89da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:38.881368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0e3bdcfe-9b46-4b73-a2b0-4f36d60b89da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:38.888556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0e3bdcfe-9b46-4b73-a2b0-4f36d60b89da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.157453 Mar 08 04:19:38.889118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 43/91] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:38 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:38.994447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9b987a82-f0b9-4d97-8db4-ccec3a23ae66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:38.995085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9b987a82-f0b9-4d97-8db4-ccec3a23ae66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:39.000859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b987a82-f0b9-4d97-8db4-ccec3a23ae66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:39.001303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b987a82-f0b9-4d97-8db4-ccec3a23ae66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:39.002088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b987a82-f0b9-4d97-8db4-ccec3a23ae66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:39.002521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b987a82-f0b9-4d97-8db4-ccec3a23ae66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:39.135010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9b987a82-f0b9-4d97-8db4-ccec3a23ae66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:39.142166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9b987a82-f0b9-4d97-8db4-ccec3a23ae66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.151480 Mar 08 04:19:39.142717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 49/92] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:39.704355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ca4bd251-0a21-43ed-956f-52eab73f98f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:39.704957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ca4bd251-0a21-43ed-956f-52eab73f98f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:39.711451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca4bd251-0a21-43ed-956f-52eab73f98f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:39.711891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca4bd251-0a21-43ed-956f-52eab73f98f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:39.712648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca4bd251-0a21-43ed-956f-52eab73f98f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:39.713077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca4bd251-0a21-43ed-956f-52eab73f98f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:39.844358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ca4bd251-0a21-43ed-956f-52eab73f98f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:39.851585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ca4bd251-0a21-43ed-956f-52eab73f98f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.150970 Mar 08 04:19:39.852149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 44/93] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:39 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:39.904030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dd2cbb75-044a-48b7-bf96-bd655fb2050e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:39.904634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dd2cbb75-044a-48b7-bf96-bd655fb2050e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:39.910743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd2cbb75-044a-48b7-bf96-bd655fb2050e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:39.911186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd2cbb75-044a-48b7-bf96-bd655fb2050e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:39.911943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd2cbb75-044a-48b7-bf96-bd655fb2050e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:39.912371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd2cbb75-044a-48b7-bf96-bd655fb2050e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:40.038385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dd2cbb75-044a-48b7-bf96-bd655fb2050e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:40.045448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dd2cbb75-044a-48b7-bf96-bd655fb2050e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.145151 Mar 08 04:19:40.046054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 50/94] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:39 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:40.162065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-98093595-3919-4cf2-92d5-72557cef32cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:40.164103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-98093595-3919-4cf2-92d5-72557cef32cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:40.170728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98093595-3919-4cf2-92d5-72557cef32cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:40.171276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98093595-3919-4cf2-92d5-72557cef32cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:40.172265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98093595-3919-4cf2-92d5-72557cef32cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:40.172765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98093595-3919-4cf2-92d5-72557cef32cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:40.370549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-98093595-3919-4cf2-92d5-72557cef32cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:40.378146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-98093595-3919-4cf2-92d5-72557cef32cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.222540 Mar 08 04:19:40.379077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 45/95] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:40.869212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cf936d22-bdac-4cb7-82d9-27a8a2046a27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:40.870026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cf936d22-bdac-4cb7-82d9-27a8a2046a27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:40.876292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf936d22-bdac-4cb7-82d9-27a8a2046a27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:40.876737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf936d22-bdac-4cb7-82d9-27a8a2046a27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:40.877553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf936d22-bdac-4cb7-82d9-27a8a2046a27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:40.878011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf936d22-bdac-4cb7-82d9-27a8a2046a27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:41.021511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cf936d22-bdac-4cb7-82d9-27a8a2046a27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:41.029405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cf936d22-bdac-4cb7-82d9-27a8a2046a27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.165376 Mar 08 04:19:41.030073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 51/96] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:41.063139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0c5a119e-0bdc-4588-a4b9-678bc00c5e26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:41.063807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0c5a119e-0bdc-4588-a4b9-678bc00c5e26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:41.070767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c5a119e-0bdc-4588-a4b9-678bc00c5e26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:41.071206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c5a119e-0bdc-4588-a4b9-678bc00c5e26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:41.071961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c5a119e-0bdc-4588-a4b9-678bc00c5e26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:41.072387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c5a119e-0bdc-4588-a4b9-678bc00c5e26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:41.203244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0c5a119e-0bdc-4588-a4b9-678bc00c5e26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:41.210440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0c5a119e-0bdc-4588-a4b9-678bc00c5e26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.151042 Mar 08 04:19:41.211004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 46/97] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:41 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:41.395472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6dd5e9eb-748e-475e-9577-721fd1496ed8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:41.396081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6dd5e9eb-748e-475e-9577-721fd1496ed8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:41.401760 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dd5e9eb-748e-475e-9577-721fd1496ed8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:41.402215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dd5e9eb-748e-475e-9577-721fd1496ed8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:41.402982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dd5e9eb-748e-475e-9577-721fd1496ed8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:41.403417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dd5e9eb-748e-475e-9577-721fd1496ed8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:41.547637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6dd5e9eb-748e-475e-9577-721fd1496ed8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:41.555628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6dd5e9eb-748e-475e-9577-721fd1496ed8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.164258 Mar 08 04:19:41.556191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 52/98] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:42.046192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d263782e-f00a-488a-a5f3-372a5c5f0aeb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:42.046854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d263782e-f00a-488a-a5f3-372a5c5f0aeb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:42.053242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d263782e-f00a-488a-a5f3-372a5c5f0aeb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:42.053709 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d263782e-f00a-488a-a5f3-372a5c5f0aeb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:42.054484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d263782e-f00a-488a-a5f3-372a5c5f0aeb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:42.054925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d263782e-f00a-488a-a5f3-372a5c5f0aeb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:42.226652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-efbba161-1fbb-4a91-9f21-8cc129ed2669 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:42.227309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-efbba161-1fbb-4a91-9f21-8cc129ed2669 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:42.233190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efbba161-1fbb-4a91-9f21-8cc129ed2669 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:42.233633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efbba161-1fbb-4a91-9f21-8cc129ed2669 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:42.234439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efbba161-1fbb-4a91-9f21-8cc129ed2669 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:42.234956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efbba161-1fbb-4a91-9f21-8cc129ed2669 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:42.344475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d263782e-f00a-488a-a5f3-372a5c5f0aeb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:42.351844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d263782e-f00a-488a-a5f3-372a5c5f0aeb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.309388 Mar 08 04:19:42.352410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 47/99] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:42 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:42.399570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-efbba161-1fbb-4a91-9f21-8cc129ed2669 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:42.406764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-efbba161-1fbb-4a91-9f21-8cc129ed2669 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.183953 Mar 08 04:19:42.407325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 53/100] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:42 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:42.573024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bf56c843-4790-489e-b39a-a36901c48a42 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:42.573741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bf56c843-4790-489e-b39a-a36901c48a42 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:42.579565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf56c843-4790-489e-b39a-a36901c48a42 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:42.580014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf56c843-4790-489e-b39a-a36901c48a42 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:42.580771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf56c843-4790-489e-b39a-a36901c48a42 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:42.581219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf56c843-4790-489e-b39a-a36901c48a42 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:42.723609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-58460be7-ea82-484f-ae68-127507503061 req-f66cd70b-b276-449d-929f-0ebff5b5a200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94db79bc-24f2-47d5-9d3b-f0a2c9da754f", "name": "network-vif-plugged", "status": "completed", "tag": "8ccbc290-b8ca-4eec-be1b-6073afa94896"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:42.736111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-58460be7-ea82-484f-ae68-127507503061 req-f66cd70b-b276-449d-929f-0ebff5b5a200 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:42.736882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-58460be7-ea82-484f-ae68-127507503061 req-f66cd70b-b276-449d-929f-0ebff5b5a200 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:42.741290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bf56c843-4790-489e-b39a-a36901c48a42 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:42.748741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bf56c843-4790-489e-b39a-a36901c48a42 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.179623 Mar 08 04:19:42.749315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 48/101] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:42.752814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-58460be7-ea82-484f-ae68-127507503061 req-f66cd70b-b276-449d-929f-0ebff5b5a200 service nova] Creating event network-vif-plugged:8ccbc290-b8ca-4eec-be1b-6073afa94896 for instance 94db79bc-24f2-47d5-9d3b-f0a2c9da754f on hv-cinder-73306 Mar 08 04:19:42.759206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-58460be7-ea82-484f-ae68-127507503061 req-f66cd70b-b276-449d-929f-0ebff5b5a200 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044188 Mar 08 04:19:42.760102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 54/102] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:43.368512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7c21f3c5-55fa-4e27-bfb1-f08404b9bcb5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:43.369032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7c21f3c5-55fa-4e27-bfb1-f08404b9bcb5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:43.375289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c21f3c5-55fa-4e27-bfb1-f08404b9bcb5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:43.375741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c21f3c5-55fa-4e27-bfb1-f08404b9bcb5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:43.376513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c21f3c5-55fa-4e27-bfb1-f08404b9bcb5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:43.376956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c21f3c5-55fa-4e27-bfb1-f08404b9bcb5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:43.424287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8596c6aa-e6b6-47aa-afac-4dcc22105ecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:43.425008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8596c6aa-e6b6-47aa-afac-4dcc22105ecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:43.431200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8596c6aa-e6b6-47aa-afac-4dcc22105ecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:43.431654 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8596c6aa-e6b6-47aa-afac-4dcc22105ecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:43.432417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8596c6aa-e6b6-47aa-afac-4dcc22105ecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:43.432877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8596c6aa-e6b6-47aa-afac-4dcc22105ecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:43.536258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7c21f3c5-55fa-4e27-bfb1-f08404b9bcb5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:43.544523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7c21f3c5-55fa-4e27-bfb1-f08404b9bcb5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.179864 Mar 08 04:19:43.545313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 49/103] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:43.604621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8596c6aa-e6b6-47aa-afac-4dcc22105ecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:43.611894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8596c6aa-e6b6-47aa-afac-4dcc22105ecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1321 microversion: 2.1 time: 0.192137 Mar 08 04:19:43.612496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 55/104] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:43 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:43.766620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e4add7d7-dd9a-442d-ba5a-8fc0377ebfc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:43.767221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e4add7d7-dd9a-442d-ba5a-8fc0377ebfc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:43.772965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4add7d7-dd9a-442d-ba5a-8fc0377ebfc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:43.773405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4add7d7-dd9a-442d-ba5a-8fc0377ebfc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:43.774271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4add7d7-dd9a-442d-ba5a-8fc0377ebfc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:43.774702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4add7d7-dd9a-442d-ba5a-8fc0377ebfc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:43.906052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e4add7d7-dd9a-442d-ba5a-8fc0377ebfc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:43.914022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e4add7d7-dd9a-442d-ba5a-8fc0377ebfc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.151210 Mar 08 04:19:43.914586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 50/105] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:44.560137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8592eb7b-e2c1-4a7f-8ed3-55274251d173 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:44.560797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8592eb7b-e2c1-4a7f-8ed3-55274251d173 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:44.567240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8592eb7b-e2c1-4a7f-8ed3-55274251d173 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:44.567699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8592eb7b-e2c1-4a7f-8ed3-55274251d173 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:44.568473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8592eb7b-e2c1-4a7f-8ed3-55274251d173 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:44.568915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8592eb7b-e2c1-4a7f-8ed3-55274251d173 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:44.628284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9eb9783f-99ae-4bdd-9bc7-548d1349a406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:44.628989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9eb9783f-99ae-4bdd-9bc7-548d1349a406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:44.635103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9eb9783f-99ae-4bdd-9bc7-548d1349a406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:44.635802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9eb9783f-99ae-4bdd-9bc7-548d1349a406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:44.636832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9eb9783f-99ae-4bdd-9bc7-548d1349a406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:44.637598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9eb9783f-99ae-4bdd-9bc7-548d1349a406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:44.736410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8592eb7b-e2c1-4a7f-8ed3-55274251d173 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:44.746133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8592eb7b-e2c1-4a7f-8ed3-55274251d173 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1362 microversion: 2.1 time: 0.189724 Mar 08 04:19:44.756233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 56/106] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:44.806937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9eb9783f-99ae-4bdd-9bc7-548d1349a406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:44.815026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9eb9783f-99ae-4bdd-9bc7-548d1349a406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1514 microversion: 2.1 time: 0.190489 Mar 08 04:19:44.815859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 51/107] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:44 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:44.833644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5f35f1ef-b5ce-482f-8fab-528611afa4a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:44.834725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5f35f1ef-b5ce-482f-8fab-528611afa4a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:44.840938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5f35f1ef-b5ce-482f-8fab-528611afa4a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:44.841484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5f35f1ef-b5ce-482f-8fab-528611afa4a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:44.842429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5f35f1ef-b5ce-482f-8fab-528611afa4a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:44.842870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5f35f1ef-b5ce-482f-8fab-528611afa4a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:44.905986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-5f35f1ef-b5ce-482f-8fab-528611afa4a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lazy-loading 'flavor' on Instance uuid 998094f1-0e7d-45da-8f63-429d4e948433 {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:19:44.932183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9e0b4448-f4a5-4645-95af-061109596266 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:44.933125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9e0b4448-f4a5-4645-95af-061109596266 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:44.941888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e0b4448-f4a5-4645-95af-061109596266 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:44.942685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e0b4448-f4a5-4645-95af-061109596266 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:44.943745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e0b4448-f4a5-4645-95af-061109596266 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:44.944411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e0b4448-f4a5-4645-95af-061109596266 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:45.029155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5f35f1ef-b5ce-482f-8fab-528611afa4a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433/action" status: 200 len: 32 microversion: 2.1 time: 0.200600 Mar 08 04:19:45.030243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 57/108] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:19:44 2022] POST /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 04:19:45.040151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-200ad7fe-0dd7-478c-9532-bb27fb650bf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:45.040840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-200ad7fe-0dd7-478c-9532-bb27fb650bf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:45.047179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-200ad7fe-0dd7-478c-9532-bb27fb650bf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:45.047634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-200ad7fe-0dd7-478c-9532-bb27fb650bf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:45.048445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-200ad7fe-0dd7-478c-9532-bb27fb650bf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:45.048897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-200ad7fe-0dd7-478c-9532-bb27fb650bf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:45.176807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9e0b4448-f4a5-4645-95af-061109596266 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:45.196541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9e0b4448-f4a5-4645-95af-061109596266 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.267632 Mar 08 04:19:45.198843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 52/109] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:45.439550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-200ad7fe-0dd7-478c-9532-bb27fb650bf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:45.457519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-200ad7fe-0dd7-478c-9532-bb27fb650bf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.421205 Mar 08 04:19:45.462227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 58/110] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:45 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:45.772586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7ebe651d-a4e0-410b-9bb3-eaec2c770cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:45.774922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7ebe651d-a4e0-410b-9bb3-eaec2c770cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:45.782966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ebe651d-a4e0-410b-9bb3-eaec2c770cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:45.784338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ebe651d-a4e0-410b-9bb3-eaec2c770cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:45.785793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ebe651d-a4e0-410b-9bb3-eaec2c770cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:45.786423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ebe651d-a4e0-410b-9bb3-eaec2c770cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:46.030581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7ebe651d-a4e0-410b-9bb3-eaec2c770cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:46.040860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7ebe651d-a4e0-410b-9bb3-eaec2c770cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1548 microversion: 2.1 time: 0.277833 Mar 08 04:19:46.053643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 53/111] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:45 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1548 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:46.058926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-005844cf-b17b-410d-92ad-a6914fa5a9e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:46.059419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-005844cf-b17b-410d-92ad-a6914fa5a9e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:46.068518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-005844cf-b17b-410d-92ad-a6914fa5a9e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:46.069210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-005844cf-b17b-410d-92ad-a6914fa5a9e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:46.070856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-005844cf-b17b-410d-92ad-a6914fa5a9e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:46.073779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-005844cf-b17b-410d-92ad-a6914fa5a9e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:46.214790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f81f2452-9398-47c7-aa65-a77e59a2aaaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:46.215665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f81f2452-9398-47c7-aa65-a77e59a2aaaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:46.223069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f81f2452-9398-47c7-aa65-a77e59a2aaaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:46.223951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f81f2452-9398-47c7-aa65-a77e59a2aaaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:46.225074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f81f2452-9398-47c7-aa65-a77e59a2aaaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:46.225901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f81f2452-9398-47c7-aa65-a77e59a2aaaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:46.504349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-005844cf-b17b-410d-92ad-a6914fa5a9e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.449107 Mar 08 04:19:46.505027 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 59/112] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 04:19:46 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-interface => generated 285 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:46.509587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-95dfe973-e25b-43d4-901b-75f0233cf9c3 req-28299a7b-8d87-436c-96fc-29c454c26f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1088612f-57f5-4e1a-bf1a-5f218b6f9eb5", "name": "network-vif-plugged", "status": "completed", "tag": "f1b4d95e-df7d-4dd5-a257-db8b401c5084"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:46.517476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-95dfe973-e25b-43d4-901b-75f0233cf9c3 req-28299a7b-8d87-436c-96fc-29c454c26f8e service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:46.518373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-95dfe973-e25b-43d4-901b-75f0233cf9c3 req-28299a7b-8d87-436c-96fc-29c454c26f8e service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:46.536230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-95dfe973-e25b-43d4-901b-75f0233cf9c3 req-28299a7b-8d87-436c-96fc-29c454c26f8e service nova] Creating event network-vif-plugged:f1b4d95e-df7d-4dd5-a257-db8b401c5084 for instance 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 on hv-cinder-73306 Mar 08 04:19:46.543538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-95dfe973-e25b-43d4-901b-75f0233cf9c3 req-28299a7b-8d87-436c-96fc-29c454c26f8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037282 Mar 08 04:19:46.545552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 60/113] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:46.560875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d15ce604-fbcd-445c-8fd8-2e3a0c2b4dda tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:46.562281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d15ce604-fbcd-445c-8fd8-2e3a0c2b4dda tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:46.572246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d15ce604-fbcd-445c-8fd8-2e3a0c2b4dda tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:46.573052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d15ce604-fbcd-445c-8fd8-2e3a0c2b4dda tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:46.587241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d15ce604-fbcd-445c-8fd8-2e3a0c2b4dda tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:46.588762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d15ce604-fbcd-445c-8fd8-2e3a0c2b4dda tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:46.740160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f81f2452-9398-47c7-aa65-a77e59a2aaaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:46.750695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f81f2452-9398-47c7-aa65-a77e59a2aaaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.540218 Mar 08 04:19:46.751605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 54/114] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:46.936557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d15ce604-fbcd-445c-8fd8-2e3a0c2b4dda tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:46.944124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d15ce604-fbcd-445c-8fd8-2e3a0c2b4dda tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.396770 Mar 08 04:19:46.944863 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 61/115] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:46 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:47.772685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1fe4ccb0-2e4c-48a4-8015-3a86d19303f5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:47.774922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1fe4ccb0-2e4c-48a4-8015-3a86d19303f5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:47.785347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fe4ccb0-2e4c-48a4-8015-3a86d19303f5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:47.786661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fe4ccb0-2e4c-48a4-8015-3a86d19303f5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:47.787668 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fe4ccb0-2e4c-48a4-8015-3a86d19303f5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:47.788261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fe4ccb0-2e4c-48a4-8015-3a86d19303f5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:47.962257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f57cd8ff-af85-4135-a267-2c78b72add26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:47.962257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f57cd8ff-af85-4135-a267-2c78b72add26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:47.968263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f57cd8ff-af85-4135-a267-2c78b72add26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:47.969059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f57cd8ff-af85-4135-a267-2c78b72add26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:47.970021 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f57cd8ff-af85-4135-a267-2c78b72add26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:47.970763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f57cd8ff-af85-4135-a267-2c78b72add26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:48.181968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1fe4ccb0-2e4c-48a4-8015-3a86d19303f5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:48.200863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1fe4ccb0-2e4c-48a4-8015-3a86d19303f5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1367 microversion: 2.1 time: 0.436231 Mar 08 04:19:48.201988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 55/116] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:48.282507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f57cd8ff-af85-4135-a267-2c78b72add26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:48.291566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f57cd8ff-af85-4135-a267-2c78b72add26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.334368 Mar 08 04:19:48.301789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 62/117] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:47 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:48.443316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-c06c2c6e-43fa-46f4-a908-ef964abeb9f7 req-7fe91170-c35b-4a46-b71a-a961d489fc73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94db79bc-24f2-47d5-9d3b-f0a2c9da754f", "tag": "8ccbc290-b8ca-4eec-be1b-6073afa94896"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:48.458619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-c06c2c6e-43fa-46f4-a908-ef964abeb9f7 req-7fe91170-c35b-4a46-b71a-a961d489fc73 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:48.459399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-c06c2c6e-43fa-46f4-a908-ef964abeb9f7 req-7fe91170-c35b-4a46-b71a-a961d489fc73 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:48.497416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-c06c2c6e-43fa-46f4-a908-ef964abeb9f7 req-7fe91170-c35b-4a46-b71a-a961d489fc73 service nova] Creating event network-changed:8ccbc290-b8ca-4eec-be1b-6073afa94896 for instance 94db79bc-24f2-47d5-9d3b-f0a2c9da754f on hv-cinder-73306 Mar 08 04:19:48.508028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-c06c2c6e-43fa-46f4-a908-ef964abeb9f7 req-7fe91170-c35b-4a46-b71a-a961d489fc73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069987 Mar 08 04:19:48.513916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 56/118] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:49.217880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bb9fb576-2615-44b6-9753-a8b90ba4b3f6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:49.224234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bb9fb576-2615-44b6-9753-a8b90ba4b3f6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:49.230993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb9fb576-2615-44b6-9753-a8b90ba4b3f6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:49.231439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb9fb576-2615-44b6-9753-a8b90ba4b3f6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:49.232214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb9fb576-2615-44b6-9753-a8b90ba4b3f6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:49.232646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb9fb576-2615-44b6-9753-a8b90ba4b3f6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:49.316696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1d7febcc-3884-4c4a-bf1e-9c2e8d6c47bf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:49.317543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1d7febcc-3884-4c4a-bf1e-9c2e8d6c47bf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:49.325244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d7febcc-3884-4c4a-bf1e-9c2e8d6c47bf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:49.325987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d7febcc-3884-4c4a-bf1e-9c2e8d6c47bf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:49.326943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d7febcc-3884-4c4a-bf1e-9c2e8d6c47bf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:49.327685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d7febcc-3884-4c4a-bf1e-9c2e8d6c47bf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:49.540048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bb9fb576-2615-44b6-9753-a8b90ba4b3f6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:49.551920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bb9fb576-2615-44b6-9753-a8b90ba4b3f6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1556 microversion: 2.1 time: 0.337809 Mar 08 04:19:49.575472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 63/119] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1556 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:49.584643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-866c2247-d215-4281-8d5e-349f05271884 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:49.586284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-866c2247-d215-4281-8d5e-349f05271884 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:49.593116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866c2247-d215-4281-8d5e-349f05271884 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:49.593737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866c2247-d215-4281-8d5e-349f05271884 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:49.594622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866c2247-d215-4281-8d5e-349f05271884 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:49.595296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866c2247-d215-4281-8d5e-349f05271884 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:49.620827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1d7febcc-3884-4c4a-bf1e-9c2e8d6c47bf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:49.629266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1d7febcc-3884-4c4a-bf1e-9c2e8d6c47bf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.317157 Mar 08 04:19:49.641375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 57/120] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:49 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:49.715298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-866c2247-d215-4281-8d5e-349f05271884 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135707 Mar 08 04:19:49.723601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 64/121] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 04:19:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:19:50.649251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-27abc343-d801-4195-9282-fddda9aaec91 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:50.649997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-27abc343-d801-4195-9282-fddda9aaec91 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:50.656609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27abc343-d801-4195-9282-fddda9aaec91 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:50.657267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27abc343-d801-4195-9282-fddda9aaec91 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:50.658648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27abc343-d801-4195-9282-fddda9aaec91 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:50.659426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27abc343-d801-4195-9282-fddda9aaec91 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:50.880067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-27abc343-d801-4195-9282-fddda9aaec91 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:50.890911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-27abc343-d801-4195-9282-fddda9aaec91 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.247974 Mar 08 04:19:50.892501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 58/122] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:50 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:51.348076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-61f7c88b-667b-41e9-b6b0-af06285c3c72 req-c3c43017-a424-440f-8215-3789512efe82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1088612f-57f5-4e1a-bf1a-5f218b6f9eb5", "tag": "f1b4d95e-df7d-4dd5-a257-db8b401c5084"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:19:51.358756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-61f7c88b-667b-41e9-b6b0-af06285c3c72 req-c3c43017-a424-440f-8215-3789512efe82 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:51.359585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-61f7c88b-667b-41e9-b6b0-af06285c3c72 req-c3c43017-a424-440f-8215-3789512efe82 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:51.383028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-61f7c88b-667b-41e9-b6b0-af06285c3c72 req-c3c43017-a424-440f-8215-3789512efe82 service nova] Creating event network-changed:f1b4d95e-df7d-4dd5-a257-db8b401c5084 for instance 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 on hv-cinder-73306 Mar 08 04:19:51.388850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-61f7c88b-667b-41e9-b6b0-af06285c3c72 req-c3c43017-a424-440f-8215-3789512efe82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045643 Mar 08 04:19:51.390046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 65/123] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:19:51.909824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-83996a22-b22a-4c9f-be6f-c525135bec6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:51.911496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-83996a22-b22a-4c9f-be6f-c525135bec6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:51.918583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83996a22-b22a-4c9f-be6f-c525135bec6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:51.919386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83996a22-b22a-4c9f-be6f-c525135bec6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:51.921025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83996a22-b22a-4c9f-be6f-c525135bec6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:51.921802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83996a22-b22a-4c9f-be6f-c525135bec6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:52.087725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-83996a22-b22a-4c9f-be6f-c525135bec6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:52.098763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-83996a22-b22a-4c9f-be6f-c525135bec6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.193273 Mar 08 04:19:52.116429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 59/124] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:51 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:53.116018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-60fb8317-9dce-469f-80b5-a135dadff69f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:53.116835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-60fb8317-9dce-469f-80b5-a135dadff69f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:53.122802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60fb8317-9dce-469f-80b5-a135dadff69f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:53.123250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60fb8317-9dce-469f-80b5-a135dadff69f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:53.124008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60fb8317-9dce-469f-80b5-a135dadff69f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:53.124440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60fb8317-9dce-469f-80b5-a135dadff69f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:53.264382 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-60fb8317-9dce-469f-80b5-a135dadff69f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:53.272466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-60fb8317-9dce-469f-80b5-a135dadff69f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.160863 Mar 08 04:19:53.273039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 66/125] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:53 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:54.288330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e946615b-6c26-47a3-9cce-1cecd7356082 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:54.288932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e946615b-6c26-47a3-9cce-1cecd7356082 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:54.295271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e946615b-6c26-47a3-9cce-1cecd7356082 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:54.295716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e946615b-6c26-47a3-9cce-1cecd7356082 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:54.296479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e946615b-6c26-47a3-9cce-1cecd7356082 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:54.296907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e946615b-6c26-47a3-9cce-1cecd7356082 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:54.433032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e946615b-6c26-47a3-9cce-1cecd7356082 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:54.440926 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e946615b-6c26-47a3-9cce-1cecd7356082 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.155793 Mar 08 04:19:54.441689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 60/126] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:54 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:55.458496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8eb3df88-0688-4d6d-ad8f-c8f35fc63762 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:55.459109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8eb3df88-0688-4d6d-ad8f-c8f35fc63762 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:55.465020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8eb3df88-0688-4d6d-ad8f-c8f35fc63762 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:55.465476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8eb3df88-0688-4d6d-ad8f-c8f35fc63762 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:55.466283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8eb3df88-0688-4d6d-ad8f-c8f35fc63762 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:55.466728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8eb3df88-0688-4d6d-ad8f-c8f35fc63762 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:55.596072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8eb3df88-0688-4d6d-ad8f-c8f35fc63762 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:55.603598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8eb3df88-0688-4d6d-ad8f-c8f35fc63762 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.149685 Mar 08 04:19:55.604363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 67/127] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:55 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:55.710093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-628cefd0-cbf2-4a5a-9250-eef7d264b75a tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:55.710593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-628cefd0-cbf2-4a5a-9250-eef7d264b75a tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:55.717117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-628cefd0-cbf2-4a5a-9250-eef7d264b75a tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:55.717572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-628cefd0-cbf2-4a5a-9250-eef7d264b75a tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:55.718381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-628cefd0-cbf2-4a5a-9250-eef7d264b75a tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:55.718825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-628cefd0-cbf2-4a5a-9250-eef7d264b75a tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:55.743773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-628cefd0-cbf2-4a5a-9250-eef7d264b75a tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:19:55.836099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-628cefd0-cbf2-4a5a-9250-eef7d264b75a tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 204 len: 0 microversion: 2.1 time: 0.129467 Mar 08 04:19:55.836831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 61/128] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:19:55 2022] DELETE /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:19:55.846526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e3065f37-2677-4726-a6d8-88ce78980632 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:55.847144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e3065f37-2677-4726-a6d8-88ce78980632 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:55.863892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3065f37-2677-4726-a6d8-88ce78980632 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:55.865049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3065f37-2677-4726-a6d8-88ce78980632 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:55.866794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3065f37-2677-4726-a6d8-88ce78980632 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:55.867846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3065f37-2677-4726-a6d8-88ce78980632 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:56.032668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e3065f37-2677-4726-a6d8-88ce78980632 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:56.043309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e3065f37-2677-4726-a6d8-88ce78980632 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1554 microversion: 2.1 time: 0.200903 Mar 08 04:19:56.044873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 68/129] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:55 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:19:56.620785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1025bdbf-8824-4ee6-8c30-268d88f9af53 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:56.621391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1025bdbf-8824-4ee6-8c30-268d88f9af53 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:56.627160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1025bdbf-8824-4ee6-8c30-268d88f9af53 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:56.627744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1025bdbf-8824-4ee6-8c30-268d88f9af53 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:56.628558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1025bdbf-8824-4ee6-8c30-268d88f9af53 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:56.629016 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1025bdbf-8824-4ee6-8c30-268d88f9af53 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:56.758923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1025bdbf-8824-4ee6-8c30-268d88f9af53 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:56.766103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1025bdbf-8824-4ee6-8c30-268d88f9af53 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.149528 Mar 08 04:19:56.766662 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 62/130] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:56 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:57.062047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bf4f24b3-e49d-424f-a8ad-7c7b0bd5292c tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:57.062694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bf4f24b3-e49d-424f-a8ad-7c7b0bd5292c tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:57.069758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf4f24b3-e49d-424f-a8ad-7c7b0bd5292c tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:57.070236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf4f24b3-e49d-424f-a8ad-7c7b0bd5292c tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:57.071026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf4f24b3-e49d-424f-a8ad-7c7b0bd5292c tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:57.071463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf4f24b3-e49d-424f-a8ad-7c7b0bd5292c tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:57.204482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bf4f24b3-e49d-424f-a8ad-7c7b0bd5292c tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:57.213000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bf4f24b3-e49d-424f-a8ad-7c7b0bd5292c tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1554 microversion: 2.1 time: 0.155028 Mar 08 04:19:57.213557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 69/131] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:57 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:57.784087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dc13cbd8-1d49-432b-8cff-42ecf6ad7312 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:57.784700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dc13cbd8-1d49-432b-8cff-42ecf6ad7312 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:57.791762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc13cbd8-1d49-432b-8cff-42ecf6ad7312 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:57.792210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc13cbd8-1d49-432b-8cff-42ecf6ad7312 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:57.792976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc13cbd8-1d49-432b-8cff-42ecf6ad7312 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:57.793440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc13cbd8-1d49-432b-8cff-42ecf6ad7312 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:57.923796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dc13cbd8-1d49-432b-8cff-42ecf6ad7312 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:57.931539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dc13cbd8-1d49-432b-8cff-42ecf6ad7312 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.151581 Mar 08 04:19:57.932106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 63/132] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:57 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:58.230075 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9812a556-cbff-45e5-8a02-5c85f86d5e2b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:58.230830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9812a556-cbff-45e5-8a02-5c85f86d5e2b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:58.236737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9812a556-cbff-45e5-8a02-5c85f86d5e2b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:58.237225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9812a556-cbff-45e5-8a02-5c85f86d5e2b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:58.238125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9812a556-cbff-45e5-8a02-5c85f86d5e2b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:58.239296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9812a556-cbff-45e5-8a02-5c85f86d5e2b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:58.383913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9812a556-cbff-45e5-8a02-5c85f86d5e2b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:58.393797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9812a556-cbff-45e5-8a02-5c85f86d5e2b tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1554 microversion: 2.1 time: 0.167557 Mar 08 04:19:58.403567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 70/133] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:58 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:58.948166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-55712a3b-0a68-4488-9857-a25a5e648c69 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:58.948777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-55712a3b-0a68-4488-9857-a25a5e648c69 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:58.954983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55712a3b-0a68-4488-9857-a25a5e648c69 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:58.955436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55712a3b-0a68-4488-9857-a25a5e648c69 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:58.956204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55712a3b-0a68-4488-9857-a25a5e648c69 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:58.956643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55712a3b-0a68-4488-9857-a25a5e648c69 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:59.094760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-55712a3b-0a68-4488-9857-a25a5e648c69 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:59.103275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-55712a3b-0a68-4488-9857-a25a5e648c69 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.158931 Mar 08 04:19:59.103898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 64/134] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:58 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:19:59.410673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-794e9a6b-c57b-4db9-ba70-c88cc465f07f tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:19:59.411287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-794e9a6b-c57b-4db9-ba70-c88cc465f07f tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:19:59.417208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-794e9a6b-c57b-4db9-ba70-c88cc465f07f tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:59.417671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-794e9a6b-c57b-4db9-ba70-c88cc465f07f tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:59.418455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-794e9a6b-c57b-4db9-ba70-c88cc465f07f tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:19:59.418890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-794e9a6b-c57b-4db9-ba70-c88cc465f07f tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:19:59.553993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-794e9a6b-c57b-4db9-ba70-c88cc465f07f tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:19:59.561802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-794e9a6b-c57b-4db9-ba70-c88cc465f07f tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1554 microversion: 2.1 time: 0.155291 Mar 08 04:19:59.562364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 71/135] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:19:59 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:00.120252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0890e580-2ffe-42bf-91cd-7d3dd395bedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:00.121001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0890e580-2ffe-42bf-91cd-7d3dd395bedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:00.127766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0890e580-2ffe-42bf-91cd-7d3dd395bedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:00.128205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0890e580-2ffe-42bf-91cd-7d3dd395bedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:00.129016 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0890e580-2ffe-42bf-91cd-7d3dd395bedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:00.129449 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0890e580-2ffe-42bf-91cd-7d3dd395bedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:00.318909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0890e580-2ffe-42bf-91cd-7d3dd395bedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:00.326627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0890e580-2ffe-42bf-91cd-7d3dd395bedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.210042 Mar 08 04:20:00.336149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 65/136] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:00 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:00.581030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-20d011bd-d551-4a5c-9abf-35be997019bc tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:00.581635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-20d011bd-d551-4a5c-9abf-35be997019bc tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:00.589346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20d011bd-d551-4a5c-9abf-35be997019bc tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:00.589832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20d011bd-d551-4a5c-9abf-35be997019bc tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:00.590795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20d011bd-d551-4a5c-9abf-35be997019bc tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:00.591232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20d011bd-d551-4a5c-9abf-35be997019bc tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:00.742592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-20d011bd-d551-4a5c-9abf-35be997019bc tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:00.751841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-20d011bd-d551-4a5c-9abf-35be997019bc tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1554 microversion: 2.1 time: 0.175550 Mar 08 04:20:00.752873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 72/137] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:00 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:01.343310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6ba3dfad-8b73-4632-b75e-bc46cc53739e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:01.344150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6ba3dfad-8b73-4632-b75e-bc46cc53739e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:01.351202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ba3dfad-8b73-4632-b75e-bc46cc53739e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:01.351609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ba3dfad-8b73-4632-b75e-bc46cc53739e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:01.352390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ba3dfad-8b73-4632-b75e-bc46cc53739e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:01.352831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ba3dfad-8b73-4632-b75e-bc46cc53739e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:01.517396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6ba3dfad-8b73-4632-b75e-bc46cc53739e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:01.524880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6ba3dfad-8b73-4632-b75e-bc46cc53739e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.185369 Mar 08 04:20:01.525602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 66/138] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:01 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:01.770502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-98f6e641-d4b1-4c85-956e-bf5304cf1153 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:01.771110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-98f6e641-d4b1-4c85-956e-bf5304cf1153 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:01.777023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98f6e641-d4b1-4c85-956e-bf5304cf1153 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:01.777530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98f6e641-d4b1-4c85-956e-bf5304cf1153 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:01.778394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98f6e641-d4b1-4c85-956e-bf5304cf1153 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:01.780771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98f6e641-d4b1-4c85-956e-bf5304cf1153 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:01.924339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-98f6e641-d4b1-4c85-956e-bf5304cf1153 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:01.932694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-98f6e641-d4b1-4c85-956e-bf5304cf1153 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1554 microversion: 2.1 time: 0.166074 Mar 08 04:20:01.933276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 73/139] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:01 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:02.542523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ece40df0-cea4-450d-afe0-3622e225729a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:02.543265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ece40df0-cea4-450d-afe0-3622e225729a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:02.549960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ece40df0-cea4-450d-afe0-3622e225729a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:02.550413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ece40df0-cea4-450d-afe0-3622e225729a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:02.551773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ece40df0-cea4-450d-afe0-3622e225729a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:02.552215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ece40df0-cea4-450d-afe0-3622e225729a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:02.701725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ece40df0-cea4-450d-afe0-3622e225729a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:02.709812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ece40df0-cea4-450d-afe0-3622e225729a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.171488 Mar 08 04:20:02.710393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 67/140] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:02 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:02.950243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e5d61f56-6759-42f8-9d83-628ae6123fc3 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:02.951062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e5d61f56-6759-42f8-9d83-628ae6123fc3 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:02.957276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e5d61f56-6759-42f8-9d83-628ae6123fc3 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:02.957905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e5d61f56-6759-42f8-9d83-628ae6123fc3 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:02.958752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e5d61f56-6759-42f8-9d83-628ae6123fc3 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:02.959238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e5d61f56-6759-42f8-9d83-628ae6123fc3 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:03.111570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e5d61f56-6759-42f8-9d83-628ae6123fc3 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:03.119671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e5d61f56-6759-42f8-9d83-628ae6123fc3 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1554 microversion: 2.1 time: 0.173228 Mar 08 04:20:03.120435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 74/141] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:02 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:03.729277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1095c2a5-58d1-41cf-bea4-48d841f3dabd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:03.731042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1095c2a5-58d1-41cf-bea4-48d841f3dabd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:03.739669 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1095c2a5-58d1-41cf-bea4-48d841f3dabd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:03.740879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1095c2a5-58d1-41cf-bea4-48d841f3dabd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:03.742179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1095c2a5-58d1-41cf-bea4-48d841f3dabd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:03.742727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1095c2a5-58d1-41cf-bea4-48d841f3dabd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:03.760771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-cb6936a3-e5df-416b-9cee-b050e7706d74 req-32acb6cc-9fff-42b1-b269-2c73a5c088dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3529a1ca-d6bd-4e49-8297-7157eedc1909", "name": "network-vif-deleted", "tag": "cbc6c216-6814-497d-a500-b1687e9e4ced"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:03.772457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-cb6936a3-e5df-416b-9cee-b050e7706d74 req-32acb6cc-9fff-42b1-b269-2c73a5c088dc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:03.777412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-cb6936a3-e5df-416b-9cee-b050e7706d74 req-32acb6cc-9fff-42b1-b269-2c73a5c088dc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:03.793469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-cb6936a3-e5df-416b-9cee-b050e7706d74 req-32acb6cc-9fff-42b1-b269-2c73a5c088dc service nova] Creating event network-vif-deleted:cbc6c216-6814-497d-a500-b1687e9e4ced for instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 on hv-cinder-73306 Mar 08 04:20:03.800178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-cb6936a3-e5df-416b-9cee-b050e7706d74 req-32acb6cc-9fff-42b1-b269-2c73a5c088dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043974 Mar 08 04:20:03.801409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 75/142] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:20:03.939213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1095c2a5-58d1-41cf-bea4-48d841f3dabd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:03.948551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1095c2a5-58d1-41cf-bea4-48d841f3dabd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.223382 Mar 08 04:20:03.949427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 68/143] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:03 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:04.138512 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-be6036d1-2ce6-4e38-8a37-88ac66f8d552 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:04.139352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-be6036d1-2ce6-4e38-8a37-88ac66f8d552 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:04.159137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be6036d1-2ce6-4e38-8a37-88ac66f8d552 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:04.159605 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be6036d1-2ce6-4e38-8a37-88ac66f8d552 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:04.160753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be6036d1-2ce6-4e38-8a37-88ac66f8d552 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:04.161231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be6036d1-2ce6-4e38-8a37-88ac66f8d552 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:04.293961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-be6036d1-2ce6-4e38-8a37-88ac66f8d552 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '138970b8b01540b5a50e7ab56d39d436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e054c47af804378914e7f89707e2245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:04.303768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-be6036d1-2ce6-4e38-8a37-88ac66f8d552 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 200 len: 1346 microversion: 2.1 time: 0.170112 Mar 08 04:20:04.304354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 76/144] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:04 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 1346 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:04.966117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1da88cc0-5518-4994-9dd2-c4c119298281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:04.966783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1da88cc0-5518-4994-9dd2-c4c119298281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:04.973468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1da88cc0-5518-4994-9dd2-c4c119298281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:04.974161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1da88cc0-5518-4994-9dd2-c4c119298281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:04.974945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1da88cc0-5518-4994-9dd2-c4c119298281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:04.975379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1da88cc0-5518-4994-9dd2-c4c119298281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:05.120354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1da88cc0-5518-4994-9dd2-c4c119298281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:05.129633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1da88cc0-5518-4994-9dd2-c4c119298281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.166527 Mar 08 04:20:05.130378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 69/145] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:04 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:05.320480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d7bf085f-b53f-42a9-97a6-380e2651af28 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:05.321240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d7bf085f-b53f-42a9-97a6-380e2651af28 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:05.328300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7bf085f-b53f-42a9-97a6-380e2651af28 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:05.328757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7bf085f-b53f-42a9-97a6-380e2651af28 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:05.335881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7bf085f-b53f-42a9-97a6-380e2651af28 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:05.336358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7bf085f-b53f-42a9-97a6-380e2651af28 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:05.352561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-d7bf085f-b53f-42a9-97a6-380e2651af28 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] HTTP exception thrown: Instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 could not be found. Mar 08 04:20:05.353169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d7bf085f-b53f-42a9-97a6-380e2651af28 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Returning 404 to user: Instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:05.354466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d7bf085f-b53f-42a9-97a6-380e2651af28 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 404 len: 111 microversion: 2.1 time: 0.037950 Mar 08 04:20:05.355215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 77/146] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:05 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:20:05.475273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-92fa0e73-0832-4600-8678-f4a2003eeede tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:05.476304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-92fa0e73-0832-4600-8678-f4a2003eeede tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:05.496167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92fa0e73-0832-4600-8678-f4a2003eeede tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:05.496625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92fa0e73-0832-4600-8678-f4a2003eeede tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:05.497557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92fa0e73-0832-4600-8678-f4a2003eeede tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:05.498330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92fa0e73-0832-4600-8678-f4a2003eeede tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:05.514328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-92fa0e73-0832-4600-8678-f4a2003eeede tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] HTTP exception thrown: Instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 could not be found. Mar 08 04:20:05.515312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-92fa0e73-0832-4600-8678-f4a2003eeede tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Returning 404 to user: Instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:05.516387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-92fa0e73-0832-4600-8678-f4a2003eeede tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046182 Mar 08 04:20:05.517110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 70/147] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:20:05 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:20:06.148888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f59a60b1-2f81-4b67-b202-2dc74b87fb26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:06.149501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f59a60b1-2f81-4b67-b202-2dc74b87fb26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:06.158598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f59a60b1-2f81-4b67-b202-2dc74b87fb26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:06.159052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f59a60b1-2f81-4b67-b202-2dc74b87fb26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:06.160044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f59a60b1-2f81-4b67-b202-2dc74b87fb26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:06.164995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f59a60b1-2f81-4b67-b202-2dc74b87fb26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:06.333506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f59a60b1-2f81-4b67-b202-2dc74b87fb26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:06.341201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f59a60b1-2f81-4b67-b202-2dc74b87fb26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.197277 Mar 08 04:20:06.341798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 78/148] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:06 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:06.736670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-98a39256-8199-486d-b516-1efe610b11f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:06.737160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-98a39256-8199-486d-b516-1efe610b11f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:06.743933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98a39256-8199-486d-b516-1efe610b11f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:06.744381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98a39256-8199-486d-b516-1efe610b11f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:06.745150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98a39256-8199-486d-b516-1efe610b11f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:06.745611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98a39256-8199-486d-b516-1efe610b11f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:06.759305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-98a39256-8199-486d-b516-1efe610b11f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] HTTP exception thrown: Instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 could not be found. Mar 08 04:20:06.759924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-98a39256-8199-486d-b516-1efe610b11f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Returning 404 to user: Instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:06.760775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-98a39256-8199-486d-b516-1efe610b11f4 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 404 len: 111 microversion: 2.1 time: 0.028832 Mar 08 04:20:06.761302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 71/149] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:20:06 2022] DELETE /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 04:20:06.769250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e480ca9d-f185-45ee-a5f5-119cb8592743 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:06.769904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e480ca9d-f185-45ee-a5f5-119cb8592743 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] [instance: 3529a1ca-d6bd-4e49-8297-7157eedc1909] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:06.775645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e480ca9d-f185-45ee-a5f5-119cb8592743 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:06.776093 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e480ca9d-f185-45ee-a5f5-119cb8592743 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:06.776904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e480ca9d-f185-45ee-a5f5-119cb8592743 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:06.777340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e480ca9d-f185-45ee-a5f5-119cb8592743 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:06.791738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-e480ca9d-f185-45ee-a5f5-119cb8592743 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] HTTP exception thrown: Instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 could not be found. Mar 08 04:20:06.792467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e480ca9d-f185-45ee-a5f5-119cb8592743 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] Returning 404 to user: Instance 3529a1ca-d6bd-4e49-8297-7157eedc1909 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:06.793297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e480ca9d-f185-45ee-a5f5-119cb8592743 tempest-DeleteServersTestJSON-1528301037 tempest-DeleteServersTestJSON-1528301037-project] 10.222.0.30 "GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909" status: 404 len: 111 microversion: 2.1 time: 0.027923 Mar 08 04:20:06.794010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 79/150] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:06 2022] GET /compute/v2.1/servers/3529a1ca-d6bd-4e49-8297-7157eedc1909 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:20:07.359395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-10312ef0-7e6f-4c17-81ca-9e777509db9f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:07.360146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-10312ef0-7e6f-4c17-81ca-9e777509db9f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:07.372005 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10312ef0-7e6f-4c17-81ca-9e777509db9f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:07.372992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10312ef0-7e6f-4c17-81ca-9e777509db9f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:07.376657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10312ef0-7e6f-4c17-81ca-9e777509db9f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:07.377208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10312ef0-7e6f-4c17-81ca-9e777509db9f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:07.523501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-10312ef0-7e6f-4c17-81ca-9e777509db9f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:07.530895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-10312ef0-7e6f-4c17-81ca-9e777509db9f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.176021 Mar 08 04:20:07.531464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 72/151] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:07 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:08.548257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e9da7c28-03a7-4561-ab54-3de1d320aba4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:08.548863 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e9da7c28-03a7-4561-ab54-3de1d320aba4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:08.555219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9da7c28-03a7-4561-ab54-3de1d320aba4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:08.555608 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9da7c28-03a7-4561-ab54-3de1d320aba4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:08.556470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9da7c28-03a7-4561-ab54-3de1d320aba4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:08.556910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9da7c28-03a7-4561-ab54-3de1d320aba4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:08.965709 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a92ec7d0-ab9c-49b7-9b4b-ab1caa84dd4d tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Action: 'create', calling method: .version_select at 0x7fe833047b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1821855712", "metadata": {"Type": "work"}}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:08.967176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a92ec7d0-ab9c-49b7-9b4b-ab1caa84dd4d tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:08.968204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a92ec7d0-ab9c-49b7-9b4b-ab1caa84dd4d tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133324 Mar 08 04:20:08.968987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 73/152] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Mar 8 04:20:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:20:08.980187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5194b090-877f-4fdd-99d6-226b95be5983 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Action: 'create', calling method: .version_select at 0x7fe833049160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1334642690", "metadata": {"Type": "work"}}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:08.981538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5194b090-877f-4fdd-99d6-226b95be5983 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:08.982465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5194b090-877f-4fdd-99d6-226b95be5983 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006865 Mar 08 04:20:08.983120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 74/153] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Mar 8 04:20:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:20:08.994161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8134e733-4dea-4f4f-aed2-3a812ca210d4 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Action: 'create', calling method: .version_select at 0x7fe832f60430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-48717416", "metadata": {"Type": "work"}}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:08.995368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8134e733-4dea-4f4f-aed2-3a812ca210d4 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:08.996210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8134e733-4dea-4f4f-aed2-3a812ca210d4 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006307 Mar 08 04:20:08.996949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 75/154] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Mar 8 04:20:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 04:20:09.007598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e0b7bb88-13dc-4747-ab58-480efbf9dd78 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Calling method '.version_select at 0x7fe83302b9d0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:09.041271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-e0b7bb88-13dc-4747-ab58-480efbf9dd78 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] HTTP exception thrown: Volume tempest-invalid-359410032 could not be found. Mar 08 04:20:09.041910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e0b7bb88-13dc-4747-ab58-480efbf9dd78 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Returning 404 to user: Volume tempest-invalid-359410032 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:09.042824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e0b7bb88-13dc-4747-ab58-480efbf9dd78 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-359410032" status: 404 len: 98 microversion: 2.1 time: 0.039899 Mar 08 04:20:09.043597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 76/155] 10.222.0.30 () {58 vars in 1214 bytes} [Tue Mar 8 04:20:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-359410032 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 08 04:20:09.053438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eb51f6dc-f9ce-4ba1-95a4-00034615288d tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004453 Mar 08 04:20:09.058671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 77/156] 10.222.0.30 () {58 vars in 1139 bytes} [Tue Mar 8 04:20:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 08 04:20:09.063631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e18b48d3-a1e3-41f4-bd77-4f4ca4a6e4b7 tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003691 Mar 08 04:20:09.064294 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 78/157] 10.222.0.30 () {58 vars in 1136 bytes} [Tue Mar 8 04:20:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 08 04:20:09.073601 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-99e27f65-f4df-4b98-b2ed-91c744847f0e tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Calling method '.version_select at 0x7fe83302bd30>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:09.102034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-99e27f65-f4df-4b98-b2ed-91c744847f0e tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] HTTP exception thrown: Volume a88cf839-d548-4293-9001-09827662a64c could not be found. Mar 08 04:20:09.102802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-99e27f65-f4df-4b98-b2ed-91c744847f0e tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Returning 404 to user: Volume a88cf839-d548-4293-9001-09827662a64c could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:09.103627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-99e27f65-f4df-4b98-b2ed-91c744847f0e tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/a88cf839-d548-4293-9001-09827662a64c" status: 404 len: 109 microversion: 2.1 time: 0.033778 Mar 08 04:20:09.104316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 79/158] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:20:09 2022] DELETE /compute/v2.1/os-volumes/a88cf839-d548-4293-9001-09827662a64c => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 04:20:09.113699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ab75ebd1-792b-4573-afa5-53339834a39e tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Calling method '.version_select at 0x7fe833049e50>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:09.137965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e9da7c28-03a7-4561-ab54-3de1d320aba4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:09.145414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-ab75ebd1-792b-4573-afa5-53339834a39e tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] HTTP exception thrown: Volume d82c64c4-d2bb-4d7d-b763-4f91e0532e89 could not be found. Mar 08 04:20:09.146345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ab75ebd1-792b-4573-afa5-53339834a39e tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] Returning 404 to user: Volume d82c64c4-d2bb-4d7d-b763-4f91e0532e89 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:20:09.147178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ab75ebd1-792b-4573-afa5-53339834a39e tempest-VolumesNegativeTest-1977472867 tempest-VolumesNegativeTest-1977472867-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/d82c64c4-d2bb-4d7d-b763-4f91e0532e89" status: 404 len: 109 microversion: 2.1 time: 0.037626 Mar 08 04:20:09.147742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 80/159] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:20:09 2022] GET /compute/v2.1/os-volumes/d82c64c4-d2bb-4d7d-b763-4f91e0532e89 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:20:09.152422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e9da7c28-03a7-4561-ab54-3de1d320aba4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.606469 Mar 08 04:20:09.153970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 80/160] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:08 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:10.174233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7097af9f-9d97-4f45-bc01-37fbb82b7156 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:10.175781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7097af9f-9d97-4f45-bc01-37fbb82b7156 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:10.189454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7097af9f-9d97-4f45-bc01-37fbb82b7156 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:10.193116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7097af9f-9d97-4f45-bc01-37fbb82b7156 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:10.194485 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7097af9f-9d97-4f45-bc01-37fbb82b7156 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:10.195138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7097af9f-9d97-4f45-bc01-37fbb82b7156 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:10.400597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7097af9f-9d97-4f45-bc01-37fbb82b7156 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:10.410313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7097af9f-9d97-4f45-bc01-37fbb82b7156 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.240804 Mar 08 04:20:10.411378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 81/161] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:10 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:11.428202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a277151a-6ba4-416c-b16e-5e52f9db24f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:11.428813 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a277151a-6ba4-416c-b16e-5e52f9db24f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:11.437365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a277151a-6ba4-416c-b16e-5e52f9db24f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:11.437852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a277151a-6ba4-416c-b16e-5e52f9db24f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:11.438650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a277151a-6ba4-416c-b16e-5e52f9db24f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:11.439092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a277151a-6ba4-416c-b16e-5e52f9db24f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:11.794017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a277151a-6ba4-416c-b16e-5e52f9db24f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:11.808177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a277151a-6ba4-416c-b16e-5e52f9db24f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.383262 Mar 08 04:20:11.809496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 81/162] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:11 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:12.827579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c5bb4146-75bc-4a55-ad04-0094a1d687b9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:12.828235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c5bb4146-75bc-4a55-ad04-0094a1d687b9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:12.839402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5bb4146-75bc-4a55-ad04-0094a1d687b9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:12.839845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5bb4146-75bc-4a55-ad04-0094a1d687b9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:12.840632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5bb4146-75bc-4a55-ad04-0094a1d687b9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:12.841065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5bb4146-75bc-4a55-ad04-0094a1d687b9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:13.101275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c5bb4146-75bc-4a55-ad04-0094a1d687b9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:13.116520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c5bb4146-75bc-4a55-ad04-0094a1d687b9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.293520 Mar 08 04:20:13.131521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 82/163] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:12 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:14.137418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7405e0b0-b060-43f2-9f78-961a4b4faae2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:14.140071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7405e0b0-b060-43f2-9f78-961a4b4faae2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:14.162069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7405e0b0-b060-43f2-9f78-961a4b4faae2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:14.162535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7405e0b0-b060-43f2-9f78-961a4b4faae2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:14.163433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7405e0b0-b060-43f2-9f78-961a4b4faae2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:14.163766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7405e0b0-b060-43f2-9f78-961a4b4faae2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:14.573436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7405e0b0-b060-43f2-9f78-961a4b4faae2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:14.586043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7405e0b0-b060-43f2-9f78-961a4b4faae2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.451191 Mar 08 04:20:14.589223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 82/164] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:14 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:15.607658 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-01fa967d-692f-4789-809b-5091e465f471 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:15.608873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-01fa967d-692f-4789-809b-5091e465f471 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:15.622672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01fa967d-692f-4789-809b-5091e465f471 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:15.623394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01fa967d-692f-4789-809b-5091e465f471 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:15.624754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01fa967d-692f-4789-809b-5091e465f471 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:15.628793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01fa967d-692f-4789-809b-5091e465f471 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:15.944706 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-01fa967d-692f-4789-809b-5091e465f471 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:15.972113 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-01fa967d-692f-4789-809b-5091e465f471 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.368451 Mar 08 04:20:15.976569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 83/165] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:15 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:16.994044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e60cc00f-bef3-46a4-a412-00f81ec73085 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:16.995648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e60cc00f-bef3-46a4-a412-00f81ec73085 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:17.005423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e60cc00f-bef3-46a4-a412-00f81ec73085 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:17.006326 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e60cc00f-bef3-46a4-a412-00f81ec73085 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:17.007397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e60cc00f-bef3-46a4-a412-00f81ec73085 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:17.008028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e60cc00f-bef3-46a4-a412-00f81ec73085 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:17.325369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e60cc00f-bef3-46a4-a412-00f81ec73085 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:17.333787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e60cc00f-bef3-46a4-a412-00f81ec73085 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.343533 Mar 08 04:20:17.334343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 83/166] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:16 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:18.354438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-52a2fd46-8c3f-4631-8331-a981702fc194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:18.355049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-52a2fd46-8c3f-4631-8331-a981702fc194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:18.374178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-52a2fd46-8c3f-4631-8331-a981702fc194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:18.375818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-52a2fd46-8c3f-4631-8331-a981702fc194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:18.382907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-52a2fd46-8c3f-4631-8331-a981702fc194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:18.383468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-52a2fd46-8c3f-4631-8331-a981702fc194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:18.712178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-52a2fd46-8c3f-4631-8331-a981702fc194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:18.724565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-52a2fd46-8c3f-4631-8331-a981702fc194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.377895 Mar 08 04:20:18.725308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 84/167] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:18 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:19.744811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ea241b66-6267-42bc-a0b4-717b247edf60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:19.749597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ea241b66-6267-42bc-a0b4-717b247edf60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:19.758166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea241b66-6267-42bc-a0b4-717b247edf60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:19.758928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea241b66-6267-42bc-a0b4-717b247edf60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:19.759972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea241b66-6267-42bc-a0b4-717b247edf60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:19.760573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea241b66-6267-42bc-a0b4-717b247edf60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:19.941101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ea241b66-6267-42bc-a0b4-717b247edf60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:19.949087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ea241b66-6267-42bc-a0b4-717b247edf60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.209201 Mar 08 04:20:19.949686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 84/168] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:19 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:20.221439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dea41484-dcda-45cb-a8d0-5db36f640c71 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Action: 'create', calling method: .version_select at 0x7fe832fd0b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1894826000"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:20.252575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-dea41484-dcda-45cb-a8d0-5db36f640c71 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Getting quotas for project 0109ff95df0941709c7e20284930ec61. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:20:20.258956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-dea41484-dcda-45cb-a8d0-5db36f640c71 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Getting quotas for user 2b4b172419974ce9a929d4df7d3c5380 and project 0109ff95df0941709c7e20284930ec61. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:20:20.966800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-58557d97-ff94-44ae-97ee-65d2a26a51f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:20.968035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-58557d97-ff94-44ae-97ee-65d2a26a51f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:20.975379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-58557d97-ff94-44ae-97ee-65d2a26a51f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:20.976112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-58557d97-ff94-44ae-97ee-65d2a26a51f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:20.977100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-58557d97-ff94-44ae-97ee-65d2a26a51f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:20.977751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-58557d97-ff94-44ae-97ee-65d2a26a51f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:21.117475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-dea41484-dcda-45cb-a8d0-5db36f640c71 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Getting quotas for project 0109ff95df0941709c7e20284930ec61. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:20:21.121568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-dea41484-dcda-45cb-a8d0-5db36f640c71 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Getting quotas for user 2b4b172419974ce9a929d4df7d3c5380 and project 0109ff95df0941709c7e20284930ec61. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:20:21.136506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dea41484-dcda-45cb-a8d0-5db36f640c71 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.092010 Mar 08 04:20:21.137413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 85/169] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 04:20:20 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:21.143085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-58557d97-ff94-44ae-97ee-65d2a26a51f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:21.165424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-58557d97-ff94-44ae-97ee-65d2a26a51f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.201190 Mar 08 04:20:21.170777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 85/170] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:20 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:22.186434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-53309935-2da2-47d6-9918-3b7dd5c53c1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:22.189415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-53309935-2da2-47d6-9918-3b7dd5c53c1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:22.206856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53309935-2da2-47d6-9918-3b7dd5c53c1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:22.207251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53309935-2da2-47d6-9918-3b7dd5c53c1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:22.208105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53309935-2da2-47d6-9918-3b7dd5c53c1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:22.208548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53309935-2da2-47d6-9918-3b7dd5c53c1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:22.395826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-53309935-2da2-47d6-9918-3b7dd5c53c1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:22.404145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-53309935-2da2-47d6-9918-3b7dd5c53c1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.223986 Mar 08 04:20:22.404777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 86/171] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:22 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:23.423556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-35f2b116-2fb0-46b1-ab74-9d5f0690e2a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:23.424242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-35f2b116-2fb0-46b1-ab74-9d5f0690e2a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:23.431592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35f2b116-2fb0-46b1-ab74-9d5f0690e2a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:23.432036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35f2b116-2fb0-46b1-ab74-9d5f0690e2a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:23.432815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35f2b116-2fb0-46b1-ab74-9d5f0690e2a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:23.433243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35f2b116-2fb0-46b1-ab74-9d5f0690e2a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:23.583094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-35f2b116-2fb0-46b1-ab74-9d5f0690e2a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:23.592137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-35f2b116-2fb0-46b1-ab74-9d5f0690e2a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.172398 Mar 08 04:20:23.592980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 86/172] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:23 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:24.608579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f0986e6d-8e86-4c4f-af4e-4d2961d7e571 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:24.609404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f0986e6d-8e86-4c4f-af4e-4d2961d7e571 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:24.617555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0986e6d-8e86-4c4f-af4e-4d2961d7e571 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:24.618282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0986e6d-8e86-4c4f-af4e-4d2961d7e571 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:24.619262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0986e6d-8e86-4c4f-af4e-4d2961d7e571 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:24.619916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0986e6d-8e86-4c4f-af4e-4d2961d7e571 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:24.872457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f0986e6d-8e86-4c4f-af4e-4d2961d7e571 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:24.882589 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f0986e6d-8e86-4c4f-af4e-4d2961d7e571 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.278032 Mar 08 04:20:24.883256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 87/173] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:24 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:25.903416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-55c3156a-3d17-43c2-bcb1-34a01eaeb485 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:25.905009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-55c3156a-3d17-43c2-bcb1-34a01eaeb485 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:25.912461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55c3156a-3d17-43c2-bcb1-34a01eaeb485 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:25.913290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55c3156a-3d17-43c2-bcb1-34a01eaeb485 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:25.914245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55c3156a-3d17-43c2-bcb1-34a01eaeb485 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:25.915269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55c3156a-3d17-43c2-bcb1-34a01eaeb485 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:26.068879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-55c3156a-3d17-43c2-bcb1-34a01eaeb485 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:26.088506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-55c3156a-3d17-43c2-bcb1-34a01eaeb485 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.186180 Mar 08 04:20:26.089501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 87/174] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:25 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:27.108357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-68a7a455-2fed-46f0-943b-a99f5ce7ba70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:27.108963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-68a7a455-2fed-46f0-943b-a99f5ce7ba70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:27.118135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-68a7a455-2fed-46f0-943b-a99f5ce7ba70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:27.118582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-68a7a455-2fed-46f0-943b-a99f5ce7ba70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:27.119492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-68a7a455-2fed-46f0-943b-a99f5ce7ba70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:27.119979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-68a7a455-2fed-46f0-943b-a99f5ce7ba70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:27.327183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-68a7a455-2fed-46f0-943b-a99f5ce7ba70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:27.335285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-68a7a455-2fed-46f0-943b-a99f5ce7ba70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.230873 Mar 08 04:20:27.335822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 88/175] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:27 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:28.352687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c64b0685-7f23-4f9e-8d76-88c032142ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:28.353281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c64b0685-7f23-4f9e-8d76-88c032142ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:28.358982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c64b0685-7f23-4f9e-8d76-88c032142ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:28.359420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c64b0685-7f23-4f9e-8d76-88c032142ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:28.360369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c64b0685-7f23-4f9e-8d76-88c032142ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:28.360806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c64b0685-7f23-4f9e-8d76-88c032142ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:28.525863 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c64b0685-7f23-4f9e-8d76-88c032142ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:28.534526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c64b0685-7f23-4f9e-8d76-88c032142ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.184980 Mar 08 04:20:28.535109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 88/176] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:28 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:29.552360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4b1e518e-bec9-451f-a911-4327c7d8bc6e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:29.552978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4b1e518e-bec9-451f-a911-4327c7d8bc6e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:29.560720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b1e518e-bec9-451f-a911-4327c7d8bc6e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:29.561145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b1e518e-bec9-451f-a911-4327c7d8bc6e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:29.562044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b1e518e-bec9-451f-a911-4327c7d8bc6e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:29.562480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b1e518e-bec9-451f-a911-4327c7d8bc6e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:29.716965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4b1e518e-bec9-451f-a911-4327c7d8bc6e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:29.726168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4b1e518e-bec9-451f-a911-4327c7d8bc6e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.178557 Mar 08 04:20:29.726846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 89/177] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:29 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:30.744587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f6d5102e-fa93-4384-aedc-b0b3513d57c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:30.745323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f6d5102e-fa93-4384-aedc-b0b3513d57c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:30.751618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6d5102e-fa93-4384-aedc-b0b3513d57c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:30.752061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6d5102e-fa93-4384-aedc-b0b3513d57c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:30.753601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6d5102e-fa93-4384-aedc-b0b3513d57c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:30.754141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6d5102e-fa93-4384-aedc-b0b3513d57c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:30.948613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f6d5102e-fa93-4384-aedc-b0b3513d57c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:30.956037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f6d5102e-fa93-4384-aedc-b0b3513d57c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.215625 Mar 08 04:20:30.956616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 89/178] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:30 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:31.972632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d4c33b9b-01fe-4111-82ac-d83db97e8aa0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:31.973599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d4c33b9b-01fe-4111-82ac-d83db97e8aa0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:31.987025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4c33b9b-01fe-4111-82ac-d83db97e8aa0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:31.987831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4c33b9b-01fe-4111-82ac-d83db97e8aa0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:31.988806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4c33b9b-01fe-4111-82ac-d83db97e8aa0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:31.989252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4c33b9b-01fe-4111-82ac-d83db97e8aa0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:32.134953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d4c33b9b-01fe-4111-82ac-d83db97e8aa0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:32.142295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d4c33b9b-01fe-4111-82ac-d83db97e8aa0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.174315 Mar 08 04:20:32.142851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 90/179] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:31 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:33.164626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dfe98a0d-0a3b-43cb-b6ee-a9060c0981e9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:33.165885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dfe98a0d-0a3b-43cb-b6ee-a9060c0981e9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:33.172633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dfe98a0d-0a3b-43cb-b6ee-a9060c0981e9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:33.173076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dfe98a0d-0a3b-43cb-b6ee-a9060c0981e9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:33.175363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dfe98a0d-0a3b-43cb-b6ee-a9060c0981e9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:33.175898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dfe98a0d-0a3b-43cb-b6ee-a9060c0981e9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:33.403556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dfe98a0d-0a3b-43cb-b6ee-a9060c0981e9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:33.413038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dfe98a0d-0a3b-43cb-b6ee-a9060c0981e9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.257226 Mar 08 04:20:33.423835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 90/180] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:33 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:34.431270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-885a0676-a39f-4020-a68c-3c5b9df19758 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:34.431856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-885a0676-a39f-4020-a68c-3c5b9df19758 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:34.438183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-885a0676-a39f-4020-a68c-3c5b9df19758 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:34.438636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-885a0676-a39f-4020-a68c-3c5b9df19758 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:34.439408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-885a0676-a39f-4020-a68c-3c5b9df19758 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:34.440461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-885a0676-a39f-4020-a68c-3c5b9df19758 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:34.576106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-885a0676-a39f-4020-a68c-3c5b9df19758 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:34.583593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-885a0676-a39f-4020-a68c-3c5b9df19758 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.156152 Mar 08 04:20:34.584288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 91/181] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:34 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:34.976100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-187492124", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "networks": [{"uuid": "d5a2bc00-60f7-4e70-97b4-aff42319728f"}]}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:35.600938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7e6128e8-ff8e-43c5-b157-aece68e8c909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:35.601491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7e6128e8-ff8e-43c5-b157-aece68e8c909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:35.607516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e6128e8-ff8e-43c5-b157-aece68e8c909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:35.607963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e6128e8-ff8e-43c5-b157-aece68e8c909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:35.608729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e6128e8-ff8e-43c5-b157-aece68e8c909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:35.609159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e6128e8-ff8e-43c5-b157-aece68e8c909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:35.744647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7e6128e8-ff8e-43c5-b157-aece68e8c909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:35.752196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7e6128e8-ff8e-43c5-b157-aece68e8c909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.155845 Mar 08 04:20:35.752978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 92/182] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:35 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:36.551202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] validate_networks() for [('d5a2bc00-60f7-4e70-97b4-aff42319728f', None, None, None, None, None)] {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:20:36.770336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-88127679-f82a-4669-81a9-ef3d60de073f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:36.770888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-88127679-f82a-4669-81a9-ef3d60de073f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:36.779828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88127679-f82a-4669-81a9-ef3d60de073f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:36.780602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88127679-f82a-4669-81a9-ef3d60de073f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:36.781965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88127679-f82a-4669-81a9-ef3d60de073f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:36.783027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88127679-f82a-4669-81a9-ef3d60de073f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:37.162986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:20:37.163485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:20:37.164055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:20:37.164519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:20:37.165104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:20:37.173723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:37.174689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:37.175491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:37.175922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:37.186507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-88127679-f82a-4669-81a9-ef3d60de073f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:37.193647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Getting quotas for project d987f379b42346f8bab2101aa92d9fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:20:37.195037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-88127679-f82a-4669-81a9-ef3d60de073f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.429245 Mar 08 04:20:37.195725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 93/183] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:36 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:37.197528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Getting quotas for user 7eab40b003f9475982a8e0afe7226d2b and project d987f379b42346f8bab2101aa92d9fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:20:37.208780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:20:37.211133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:20:37.254564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0a0d0afa-74c3-4a22-9bb3-3dfa201bb7ae tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.282405 Mar 08 04:20:37.255214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 91/184] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:20:37.265032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f25d1565-088d-49f4-bab7-5232f642e6b2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:37.265769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f25d1565-088d-49f4-bab7-5232f642e6b2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:37.317209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f25d1565-088d-49f4-bab7-5232f642e6b2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:37.324052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f25d1565-088d-49f4-bab7-5232f642e6b2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1218 microversion: 2.1 time: 0.062903 Mar 08 04:20:37.324710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 94/185] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:37 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:38.212867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bcfea368-df07-4301-966c-26680dc48c9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:38.213482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bcfea368-df07-4301-966c-26680dc48c9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:38.219570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bcfea368-df07-4301-966c-26680dc48c9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:38.220024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bcfea368-df07-4301-966c-26680dc48c9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:38.220829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bcfea368-df07-4301-966c-26680dc48c9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:38.222151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bcfea368-df07-4301-966c-26680dc48c9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:38.340317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d027a9a3-413c-428a-ab3b-e94457495125 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:38.341051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d027a9a3-413c-428a-ab3b-e94457495125 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:38.347877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d027a9a3-413c-428a-ab3b-e94457495125 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:38.348571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d027a9a3-413c-428a-ab3b-e94457495125 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:38.349714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d027a9a3-413c-428a-ab3b-e94457495125 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:38.350275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d027a9a3-413c-428a-ab3b-e94457495125 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:38.351336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bcfea368-df07-4301-966c-26680dc48c9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:38.359178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bcfea368-df07-4301-966c-26680dc48c9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.150217 Mar 08 04:20:38.359754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 92/186] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:38 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:38.428351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d027a9a3-413c-428a-ab3b-e94457495125 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:38.435564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d027a9a3-413c-428a-ab3b-e94457495125 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1222 microversion: 2.1 time: 0.099091 Mar 08 04:20:38.436126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 95/187] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:38 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:39.375950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6c9ce0a9-0ec6-4062-bc30-0688e13e3364 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:39.376585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6c9ce0a9-0ec6-4062-bc30-0688e13e3364 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:39.382661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c9ce0a9-0ec6-4062-bc30-0688e13e3364 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:39.383111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c9ce0a9-0ec6-4062-bc30-0688e13e3364 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:39.383886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c9ce0a9-0ec6-4062-bc30-0688e13e3364 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:39.384323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c9ce0a9-0ec6-4062-bc30-0688e13e3364 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:39.452103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1f5abddb-7a26-43b2-8f35-d5213169b85f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:39.452702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1f5abddb-7a26-43b2-8f35-d5213169b85f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:39.459367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f5abddb-7a26-43b2-8f35-d5213169b85f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:39.459860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f5abddb-7a26-43b2-8f35-d5213169b85f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:39.460625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f5abddb-7a26-43b2-8f35-d5213169b85f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:39.461558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f5abddb-7a26-43b2-8f35-d5213169b85f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:39.527243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1f5abddb-7a26-43b2-8f35-d5213169b85f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:39.535110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1f5abddb-7a26-43b2-8f35-d5213169b85f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1214 microversion: 2.1 time: 0.086783 Mar 08 04:20:39.535680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 96/188] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:39 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:39.539406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6c9ce0a9-0ec6-4062-bc30-0688e13e3364 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:39.546975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6c9ce0a9-0ec6-4062-bc30-0688e13e3364 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.174917 Mar 08 04:20:39.547548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 93/189] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:39 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:40.551257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7c9d9249-e039-4634-aed8-ee6bce0703f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:40.551868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7c9d9249-e039-4634-aed8-ee6bce0703f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:40.558244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c9d9249-e039-4634-aed8-ee6bce0703f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:40.558786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c9d9249-e039-4634-aed8-ee6bce0703f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:40.559734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c9d9249-e039-4634-aed8-ee6bce0703f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:40.560323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c9d9249-e039-4634-aed8-ee6bce0703f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:40.565010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5be886a9-387d-4fe3-915c-3755a3b16aae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:40.565629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5be886a9-387d-4fe3-915c-3755a3b16aae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:40.571829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5be886a9-387d-4fe3-915c-3755a3b16aae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:40.572294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5be886a9-387d-4fe3-915c-3755a3b16aae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:40.573256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5be886a9-387d-4fe3-915c-3755a3b16aae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:40.573900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5be886a9-387d-4fe3-915c-3755a3b16aae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:40.690083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7c9d9249-e039-4634-aed8-ee6bce0703f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:40.699903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7c9d9249-e039-4634-aed8-ee6bce0703f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1276 microversion: 2.1 time: 0.152459 Mar 08 04:20:40.700693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 97/190] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:40 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:40.822898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5be886a9-387d-4fe3-915c-3755a3b16aae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:40.838480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5be886a9-387d-4fe3-915c-3755a3b16aae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.278523 Mar 08 04:20:40.841917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 94/191] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:40 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:41.692283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-92ba445b-726d-49ff-b7f1-8f725fa355a2 req-50fee41a-9375-4a8a-8c7b-d8a1cf2db390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e369a590-728c-4108-9f1c-d685ab4a0c92", "tag": "58a443b2-b10c-4c0d-b138-65b75997b871"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:41.702977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-92ba445b-726d-49ff-b7f1-8f725fa355a2 req-50fee41a-9375-4a8a-8c7b-d8a1cf2db390 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:41.703424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-92ba445b-726d-49ff-b7f1-8f725fa355a2 req-50fee41a-9375-4a8a-8c7b-d8a1cf2db390 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:41.720488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2f30f758-c14f-4afd-b5af-01e2e89ffe82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:41.721452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2f30f758-c14f-4afd-b5af-01e2e89ffe82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:41.727784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2f30f758-c14f-4afd-b5af-01e2e89ffe82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:41.727935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-92ba445b-726d-49ff-b7f1-8f725fa355a2 req-50fee41a-9375-4a8a-8c7b-d8a1cf2db390 service nova] Creating event network-changed:58a443b2-b10c-4c0d-b138-65b75997b871 for instance e369a590-728c-4108-9f1c-d685ab4a0c92 on hv-cinder-73306 Mar 08 04:20:41.729058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2f30f758-c14f-4afd-b5af-01e2e89ffe82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:41.730064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2f30f758-c14f-4afd-b5af-01e2e89ffe82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:41.730502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2f30f758-c14f-4afd-b5af-01e2e89ffe82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:41.732949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-92ba445b-726d-49ff-b7f1-8f725fa355a2 req-50fee41a-9375-4a8a-8c7b-d8a1cf2db390 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046063 Mar 08 04:20:41.733542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 98/192] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:20:41.859795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4fb7b75b-7f8d-43d6-bafb-e54d16c5e9f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:41.860512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4fb7b75b-7f8d-43d6-bafb-e54d16c5e9f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:41.867099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4fb7b75b-7f8d-43d6-bafb-e54d16c5e9f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:41.867554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4fb7b75b-7f8d-43d6-bafb-e54d16c5e9f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:41.868344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4fb7b75b-7f8d-43d6-bafb-e54d16c5e9f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:41.868782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4fb7b75b-7f8d-43d6-bafb-e54d16c5e9f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:41.878050 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2f30f758-c14f-4afd-b5af-01e2e89ffe82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:41.885650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2f30f758-c14f-4afd-b5af-01e2e89ffe82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1318 microversion: 2.1 time: 0.168980 Mar 08 04:20:41.886735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 95/193] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:41 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:42.014458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4fb7b75b-7f8d-43d6-bafb-e54d16c5e9f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:42.025405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4fb7b75b-7f8d-43d6-bafb-e54d16c5e9f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1520 microversion: 2.1 time: 0.171032 Mar 08 04:20:42.026431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 99/194] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:41 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:42.903819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-67474351-e4d0-486d-a0ea-d7b3079221cd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:42.904614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-67474351-e4d0-486d-a0ea-d7b3079221cd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:42.912085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67474351-e4d0-486d-a0ea-d7b3079221cd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:42.912658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67474351-e4d0-486d-a0ea-d7b3079221cd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:42.913554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67474351-e4d0-486d-a0ea-d7b3079221cd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:42.914039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67474351-e4d0-486d-a0ea-d7b3079221cd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:43.042392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e454f2c2-d414-43fc-96ec-d0b04b053c0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:43.043001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e454f2c2-d414-43fc-96ec-d0b04b053c0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:43.044243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-67474351-e4d0-486d-a0ea-d7b3079221cd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:43.050137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e454f2c2-d414-43fc-96ec-d0b04b053c0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:43.050587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e454f2c2-d414-43fc-96ec-d0b04b053c0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:43.051354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e454f2c2-d414-43fc-96ec-d0b04b053c0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:43.051789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e454f2c2-d414-43fc-96ec-d0b04b053c0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:43.052209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-67474351-e4d0-486d-a0ea-d7b3079221cd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1318 microversion: 2.1 time: 0.152710 Mar 08 04:20:43.052786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 96/195] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:42 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:43.184658 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e454f2c2-d414-43fc-96ec-d0b04b053c0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:43.192464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e454f2c2-d414-43fc-96ec-d0b04b053c0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1500 microversion: 2.1 time: 0.153880 Mar 08 04:20:43.193031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 100/196] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:43 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:43.208590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1275789c-6f99-4b5d-9629-deec1de2e87f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:43.209370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1275789c-6f99-4b5d-9629-deec1de2e87f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:43.215466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1275789c-6f99-4b5d-9629-deec1de2e87f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:43.215914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1275789c-6f99-4b5d-9629-deec1de2e87f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:43.216688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1275789c-6f99-4b5d-9629-deec1de2e87f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:43.217128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1275789c-6f99-4b5d-9629-deec1de2e87f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:43.350410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1275789c-6f99-4b5d-9629-deec1de2e87f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:43.358381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1275789c-6f99-4b5d-9629-deec1de2e87f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1516 microversion: 2.1 time: 0.154287 Mar 08 04:20:43.358945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 97/197] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:44.069059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-28668387-9c4f-475c-b603-317337356a10 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:44.069640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-28668387-9c4f-475c-b603-317337356a10 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:44.078080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28668387-9c4f-475c-b603-317337356a10 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:44.078671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28668387-9c4f-475c-b603-317337356a10 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:44.079799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28668387-9c4f-475c-b603-317337356a10 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:44.080728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28668387-9c4f-475c-b603-317337356a10 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:44.231940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-28668387-9c4f-475c-b603-317337356a10 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:44.233250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ed5a1b34-8690-4f83-9c26-9f434dcf8f7e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:44.233780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ed5a1b34-8690-4f83-9c26-9f434dcf8f7e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:44.240632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed5a1b34-8690-4f83-9c26-9f434dcf8f7e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:44.241079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed5a1b34-8690-4f83-9c26-9f434dcf8f7e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:44.241883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed5a1b34-8690-4f83-9c26-9f434dcf8f7e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:44.242544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed5a1b34-8690-4f83-9c26-9f434dcf8f7e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:44.242657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-28668387-9c4f-475c-b603-317337356a10 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1318 microversion: 2.1 time: 0.177555 Mar 08 04:20:44.250809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 101/198] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:44 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:44.275102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ed5a1b34-8690-4f83-9c26-9f434dcf8f7e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/ips" status: 200 len: 146 microversion: 2.1 time: 0.045548 Mar 08 04:20:44.286295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 98/199] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:20:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/ips => generated 146 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:20:44.732393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ef210f3b-ae42-4232-be16-55d5f3a68996 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:44.733529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ef210f3b-ae42-4232-be16-55d5f3a68996 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:44.741625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef210f3b-ae42-4232-be16-55d5f3a68996 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:44.742139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef210f3b-ae42-4232-be16-55d5f3a68996 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:44.743533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef210f3b-ae42-4232-be16-55d5f3a68996 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:44.744351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef210f3b-ae42-4232-be16-55d5f3a68996 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:44.778540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-ef210f3b-ae42-4232-be16-55d5f3a68996 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lazy-loading 'flavor' on Instance uuid 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:20:44.926868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ef210f3b-ae42-4232-be16-55d5f3a68996 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action" status: 200 len: 32 microversion: 2.1 time: 0.199205 Mar 08 04:20:44.927480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 102/200] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:20:44 2022] POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 04:20:44.943141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-92c7f996-7af5-4e2e-81f3-fa079e10c1e4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:44.943854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-92c7f996-7af5-4e2e-81f3-fa079e10c1e4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:44.949914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92c7f996-7af5-4e2e-81f3-fa079e10c1e4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:44.950505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92c7f996-7af5-4e2e-81f3-fa079e10c1e4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:44.951387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92c7f996-7af5-4e2e-81f3-fa079e10c1e4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:44.951936 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92c7f996-7af5-4e2e-81f3-fa079e10c1e4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:45.116022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-92c7f996-7af5-4e2e-81f3-fa079e10c1e4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:45.127058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-92c7f996-7af5-4e2e-81f3-fa079e10c1e4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.193829 Mar 08 04:20:45.128088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 99/201] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:45.260375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2682633d-7623-4988-aed1-0524b6e89ce8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:45.261055 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2682633d-7623-4988-aed1-0524b6e89ce8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:45.267089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2682633d-7623-4988-aed1-0524b6e89ce8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:45.267578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2682633d-7623-4988-aed1-0524b6e89ce8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:45.268448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2682633d-7623-4988-aed1-0524b6e89ce8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:45.268889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2682633d-7623-4988-aed1-0524b6e89ce8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:45.420595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2682633d-7623-4988-aed1-0524b6e89ce8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:45.430535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2682633d-7623-4988-aed1-0524b6e89ce8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1318 microversion: 2.1 time: 0.174912 Mar 08 04:20:45.431122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 103/202] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:45 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:46.144401 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-10392072-ff4c-4fd7-a77a-39b701c28e63 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:46.145019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-10392072-ff4c-4fd7-a77a-39b701c28e63 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:46.151227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10392072-ff4c-4fd7-a77a-39b701c28e63 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:46.151681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10392072-ff4c-4fd7-a77a-39b701c28e63 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:46.152455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10392072-ff4c-4fd7-a77a-39b701c28e63 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:46.153058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10392072-ff4c-4fd7-a77a-39b701c28e63 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:46.327802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-10392072-ff4c-4fd7-a77a-39b701c28e63 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:46.335881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-10392072-ff4c-4fd7-a77a-39b701c28e63 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.195588 Mar 08 04:20:46.336455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 100/203] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:46.449289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7f3cc850-ebf6-42e9-ae53-fbe9bf8ffb23 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:46.449828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7f3cc850-ebf6-42e9-ae53-fbe9bf8ffb23 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:46.458884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f3cc850-ebf6-42e9-ae53-fbe9bf8ffb23 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:46.461190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f3cc850-ebf6-42e9-ae53-fbe9bf8ffb23 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:46.462216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f3cc850-ebf6-42e9-ae53-fbe9bf8ffb23 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:46.463231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f3cc850-ebf6-42e9-ae53-fbe9bf8ffb23 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:46.658273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7f3cc850-ebf6-42e9-ae53-fbe9bf8ffb23 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:46.666295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7f3cc850-ebf6-42e9-ae53-fbe9bf8ffb23 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1318 microversion: 2.1 time: 0.221466 Mar 08 04:20:46.666980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 104/204] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:46 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:46.918249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2c618743-7de9-42dd-9d5e-4e4c75604064 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:46.918249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2c618743-7de9-42dd-9d5e-4e4c75604064 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:46.923258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c618743-7de9-42dd-9d5e-4e4c75604064 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:46.924530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c618743-7de9-42dd-9d5e-4e4c75604064 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:46.925535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c618743-7de9-42dd-9d5e-4e4c75604064 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:46.926022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c618743-7de9-42dd-9d5e-4e4c75604064 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:46.959612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2c618743-7de9-42dd-9d5e-4e4c75604064 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/ips" status: 200 len: 149 microversion: 2.1 time: 0.047014 Mar 08 04:20:46.965688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 101/205] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:20:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:20:47.354154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-899b6726-b283-4b2f-9b52-ed448ce4437c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:47.354764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-899b6726-b283-4b2f-9b52-ed448ce4437c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:47.360516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-899b6726-b283-4b2f-9b52-ed448ce4437c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:47.361024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-899b6726-b283-4b2f-9b52-ed448ce4437c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:47.362435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-899b6726-b283-4b2f-9b52-ed448ce4437c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:47.362878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-899b6726-b283-4b2f-9b52-ed448ce4437c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:47.523846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-899b6726-b283-4b2f-9b52-ed448ce4437c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:47.539756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-899b6726-b283-4b2f-9b52-ed448ce4437c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.189586 Mar 08 04:20:47.540631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 105/206] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:47.594299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bd0be8f6-6e10-4da2-90d1-bb23ef6dbca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56c45444-90a5-4de0-85de-95176ec10068"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:47.596267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bd0be8f6-6e10-4da2-90d1-bb23ef6dbca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:47.602530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd0be8f6-6e10-4da2-90d1-bb23ef6dbca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:47.602984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd0be8f6-6e10-4da2-90d1-bb23ef6dbca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:47.603532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-7bea4dad-39bf-44d5-945a-9eb1ef28036d req-cc847e94-7090-4bb0-ad77-f1d13f90b2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e369a590-728c-4108-9f1c-d685ab4a0c92", "name": "network-vif-plugged", "status": "completed", "tag": "58a443b2-b10c-4c0d-b138-65b75997b871"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:47.603770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd0be8f6-6e10-4da2-90d1-bb23ef6dbca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:47.604194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd0be8f6-6e10-4da2-90d1-bb23ef6dbca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:47.613590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-7bea4dad-39bf-44d5-945a-9eb1ef28036d req-cc847e94-7090-4bb0-ad77-f1d13f90b2ef service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:47.614317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-7bea4dad-39bf-44d5-945a-9eb1ef28036d req-cc847e94-7090-4bb0-ad77-f1d13f90b2ef service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:47.627354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-7bea4dad-39bf-44d5-945a-9eb1ef28036d req-cc847e94-7090-4bb0-ad77-f1d13f90b2ef service nova] Creating event network-vif-plugged:58a443b2-b10c-4c0d-b138-65b75997b871 for instance e369a590-728c-4108-9f1c-d685ab4a0c92 on hv-cinder-73306 Mar 08 04:20:47.632551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-7bea4dad-39bf-44d5-945a-9eb1ef28036d req-cc847e94-7090-4bb0-ad77-f1d13f90b2ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033859 Mar 08 04:20:47.633620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 106/207] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:20:47.688955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-93c66c50-2ec2-4da9-87a6-b7727c99ef98 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:47.689688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-93c66c50-2ec2-4da9-87a6-b7727c99ef98 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:47.699084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-93c66c50-2ec2-4da9-87a6-b7727c99ef98 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:47.699084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-93c66c50-2ec2-4da9-87a6-b7727c99ef98 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:47.700009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-93c66c50-2ec2-4da9-87a6-b7727c99ef98 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:47.700515 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-93c66c50-2ec2-4da9-87a6-b7727c99ef98 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:47.887935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-93c66c50-2ec2-4da9-87a6-b7727c99ef98 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:47.905744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-93c66c50-2ec2-4da9-87a6-b7727c99ef98 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1318 microversion: 2.1 time: 0.213300 Mar 08 04:20:47.906605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 107/208] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:47 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:47.967305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bd0be8f6-6e10-4da2-90d1-bb23ef6dbca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377192 Mar 08 04:20:47.968029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 102/209] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:20:47 2022] POST /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:20:48.378710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-473f96f0-cefd-46a5-a230-64f1480c364d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61f29fdb-515f-43d6-ab43-06e46b979899"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:48.380519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-473f96f0-cefd-46a5-a230-64f1480c364d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:48.392240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-473f96f0-cefd-46a5-a230-64f1480c364d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:48.393693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-473f96f0-cefd-46a5-a230-64f1480c364d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:48.394821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-473f96f0-cefd-46a5-a230-64f1480c364d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:48.395382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-473f96f0-cefd-46a5-a230-64f1480c364d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:48.562360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fac61258-b75b-4104-9d37-0332cad2a8ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:48.563063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fac61258-b75b-4104-9d37-0332cad2a8ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:48.569498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fac61258-b75b-4104-9d37-0332cad2a8ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:48.569977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fac61258-b75b-4104-9d37-0332cad2a8ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:48.570761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fac61258-b75b-4104-9d37-0332cad2a8ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:48.571957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fac61258-b75b-4104-9d37-0332cad2a8ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:48.699368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-473f96f0-cefd-46a5-a230-64f1480c364d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338102 Mar 08 04:20:48.700344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 108/210] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:20:48 2022] POST /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:20:48.862659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fac61258-b75b-4104-9d37-0332cad2a8ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:48.870347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fac61258-b75b-4104-9d37-0332cad2a8ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.313040 Mar 08 04:20:48.870937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 103/211] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:48.924680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-de0922dc-dd2d-482b-8bd8-79cc35877b21 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:48.925638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-de0922dc-dd2d-482b-8bd8-79cc35877b21 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:48.932533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de0922dc-dd2d-482b-8bd8-79cc35877b21 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:48.932914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de0922dc-dd2d-482b-8bd8-79cc35877b21 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:48.933733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de0922dc-dd2d-482b-8bd8-79cc35877b21 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:48.934166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de0922dc-dd2d-482b-8bd8-79cc35877b21 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:49.166949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-de0922dc-dd2d-482b-8bd8-79cc35877b21 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:49.177682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-de0922dc-dd2d-482b-8bd8-79cc35877b21 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1318 microversion: 2.1 time: 0.257524 Mar 08 04:20:49.178502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 109/212] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:48 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:49.888455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-732ab97f-4e49-4d51-8309-a0ac7a65369b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:49.889070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-732ab97f-4e49-4d51-8309-a0ac7a65369b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:49.896508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-732ab97f-4e49-4d51-8309-a0ac7a65369b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:49.897124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-732ab97f-4e49-4d51-8309-a0ac7a65369b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:49.898519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-732ab97f-4e49-4d51-8309-a0ac7a65369b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:49.898960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-732ab97f-4e49-4d51-8309-a0ac7a65369b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:50.052625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-732ab97f-4e49-4d51-8309-a0ac7a65369b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:50.070684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-732ab97f-4e49-4d51-8309-a0ac7a65369b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.186095 Mar 08 04:20:50.071635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 104/213] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:50.195494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0d3db789-de68-43d9-bea0-af00327354d5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:50.196919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0d3db789-de68-43d9-bea0-af00327354d5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:50.204097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d3db789-de68-43d9-bea0-af00327354d5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:50.205534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d3db789-de68-43d9-bea0-af00327354d5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:50.206961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d3db789-de68-43d9-bea0-af00327354d5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:50.207578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d3db789-de68-43d9-bea0-af00327354d5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:50.468789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0d3db789-de68-43d9-bea0-af00327354d5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:50.477505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0d3db789-de68-43d9-bea0-af00327354d5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1507 microversion: 2.1 time: 0.286485 Mar 08 04:20:50.478100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 110/214] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:50 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:51.106052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a916bbcc-728c-4057-bb93-878fca9d55e3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:51.107732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a916bbcc-728c-4057-bb93-878fca9d55e3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:51.118481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a916bbcc-728c-4057-bb93-878fca9d55e3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:51.119714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a916bbcc-728c-4057-bb93-878fca9d55e3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:51.121010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a916bbcc-728c-4057-bb93-878fca9d55e3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:51.122265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a916bbcc-728c-4057-bb93-878fca9d55e3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:51.323502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a916bbcc-728c-4057-bb93-878fca9d55e3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:51.332860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a916bbcc-728c-4057-bb93-878fca9d55e3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.241378 Mar 08 04:20:51.333618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 105/215] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:52.350970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-28600397-485c-4620-b77e-810b436ac19b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:52.351574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-28600397-485c-4620-b77e-810b436ac19b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:52.357987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28600397-485c-4620-b77e-810b436ac19b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:52.358427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28600397-485c-4620-b77e-810b436ac19b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:52.359242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28600397-485c-4620-b77e-810b436ac19b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:52.359679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28600397-485c-4620-b77e-810b436ac19b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:52.495439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-28600397-485c-4620-b77e-810b436ac19b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:52.506704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-28600397-485c-4620-b77e-810b436ac19b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.156291 Mar 08 04:20:52.506704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 111/216] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:52.754518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2113291514", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "networks": [{"uuid": "dba40b89-9401-401c-ab98-b3081100c82f"}]}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:20:53.522252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f2d7b745-4645-4e41-a773-1edc46841d76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:53.522782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f2d7b745-4645-4e41-a773-1edc46841d76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:53.532057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2d7b745-4645-4e41-a773-1edc46841d76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:53.532814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2d7b745-4645-4e41-a773-1edc46841d76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:53.533636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2d7b745-4645-4e41-a773-1edc46841d76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:53.534167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2d7b745-4645-4e41-a773-1edc46841d76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:53.677602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f2d7b745-4645-4e41-a773-1edc46841d76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:53.685619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f2d7b745-4645-4e41-a773-1edc46841d76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.167281 Mar 08 04:20:53.686284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 112/217] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:54.703214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f497b048-fb75-44b7-8f76-3710c17f956b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:54.703848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f497b048-fb75-44b7-8f76-3710c17f956b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:54.710584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f497b048-fb75-44b7-8f76-3710c17f956b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:54.711029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f497b048-fb75-44b7-8f76-3710c17f956b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:54.711895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f497b048-fb75-44b7-8f76-3710c17f956b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:54.712327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f497b048-fb75-44b7-8f76-3710c17f956b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:54.858351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f497b048-fb75-44b7-8f76-3710c17f956b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:54.866396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f497b048-fb75-44b7-8f76-3710c17f956b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.167434 Mar 08 04:20:54.866964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 113/218] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:54 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:55.883043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-82100c3a-44a8-414b-afec-4b19ba4fb778 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:55.883649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-82100c3a-44a8-414b-afec-4b19ba4fb778 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:55.889997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-82100c3a-44a8-414b-afec-4b19ba4fb778 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:55.890444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-82100c3a-44a8-414b-afec-4b19ba4fb778 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:55.891204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-82100c3a-44a8-414b-afec-4b19ba4fb778 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:55.891632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-82100c3a-44a8-414b-afec-4b19ba4fb778 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:56.031699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-82100c3a-44a8-414b-afec-4b19ba4fb778 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:56.040048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-82100c3a-44a8-414b-afec-4b19ba4fb778 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.160820 Mar 08 04:20:56.040627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 114/219] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:57.056967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b5ea4696-c220-4ceb-b96b-2087d820e89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:57.057695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b5ea4696-c220-4ceb-b96b-2087d820e89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:57.064266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5ea4696-c220-4ceb-b96b-2087d820e89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:57.064856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5ea4696-c220-4ceb-b96b-2087d820e89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:57.065694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5ea4696-c220-4ceb-b96b-2087d820e89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:57.066121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5ea4696-c220-4ceb-b96b-2087d820e89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:57.200444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b5ea4696-c220-4ceb-b96b-2087d820e89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:57.208123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b5ea4696-c220-4ceb-b96b-2087d820e89c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.154984 Mar 08 04:20:57.208695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 115/220] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:57.538533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] validate_networks() for [('dba40b89-9401-401c-ab98-b3081100c82f', None, None, None, None, None)] {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:20:57.904539 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:20:57.904952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:20:57.905422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:20:57.905856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:20:57.906258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:20:57.915823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:57.916536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:57.917685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:57.918048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:57.936552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Getting quotas for project 21a2431c1a3a402f93d42ece33c568eb. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:20:57.941159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Getting quotas for user f56858073f1f4a9ab49f3833c2bf77e0 and project 21a2431c1a3a402f93d42ece33c568eb. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:20:57.952811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:20:57.956222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:20:58.003452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-50b26b5b-a204-4d8e-9adb-2d8cad63417c tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.253860 Mar 08 04:20:58.004086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 106/221] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:20:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 5255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 04:20:58.014607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c3e0554c-1c65-43d6-a19d-8dcd95128f50 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:58.015275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c3e0554c-1c65-43d6-a19d-8dcd95128f50 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:58.066579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c3e0554c-1c65-43d6-a19d-8dcd95128f50 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:58.072944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c3e0554c-1c65-43d6-a19d-8dcd95128f50 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1214 microversion: 2.1 time: 0.062688 Mar 08 04:20:58.073504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 116/222] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:58 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:20:58.225953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-786a83d9-a37c-4b56-bc88-162c0092e702 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:58.226596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-786a83d9-a37c-4b56-bc88-162c0092e702 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:58.233296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-786a83d9-a37c-4b56-bc88-162c0092e702 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:58.233828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-786a83d9-a37c-4b56-bc88-162c0092e702 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:58.234607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-786a83d9-a37c-4b56-bc88-162c0092e702 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:58.235045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-786a83d9-a37c-4b56-bc88-162c0092e702 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:58.386186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-786a83d9-a37c-4b56-bc88-162c0092e702 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:58.396274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-786a83d9-a37c-4b56-bc88-162c0092e702 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.174061 Mar 08 04:20:58.396770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 107/223] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:59.093045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4a017630-ec5e-4d4e-ae0d-b48e33be2658 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:59.094397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4a017630-ec5e-4d4e-ae0d-b48e33be2658 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:59.105703 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a017630-ec5e-4d4e-ae0d-b48e33be2658 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:59.106634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a017630-ec5e-4d4e-ae0d-b48e33be2658 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:59.108448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a017630-ec5e-4d4e-ae0d-b48e33be2658 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:59.109535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a017630-ec5e-4d4e-ae0d-b48e33be2658 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:59.182271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4a017630-ec5e-4d4e-ae0d-b48e33be2658 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:59.197885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4a017630-ec5e-4d4e-ae0d-b48e33be2658 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1284 microversion: 2.1 time: 0.105623 Mar 08 04:20:59.201251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 117/224] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:59 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:20:59.413290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e533d6ad-1e6e-4d26-8537-8165ea1e5f0f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:20:59.414835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e533d6ad-1e6e-4d26-8537-8165ea1e5f0f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:20:59.430131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e533d6ad-1e6e-4d26-8537-8165ea1e5f0f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:59.431311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e533d6ad-1e6e-4d26-8537-8165ea1e5f0f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:59.432446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e533d6ad-1e6e-4d26-8537-8165ea1e5f0f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:20:59.432962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e533d6ad-1e6e-4d26-8537-8165ea1e5f0f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:20:59.649989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e533d6ad-1e6e-4d26-8537-8165ea1e5f0f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:20:59.658456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e533d6ad-1e6e-4d26-8537-8165ea1e5f0f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.248731 Mar 08 04:20:59.659265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 108/225] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:20:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:00.219994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-021e303c-f831-4616-a486-9ebd40c577a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:00.221776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-021e303c-f831-4616-a486-9ebd40c577a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:00.233993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021e303c-f831-4616-a486-9ebd40c577a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:00.236821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021e303c-f831-4616-a486-9ebd40c577a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:00.247437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021e303c-f831-4616-a486-9ebd40c577a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:00.248123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021e303c-f831-4616-a486-9ebd40c577a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:00.501238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-021e303c-f831-4616-a486-9ebd40c577a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:00.513092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-021e303c-f831-4616-a486-9ebd40c577a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1314 microversion: 2.1 time: 0.295974 Mar 08 04:21:00.514408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 118/226] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:00 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:00.675987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-864c0f87-1e08-47b5-ba9e-8a155d462ad4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:00.677971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-864c0f87-1e08-47b5-ba9e-8a155d462ad4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:00.685403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-864c0f87-1e08-47b5-ba9e-8a155d462ad4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:00.686111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-864c0f87-1e08-47b5-ba9e-8a155d462ad4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:00.687099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-864c0f87-1e08-47b5-ba9e-8a155d462ad4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:00.687537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-864c0f87-1e08-47b5-ba9e-8a155d462ad4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:00.880696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-fbfa004f-498c-4ac0-9c60-791702dba0d1 req-4484acbf-f842-46d7-85b7-495318d62521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59f2363-5bf8-4f46-972a-4e16d0e4bbd1", "tag": "43c1641b-04c0-4d4b-b349-9375016443ef"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:00.889080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-fbfa004f-498c-4ac0-9c60-791702dba0d1 req-4484acbf-f842-46d7-85b7-495318d62521 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:00.889522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-fbfa004f-498c-4ac0-9c60-791702dba0d1 req-4484acbf-f842-46d7-85b7-495318d62521 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:00.910925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-fbfa004f-498c-4ac0-9c60-791702dba0d1 req-4484acbf-f842-46d7-85b7-495318d62521 service nova] Creating event network-changed:43c1641b-04c0-4d4b-b349-9375016443ef for instance f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 on hv-cinder-73306 Mar 08 04:21:00.916932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-fbfa004f-498c-4ac0-9c60-791702dba0d1 req-4484acbf-f842-46d7-85b7-495318d62521 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040943 Mar 08 04:21:00.917775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 119/227] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:21:00.929478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-864c0f87-1e08-47b5-ba9e-8a155d462ad4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:00.942837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-864c0f87-1e08-47b5-ba9e-8a155d462ad4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.269633 Mar 08 04:21:00.953574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 109/228] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:01.198241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2908820a-290f-4683-a5b1-706964d0f348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:01.205630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2908820a-290f-4683-a5b1-706964d0f348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:01.206395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2908820a-290f-4683-a5b1-706964d0f348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:01.306592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2908820a-290f-4683-a5b1-706964d0f348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Going to try to stop instance {{(pid=116775) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 08 04:21:01.365960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2908820a-290f-4683-a5b1-706964d0f348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/action" status: 202 len: 0 microversion: 2.1 time: 0.171726 Mar 08 04:21:01.367890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 120/229] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:21:01 2022] POST /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 04:21:01.381029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-09e05d31-4c74-4cd6-8248-a831cbba821d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:01.382167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-09e05d31-4c74-4cd6-8248-a831cbba821d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:01.395927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-09e05d31-4c74-4cd6-8248-a831cbba821d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:01.396556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-09e05d31-4c74-4cd6-8248-a831cbba821d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:01.398049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-09e05d31-4c74-4cd6-8248-a831cbba821d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:01.399753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-09e05d31-4c74-4cd6-8248-a831cbba821d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:01.533953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d26b8604-95b3-4e0a-84d1-d4727858dd6d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:01.534841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d26b8604-95b3-4e0a-84d1-d4727858dd6d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:01.554998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d26b8604-95b3-4e0a-84d1-d4727858dd6d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:01.557065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d26b8604-95b3-4e0a-84d1-d4727858dd6d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:01.557901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d26b8604-95b3-4e0a-84d1-d4727858dd6d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:01.558524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d26b8604-95b3-4e0a-84d1-d4727858dd6d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:01.689236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-09e05d31-4c74-4cd6-8248-a831cbba821d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:01.701442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-09e05d31-4c74-4cd6-8248-a831cbba821d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.327420 Mar 08 04:21:01.704687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 110/230] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:01.786263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d26b8604-95b3-4e0a-84d1-d4727858dd6d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:01.793584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d26b8604-95b3-4e0a-84d1-d4727858dd6d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1314 microversion: 2.1 time: 0.265647 Mar 08 04:21:01.794176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 121/231] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:01 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:01.960588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d4f8ed5f-c007-4c77-8914-11bb85d80474 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:01.963199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d4f8ed5f-c007-4c77-8914-11bb85d80474 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:01.968912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d4f8ed5f-c007-4c77-8914-11bb85d80474 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:01.969360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d4f8ed5f-c007-4c77-8914-11bb85d80474 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:01.970153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d4f8ed5f-c007-4c77-8914-11bb85d80474 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:01.970588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d4f8ed5f-c007-4c77-8914-11bb85d80474 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:02.123102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d4f8ed5f-c007-4c77-8914-11bb85d80474 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:02.134331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d4f8ed5f-c007-4c77-8914-11bb85d80474 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.177689 Mar 08 04:21:02.135807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 111/232] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:02.719734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-807f18af-5674-4811-b864-8a2fc14fb3b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:02.720338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-807f18af-5674-4811-b864-8a2fc14fb3b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:02.735149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-807f18af-5674-4811-b864-8a2fc14fb3b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:02.736306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-807f18af-5674-4811-b864-8a2fc14fb3b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:02.737021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-807f18af-5674-4811-b864-8a2fc14fb3b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:02.737456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-807f18af-5674-4811-b864-8a2fc14fb3b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:02.811070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f6c6c5bf-0845-413c-99fb-c25b69d574c0 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:02.812335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f6c6c5bf-0845-413c-99fb-c25b69d574c0 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:02.820941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6c6c5bf-0845-413c-99fb-c25b69d574c0 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:02.821527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6c6c5bf-0845-413c-99fb-c25b69d574c0 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:02.822591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6c6c5bf-0845-413c-99fb-c25b69d574c0 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:02.823489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6c6c5bf-0845-413c-99fb-c25b69d574c0 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:02.933691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-807f18af-5674-4811-b864-8a2fc14fb3b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:02.942459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-807f18af-5674-4811-b864-8a2fc14fb3b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.226508 Mar 08 04:21:02.943120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 122/233] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:03.002247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f6c6c5bf-0845-413c-99fb-c25b69d574c0 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:03.009643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f6c6c5bf-0845-413c-99fb-c25b69d574c0 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1314 microversion: 2.1 time: 0.202316 Mar 08 04:21:03.010225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 112/234] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:02 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:03.152346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d704b605-cf3c-474b-b1e2-940ff368da62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:03.153111 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d704b605-cf3c-474b-b1e2-940ff368da62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:03.160220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d704b605-cf3c-474b-b1e2-940ff368da62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:03.160872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d704b605-cf3c-474b-b1e2-940ff368da62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:03.161679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d704b605-cf3c-474b-b1e2-940ff368da62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:03.162253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d704b605-cf3c-474b-b1e2-940ff368da62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:03.297171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d704b605-cf3c-474b-b1e2-940ff368da62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:03.307655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d704b605-cf3c-474b-b1e2-940ff368da62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.159245 Mar 08 04:21:03.308151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 123/235] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:03.521446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1191921730", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1894826000", "security_groups": [{"name": "tempest-secgroup-smoke-740706584"}], "networks": [{"uuid": "197628f4-b162-4623-8f19-57919017091a"}], "block_device_mapping_v2": [{"uuid": "6a3d0b7e-4f67-4cba-8c74-d6f4890abfd4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:03.634196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] validate_networks() for [('197628f4-b162-4623-8f19-57919017091a', None, None, None, None, None)] {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:21:03.960046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4a42843c-d3a9-43a7-819f-a9067169ddfb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:03.961255 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4a42843c-d3a9-43a7-819f-a9067169ddfb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:03.967727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a42843c-d3a9-43a7-819f-a9067169ddfb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:03.968176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a42843c-d3a9-43a7-819f-a9067169ddfb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:03.968942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a42843c-d3a9-43a7-819f-a9067169ddfb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:03.969379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a42843c-d3a9-43a7-819f-a9067169ddfb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.064237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:21:04.064733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:21:04.065085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:21:04.065503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:21:04.065938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:21:04.074749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.075204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.076049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.076490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.094262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Getting quotas for project 0109ff95df0941709c7e20284930ec61. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:21:04.098257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Getting quotas for user 2b4b172419974ce9a929d4df7d3c5380 and project 0109ff95df0941709c7e20284930ec61. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:21:04.167348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:21:04.169876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a3d0b7e-4f67-4cba-8c74-d6f4890abfd4',volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:21:04.331710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4a42843c-d3a9-43a7-819f-a9067169ddfb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:04.341880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4a42843c-d3a9-43a7-819f-a9067169ddfb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.385505 Mar 08 04:21:04.342461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 124/236] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:03 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:04.351585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-559e70f4-7ed4-4900-8f6c-d714a410e975 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.833860 Mar 08 04:21:04.352306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 113/237] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:21:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:21:04.357343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1272440307", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:04.361335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b70bc802-4233-46d6-b1a3-18d1e0ef241a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:04.361994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b70bc802-4233-46d6-b1a3-18d1e0ef241a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:04.370393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b70bc802-4233-46d6-b1a3-18d1e0ef241a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.370843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b70bc802-4233-46d6-b1a3-18d1e0ef241a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.371618 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b70bc802-4233-46d6-b1a3-18d1e0ef241a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.372437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b70bc802-4233-46d6-b1a3-18d1e0ef241a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.413585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] validate_networks() for None {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:21:04.697265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b70bc802-4233-46d6-b1a3-18d1e0ef241a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:04.705281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b70bc802-4233-46d6-b1a3-18d1e0ef241a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1314 microversion: 2.1 time: 0.352161 Mar 08 04:21:04.706174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 125/238] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:04 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:04.721687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-132a25b0-cb93-48b5-9960-39311750e919 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:04.722475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-132a25b0-cb93-48b5-9960-39311750e919 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:04.729281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-132a25b0-cb93-48b5-9960-39311750e919 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.730077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-132a25b0-cb93-48b5-9960-39311750e919 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.731095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-132a25b0-cb93-48b5-9960-39311750e919 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.731784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-132a25b0-cb93-48b5-9960-39311750e919 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.777939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:21:04.778162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:21:04.778917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:21:04.779615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:21:04.779981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:21:04.790517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.791059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.791938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.792571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.815579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Getting quotas for project f1c2f59b362541308c7e35540918b59b. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:21:04.820137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Getting quotas for user 9779db0a09d04a0fb3e27f8c58b38ba3 and project f1c2f59b362541308c7e35540918b59b. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:21:04.837942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:21:04.840325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:21:04.900516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-48c5f5c7-d544-4155-ba18-af0a4f77f54e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546574 Mar 08 04:21:04.901246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 114/239] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:21:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:21:04.906978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d8195446-5741-455e-a724-4e50e02ab4d7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:04.908494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d8195446-5741-455e-a724-4e50e02ab4d7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:04.915343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8195446-5741-455e-a724-4e50e02ab4d7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.916008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8195446-5741-455e-a724-4e50e02ab4d7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.916966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8195446-5741-455e-a724-4e50e02ab4d7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:04.917900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8195446-5741-455e-a724-4e50e02ab4d7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:04.921533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-132a25b0-cb93-48b5-9960-39311750e919 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:04.936847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-132a25b0-cb93-48b5-9960-39311750e919 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.220235 Mar 08 04:21:04.952177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 126/240] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:04.963235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c734c70a-2413-4463-87de-e185c52ec719 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:04.964254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c734c70a-2413-4463-87de-e185c52ec719 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:05.020611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d8195446-5741-455e-a724-4e50e02ab4d7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:05.028450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d8195446-5741-455e-a724-4e50e02ab4d7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1131 microversion: 2.1 time: 0.125976 Mar 08 04:21:05.029030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 115/241] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:04 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1131 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:05.051152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c734c70a-2413-4463-87de-e185c52ec719 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:05.058190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c734c70a-2413-4463-87de-e185c52ec719 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1215 microversion: 2.1 time: 0.104548 Mar 08 04:21:05.058760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 127/242] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:04 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:05.360126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d51dbe4c-7c65-4648-9e34-ffaa811f9499 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:05.361810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d51dbe4c-7c65-4648-9e34-ffaa811f9499 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:05.367888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d51dbe4c-7c65-4648-9e34-ffaa811f9499 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:05.368339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d51dbe4c-7c65-4648-9e34-ffaa811f9499 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:05.369141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d51dbe4c-7c65-4648-9e34-ffaa811f9499 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:05.369582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d51dbe4c-7c65-4648-9e34-ffaa811f9499 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:05.526557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d51dbe4c-7c65-4648-9e34-ffaa811f9499 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:05.535810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d51dbe4c-7c65-4648-9e34-ffaa811f9499 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.180460 Mar 08 04:21:05.545909 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 116/243] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:05.722931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-47eebc6a-5235-49da-b304-85cd33581413 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:05.723499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-47eebc6a-5235-49da-b304-85cd33581413 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:05.729974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47eebc6a-5235-49da-b304-85cd33581413 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:05.730494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47eebc6a-5235-49da-b304-85cd33581413 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:05.731738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47eebc6a-5235-49da-b304-85cd33581413 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:05.732276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47eebc6a-5235-49da-b304-85cd33581413 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:05.780378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-2077b239-fbf9-4b40-81af-c898cb7f2fbb req-3841d162-1745-4cdb-b9f2-2cd992236e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59f2363-5bf8-4f46-972a-4e16d0e4bbd1", "name": "network-vif-plugged", "status": "completed", "tag": "43c1641b-04c0-4d4b-b349-9375016443ef"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:05.791838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-2077b239-fbf9-4b40-81af-c898cb7f2fbb req-3841d162-1745-4cdb-b9f2-2cd992236e95 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:05.792283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-2077b239-fbf9-4b40-81af-c898cb7f2fbb req-3841d162-1745-4cdb-b9f2-2cd992236e95 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:05.803891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-2077b239-fbf9-4b40-81af-c898cb7f2fbb req-3841d162-1745-4cdb-b9f2-2cd992236e95 service nova] Creating event network-vif-plugged:43c1641b-04c0-4d4b-b349-9375016443ef for instance f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 on hv-cinder-73306 Mar 08 04:21:05.810445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-2077b239-fbf9-4b40-81af-c898cb7f2fbb req-3841d162-1745-4cdb-b9f2-2cd992236e95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033899 Mar 08 04:21:05.811538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 117/244] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:05.950992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-47eebc6a-5235-49da-b304-85cd33581413 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:05.968156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a4a07480-f5c7-4939-8200-ffae0578c0f8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:05.969460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a4a07480-f5c7-4939-8200-ffae0578c0f8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:05.977835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4a07480-f5c7-4939-8200-ffae0578c0f8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:05.978676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4a07480-f5c7-4939-8200-ffae0578c0f8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:05.980054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4a07480-f5c7-4939-8200-ffae0578c0f8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:05.981328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-47eebc6a-5235-49da-b304-85cd33581413 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1314 microversion: 2.1 time: 0.263280 Mar 08 04:21:05.982056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4a07480-f5c7-4939-8200-ffae0578c0f8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:05.989337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 128/245] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:05 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:06.046910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-390d3532-99ea-42ac-87e7-08bbde170a1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:06.048481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-390d3532-99ea-42ac-87e7-08bbde170a1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:06.055022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-390d3532-99ea-42ac-87e7-08bbde170a1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:06.055712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-390d3532-99ea-42ac-87e7-08bbde170a1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:06.056636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-390d3532-99ea-42ac-87e7-08bbde170a1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:06.057257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-390d3532-99ea-42ac-87e7-08bbde170a1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:06.138479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-390d3532-99ea-42ac-87e7-08bbde170a1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:06.146359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-390d3532-99ea-42ac-87e7-08bbde170a1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1205 microversion: 2.1 time: 0.103688 Mar 08 04:21:06.147482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 129/246] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:06.152213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-feb56e4e-5409-4774-b8c4-6e5bf3e7a2db tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:06.152995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-feb56e4e-5409-4774-b8c4-6e5bf3e7a2db tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:06.161713 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-feb56e4e-5409-4774-b8c4-6e5bf3e7a2db tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:06.162357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-feb56e4e-5409-4774-b8c4-6e5bf3e7a2db tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:06.163290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-feb56e4e-5409-4774-b8c4-6e5bf3e7a2db tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:06.163878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-feb56e4e-5409-4774-b8c4-6e5bf3e7a2db tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:06.255502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-feb56e4e-5409-4774-b8c4-6e5bf3e7a2db tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:06.265989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-feb56e4e-5409-4774-b8c4-6e5bf3e7a2db tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1275 microversion: 2.1 time: 0.117262 Mar 08 04:21:06.270772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 130/247] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:06 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1275 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:06.299766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a4a07480-f5c7-4939-8200-ffae0578c0f8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:06.308298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a4a07480-f5c7-4939-8200-ffae0578c0f8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.347102 Mar 08 04:21:06.308995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 118/248] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:06.553297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-355a72e3-1a34-410f-a3f8-23e8b068e1f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:06.553935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-355a72e3-1a34-410f-a3f8-23e8b068e1f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:06.560554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-355a72e3-1a34-410f-a3f8-23e8b068e1f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:06.561024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-355a72e3-1a34-410f-a3f8-23e8b068e1f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:06.562167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-355a72e3-1a34-410f-a3f8-23e8b068e1f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:06.562608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-355a72e3-1a34-410f-a3f8-23e8b068e1f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:06.725796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-355a72e3-1a34-410f-a3f8-23e8b068e1f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:06.733707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-355a72e3-1a34-410f-a3f8-23e8b068e1f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.184676 Mar 08 04:21:06.734278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 131/249] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:07.005601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e333f315-30a9-4673-b7fd-285ed4662bdd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:07.006684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e333f315-30a9-4673-b7fd-285ed4662bdd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:07.013643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e333f315-30a9-4673-b7fd-285ed4662bdd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.014338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e333f315-30a9-4673-b7fd-285ed4662bdd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.015435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e333f315-30a9-4673-b7fd-285ed4662bdd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.015869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e333f315-30a9-4673-b7fd-285ed4662bdd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.164616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8e0a07a2-4661-44d3-b33f-ec8a72b4a289 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:07.165229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8e0a07a2-4661-44d3-b33f-ec8a72b4a289 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:07.173240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8e0a07a2-4661-44d3-b33f-ec8a72b4a289 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.174266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e333f315-30a9-4673-b7fd-285ed4662bdd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:07.175391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8e0a07a2-4661-44d3-b33f-ec8a72b4a289 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.176358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8e0a07a2-4661-44d3-b33f-ec8a72b4a289 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.176964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8e0a07a2-4661-44d3-b33f-ec8a72b4a289 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.182913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e333f315-30a9-4673-b7fd-285ed4662bdd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1314 microversion: 2.1 time: 0.181446 Mar 08 04:21:07.189715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 119/250] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:07 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:07.289188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-376326e9-dbd0-4d2b-863a-bea11df6c7d9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:07.290061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-376326e9-dbd0-4d2b-863a-bea11df6c7d9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:07.297413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-376326e9-dbd0-4d2b-863a-bea11df6c7d9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.299597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-376326e9-dbd0-4d2b-863a-bea11df6c7d9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.304372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-376326e9-dbd0-4d2b-863a-bea11df6c7d9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.305757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-376326e9-dbd0-4d2b-863a-bea11df6c7d9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.343467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8e0a07a2-4661-44d3-b33f-ec8a72b4a289 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:07.356594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8e0a07a2-4661-44d3-b33f-ec8a72b4a289 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1272 microversion: 2.1 time: 0.195613 Mar 08 04:21:07.357906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 132/251] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:07.364158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7fe04c7c-fc15-4d83-b60d-23278888a939 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:07.365903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7fe04c7c-fc15-4d83-b60d-23278888a939 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:07.373799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fe04c7c-fc15-4d83-b60d-23278888a939 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.374684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fe04c7c-fc15-4d83-b60d-23278888a939 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.376664 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fe04c7c-fc15-4d83-b60d-23278888a939 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.381815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fe04c7c-fc15-4d83-b60d-23278888a939 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.398196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-376326e9-dbd0-4d2b-863a-bea11df6c7d9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:07.406735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-376326e9-dbd0-4d2b-863a-bea11df6c7d9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1273 microversion: 2.1 time: 0.121541 Mar 08 04:21:07.408573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 120/252] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:07 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:07.549815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7fe04c7c-fc15-4d83-b60d-23278888a939 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:07.557779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7fe04c7c-fc15-4d83-b60d-23278888a939 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.198420 Mar 08 04:21:07.562264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 133/253] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:07.732195 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-7fd58355-b807-40f8-afea-6cb226d0ddd1 req-eb056afa-0da4-41e0-afe7-7d28d15e0d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4208bcea-e0a6-4c9d-956c-477a87d388ca", "tag": "5ed21f05-392d-4365-8c94-f119e23a8232"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:07.743695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7fd58355-b807-40f8-afea-6cb226d0ddd1 req-eb056afa-0da4-41e0-afe7-7d28d15e0d0a service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.744513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7fd58355-b807-40f8-afea-6cb226d0ddd1 req-eb056afa-0da4-41e0-afe7-7d28d15e0d0a service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.755871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-55fae116-918e-4dfd-9f1b-d3e2af9a72ef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:07.757178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-55fae116-918e-4dfd-9f1b-d3e2af9a72ef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:07.768772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55fae116-918e-4dfd-9f1b-d3e2af9a72ef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.769513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55fae116-918e-4dfd-9f1b-d3e2af9a72ef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.770492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55fae116-918e-4dfd-9f1b-d3e2af9a72ef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:07.771036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55fae116-918e-4dfd-9f1b-d3e2af9a72ef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:07.771416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-7fd58355-b807-40f8-afea-6cb226d0ddd1 req-eb056afa-0da4-41e0-afe7-7d28d15e0d0a service nova] Creating event network-changed:5ed21f05-392d-4365-8c94-f119e23a8232 for instance 4208bcea-e0a6-4c9d-956c-477a87d388ca on hv-cinder-73306 Mar 08 04:21:07.778387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-7fd58355-b807-40f8-afea-6cb226d0ddd1 req-eb056afa-0da4-41e0-afe7-7d28d15e0d0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051964 Mar 08 04:21:07.778991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 121/254] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:07.985542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-55fae116-918e-4dfd-9f1b-d3e2af9a72ef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:07.996143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-55fae116-918e-4dfd-9f1b-d3e2af9a72ef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.247141 Mar 08 04:21:08.006680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 134/255] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:07 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:08.161427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8482ea19-7b53-40b5-bac0-c347a140596b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: .version_select at 0x7fe83282c040>, body: {"keypair": {"name": "tempest-keypair-82282902"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:08.176913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-8482ea19-7b53-40b5-bac0-c347a140596b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:21:08.183043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-8482ea19-7b53-40b5-bac0-c347a140596b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:21:08.203359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5673a43c-20ed-43c3-9fbc-42b9dc0f0660 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:08.204526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5673a43c-20ed-43c3-9fbc-42b9dc0f0660 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:08.210658 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5673a43c-20ed-43c3-9fbc-42b9dc0f0660 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:08.211112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5673a43c-20ed-43c3-9fbc-42b9dc0f0660 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:08.211983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5673a43c-20ed-43c3-9fbc-42b9dc0f0660 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:08.212323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5673a43c-20ed-43c3-9fbc-42b9dc0f0660 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:08.383790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5673a43c-20ed-43c3-9fbc-42b9dc0f0660 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:08.403556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5673a43c-20ed-43c3-9fbc-42b9dc0f0660 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1498 microversion: 2.1 time: 0.206532 Mar 08 04:21:08.406862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 135/256] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:08 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1498 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:08.407977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-8482ea19-7b53-40b5-bac0-c347a140596b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:21:08.412517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e2adf075-d781-4c6f-97d0-0b2e60635634 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:08.413260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e2adf075-d781-4c6f-97d0-0b2e60635634 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:08.422015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2adf075-d781-4c6f-97d0-0b2e60635634 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:08.423043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2adf075-d781-4c6f-97d0-0b2e60635634 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:08.423775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-8482ea19-7b53-40b5-bac0-c347a140596b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:21:08.427748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2adf075-d781-4c6f-97d0-0b2e60635634 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:08.428553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2adf075-d781-4c6f-97d0-0b2e60635634 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:08.455771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8482ea19-7b53-40b5-bac0-c347a140596b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.300330 Mar 08 04:21:08.461636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 122/257] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 04:21:08 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:08.471560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d36d5698-9a89-4768-aa0d-f9009f50e35b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:08.472366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d36d5698-9a89-4768-aa0d-f9009f50e35b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:08.485369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36d5698-9a89-4768-aa0d-f9009f50e35b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:08.485858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36d5698-9a89-4768-aa0d-f9009f50e35b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:08.486649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36d5698-9a89-4768-aa0d-f9009f50e35b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:08.487099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36d5698-9a89-4768-aa0d-f9009f50e35b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:08.773505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e2adf075-d781-4c6f-97d0-0b2e60635634 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:08.781793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e2adf075-d781-4c6f-97d0-0b2e60635634 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1272 microversion: 2.1 time: 0.372895 Mar 08 04:21:08.792022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 136/258] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:08 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1272 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:08.792256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d36d5698-9a89-4768-aa0d-f9009f50e35b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:08.792367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9396d6cf-5315-45d7-8a27-316186268aff tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:08.792367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9396d6cf-5315-45d7-8a27-316186268aff tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:08.797179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9396d6cf-5315-45d7-8a27-316186268aff tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:08.797994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9396d6cf-5315-45d7-8a27-316186268aff tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:08.798788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9396d6cf-5315-45d7-8a27-316186268aff tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:08.799254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9396d6cf-5315-45d7-8a27-316186268aff tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:08.799389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d36d5698-9a89-4768-aa0d-f9009f50e35b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1315 microversion: 2.1 time: 0.336512 Mar 08 04:21:08.800238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 123/259] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:08 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:09.005042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a87923a5-4fc0-41ea-b167-96f932131b00 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:09.005536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a87923a5-4fc0-41ea-b167-96f932131b00 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:09.014240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a87923a5-4fc0-41ea-b167-96f932131b00 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.014465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a87923a5-4fc0-41ea-b167-96f932131b00 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:09.016030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a87923a5-4fc0-41ea-b167-96f932131b00 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.016594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a87923a5-4fc0-41ea-b167-96f932131b00 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:09.036377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9396d6cf-5315-45d7-8a27-316186268aff tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:09.045699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9396d6cf-5315-45d7-8a27-316186268aff tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1522 microversion: 2.1 time: 0.261380 Mar 08 04:21:09.046252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 137/260] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:09.053373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-80194a52-e9ad-4e98-bf55-d3fc76e5e9df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:09.057291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-80194a52-e9ad-4e98-bf55-d3fc76e5e9df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:09.074502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a87923a5-4fc0-41ea-b167-96f932131b00 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Going to try to terminate instance {{(pid=116774) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:21:09.074748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80194a52-e9ad-4e98-bf55-d3fc76e5e9df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.075078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80194a52-e9ad-4e98-bf55-d3fc76e5e9df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:09.075870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80194a52-e9ad-4e98-bf55-d3fc76e5e9df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.076312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80194a52-e9ad-4e98-bf55-d3fc76e5e9df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:09.197524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a87923a5-4fc0-41ea-b167-96f932131b00 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 204 len: 0 microversion: 2.1 time: 0.196306 Mar 08 04:21:09.198353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 124/261] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:21:08 2022] DELETE /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 04:21:09.207355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2d787d66-9510-41e3-bc3b-9b8ebb0f0601 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:09.208058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2d787d66-9510-41e3-bc3b-9b8ebb0f0601 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:09.220198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d787d66-9510-41e3-bc3b-9b8ebb0f0601 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.220951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d787d66-9510-41e3-bc3b-9b8ebb0f0601 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:09.222471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d787d66-9510-41e3-bc3b-9b8ebb0f0601 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.223444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d787d66-9510-41e3-bc3b-9b8ebb0f0601 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:09.367075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-80194a52-e9ad-4e98-bf55-d3fc76e5e9df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:09.380128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-80194a52-e9ad-4e98-bf55-d3fc76e5e9df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.332824 Mar 08 04:21:09.392435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 138/262] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:09 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:09.474192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2d787d66-9510-41e3-bc3b-9b8ebb0f0601 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:09.487053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2d787d66-9510-41e3-bc3b-9b8ebb0f0601 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1504 microversion: 2.1 time: 0.283645 Mar 08 04:21:09.488408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 125/263] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:09 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:09.799038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-486dc29f-6c7d-4cd4-b287-db54beafc703 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:09.799872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-486dc29f-6c7d-4cd4-b287-db54beafc703 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:09.805732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-486dc29f-6c7d-4cd4-b287-db54beafc703 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.806296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-486dc29f-6c7d-4cd4-b287-db54beafc703 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:09.807077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-486dc29f-6c7d-4cd4-b287-db54beafc703 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.807507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-486dc29f-6c7d-4cd4-b287-db54beafc703 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:09.818194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f7a0c444-5e2d-434e-8b6d-6767ce04657e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:09.819213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f7a0c444-5e2d-434e-8b6d-6767ce04657e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:09.828664 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7a0c444-5e2d-434e-8b6d-6767ce04657e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.829768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7a0c444-5e2d-434e-8b6d-6767ce04657e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:09.830737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7a0c444-5e2d-434e-8b6d-6767ce04657e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:09.831158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7a0c444-5e2d-434e-8b6d-6767ce04657e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.020045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-486dc29f-6c7d-4cd4-b287-db54beafc703 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:10.027596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-486dc29f-6c7d-4cd4-b287-db54beafc703 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.232395 Mar 08 04:21:10.038366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 139/264] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:10.038366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-4763b958-11b6-4b82-8de0-b19cca1e078d req-b32058fe-9a42-4ee1-bf9b-73f32eacdcaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5482da2d-a290-4a63-a09f-583238ed6c8b", "tag": "a5291667-857d-4950-9ea1-dd103057d8b9"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:10.041635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f7a0c444-5e2d-434e-8b6d-6767ce04657e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:10.041988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-4763b958-11b6-4b82-8de0-b19cca1e078d req-b32058fe-9a42-4ee1-bf9b-73f32eacdcaa service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.042495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-4763b958-11b6-4b82-8de0-b19cca1e078d req-b32058fe-9a42-4ee1-bf9b-73f32eacdcaa service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.050016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f7a0c444-5e2d-434e-8b6d-6767ce04657e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1315 microversion: 2.1 time: 0.237861 Mar 08 04:21:10.050792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 126/265] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:09 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:10.054316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-4763b958-11b6-4b82-8de0-b19cca1e078d req-b32058fe-9a42-4ee1-bf9b-73f32eacdcaa service nova] Creating event network-changed:a5291667-857d-4950-9ea1-dd103057d8b9 for instance 5482da2d-a290-4a63-a09f-583238ed6c8b on hv-cinder-73306 Mar 08 04:21:10.060869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-4763b958-11b6-4b82-8de0-b19cca1e078d req-b32058fe-9a42-4ee1-bf9b-73f32eacdcaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031132 Mar 08 04:21:10.061561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 140/266] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:10.065899 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cfc732e9-9355-420e-980e-4955d4cf3ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:10.066572 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cfc732e9-9355-420e-980e-4955d4cf3ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:10.072388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cfc732e9-9355-420e-980e-4955d4cf3ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.072837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cfc732e9-9355-420e-980e-4955d4cf3ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.073637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cfc732e9-9355-420e-980e-4955d4cf3ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.074095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cfc732e9-9355-420e-980e-4955d4cf3ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.208786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cfc732e9-9355-420e-980e-4955d4cf3ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:10.217718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cfc732e9-9355-420e-980e-4955d4cf3ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1502 microversion: 2.1 time: 0.156340 Mar 08 04:21:10.218340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 127/267] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:10.236282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3b4b5448-55f9-4528-98ba-0bf41debdcbf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ff58b47-a7ea-4f70-ba5a-638056a1ee34"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:10.237528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3b4b5448-55f9-4528-98ba-0bf41debdcbf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:10.243580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b4b5448-55f9-4528-98ba-0bf41debdcbf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.244616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b4b5448-55f9-4528-98ba-0bf41debdcbf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.245478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b4b5448-55f9-4528-98ba-0bf41debdcbf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.246000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b4b5448-55f9-4528-98ba-0bf41debdcbf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.270049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-3b4b5448-55f9-4528-98ba-0bf41debdcbf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] HTTP exception thrown: Cannot 'attach_volume' instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 while it is in vm_state rescued Mar 08 04:21:10.270746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3b4b5448-55f9-4528-98ba-0bf41debdcbf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Returning 409 to user: Cannot 'attach_volume' instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 while it is in vm_state rescued {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:21:10.271655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3b4b5448-55f9-4528-98ba-0bf41debdcbf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040872 Mar 08 04:21:10.272213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 141/268] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:21:10 2022] POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 08 04:21:10.280773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-066aa86e-aafc-4f47-83a4-581f47ddbb23 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:10.281306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-066aa86e-aafc-4f47-83a4-581f47ddbb23 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:10.288214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-066aa86e-aafc-4f47-83a4-581f47ddbb23 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.288671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-066aa86e-aafc-4f47-83a4-581f47ddbb23 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.289438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-066aa86e-aafc-4f47-83a4-581f47ddbb23 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.289905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-066aa86e-aafc-4f47-83a4-581f47ddbb23 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.370689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-066aa86e-aafc-4f47-83a4-581f47ddbb23 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action" status: 202 len: 0 microversion: 2.1 time: 0.093587 Mar 08 04:21:10.374466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 128/269] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:21:10 2022] POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:21:10.380250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bfb00a98-0632-4d20-b78b-178011cf80c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:10.380860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bfb00a98-0632-4d20-b78b-178011cf80c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:10.386999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfb00a98-0632-4d20-b78b-178011cf80c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.387449 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfb00a98-0632-4d20-b78b-178011cf80c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.388230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfb00a98-0632-4d20-b78b-178011cf80c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.388667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfb00a98-0632-4d20-b78b-178011cf80c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.398272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-74e41764-c085-43dd-bf36-073e1de196f4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:10.399290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-74e41764-c085-43dd-bf36-073e1de196f4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:10.411575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74e41764-c085-43dd-bf36-073e1de196f4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.412564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74e41764-c085-43dd-bf36-073e1de196f4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.413399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74e41764-c085-43dd-bf36-073e1de196f4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.413719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74e41764-c085-43dd-bf36-073e1de196f4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.590506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bfb00a98-0632-4d20-b78b-178011cf80c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:10.599566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bfb00a98-0632-4d20-b78b-178011cf80c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1510 microversion: 2.1 time: 0.223382 Mar 08 04:21:10.600608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 142/270] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:10.606120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b6306127-4b9d-4159-a045-7cde5a93e23e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:10.606940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b6306127-4b9d-4159-a045-7cde5a93e23e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:10.615071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6306127-4b9d-4159-a045-7cde5a93e23e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.615759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6306127-4b9d-4159-a045-7cde5a93e23e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.615894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-74e41764-c085-43dd-bf36-073e1de196f4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:10.616774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6306127-4b9d-4159-a045-7cde5a93e23e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:10.617273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6306127-4b9d-4159-a045-7cde5a93e23e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:10.626449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-74e41764-c085-43dd-bf36-073e1de196f4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.231987 Mar 08 04:21:10.627024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 129/271] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:10 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:10.755591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b6306127-4b9d-4159-a045-7cde5a93e23e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:10.763264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b6306127-4b9d-4159-a045-7cde5a93e23e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1504 microversion: 2.1 time: 0.161836 Mar 08 04:21:10.763982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 143/272] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:10 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:11.045954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0509c187-8092-4f38-982f-3ab085f6da0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:11.046500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0509c187-8092-4f38-982f-3ab085f6da0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:11.052830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0509c187-8092-4f38-982f-3ab085f6da0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.053303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0509c187-8092-4f38-982f-3ab085f6da0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.054124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0509c187-8092-4f38-982f-3ab085f6da0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.054566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0509c187-8092-4f38-982f-3ab085f6da0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.066913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4154f449-71d7-486d-b254-4db9e88d4809 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:11.067522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4154f449-71d7-486d-b254-4db9e88d4809 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:11.073762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4154f449-71d7-486d-b254-4db9e88d4809 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.074451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4154f449-71d7-486d-b254-4db9e88d4809 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.075413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4154f449-71d7-486d-b254-4db9e88d4809 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.076367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4154f449-71d7-486d-b254-4db9e88d4809 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.270053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0509c187-8092-4f38-982f-3ab085f6da0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:11.276594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4154f449-71d7-486d-b254-4db9e88d4809 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:11.284810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4154f449-71d7-486d-b254-4db9e88d4809 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1315 microversion: 2.1 time: 0.221681 Mar 08 04:21:11.285613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 144/273] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:11 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:11.294103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0509c187-8092-4f38-982f-3ab085f6da0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.246479 Mar 08 04:21:11.294103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 130/274] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:11 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:11.617113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57a72e3a-ebae-4858-8188-9bec68d91bdb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:11.617760 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-57a72e3a-ebae-4858-8188-9bec68d91bdb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:11.623639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57a72e3a-ebae-4858-8188-9bec68d91bdb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.624089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57a72e3a-ebae-4858-8188-9bec68d91bdb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.624857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57a72e3a-ebae-4858-8188-9bec68d91bdb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.625293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57a72e3a-ebae-4858-8188-9bec68d91bdb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.644766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c78cce32-1575-4425-8a6c-893e05813dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:11.645370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c78cce32-1575-4425-8a6c-893e05813dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:11.651752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c78cce32-1575-4425-8a6c-893e05813dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.652196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c78cce32-1575-4425-8a6c-893e05813dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.653121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c78cce32-1575-4425-8a6c-893e05813dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.653555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c78cce32-1575-4425-8a6c-893e05813dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.843736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-57a72e3a-ebae-4858-8188-9bec68d91bdb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:11.852117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-57a72e3a-ebae-4858-8188-9bec68d91bdb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1510 microversion: 2.1 time: 0.238876 Mar 08 04:21:11.863407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 131/275] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:11.868266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ea65893d-3a97-4120-a586-d6ed3bfaf95e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:11.868899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c78cce32-1575-4425-8a6c-893e05813dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:11.869251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ea65893d-3a97-4120-a586-d6ed3bfaf95e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:11.875615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea65893d-3a97-4120-a586-d6ed3bfaf95e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.876601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea65893d-3a97-4120-a586-d6ed3bfaf95e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.877555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea65893d-3a97-4120-a586-d6ed3bfaf95e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:11.878033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea65893d-3a97-4120-a586-d6ed3bfaf95e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:11.880386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c78cce32-1575-4425-8a6c-893e05813dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.240729 Mar 08 04:21:11.881093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 145/276] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:11.886874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1483795436", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "551fbd03-e272-4e1c-ae72-e8d5eda5763a"}], "security_groups": [{"name": "tempest-securitygroup--1520096638"}], "key_name": "tempest-keypair-82282902", "user_data": "}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:11.996221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.network.neutron [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] validate_networks() for [('551fbd03-e272-4e1c-ae72-e8d5eda5763a', None, None, None, None, None)] {{(pid=116775) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:21:12.113520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ea65893d-3a97-4120-a586-d6ed3bfaf95e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:12.120827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ea65893d-3a97-4120-a586-d6ed3bfaf95e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1504 microversion: 2.1 time: 0.256313 Mar 08 04:21:12.121461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 132/277] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:11 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:12.303523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-30e2a6b1-5b47-40ef-9afc-7dce1eea945b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:12.304447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-30e2a6b1-5b47-40ef-9afc-7dce1eea945b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:12.310913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30e2a6b1-5b47-40ef-9afc-7dce1eea945b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.311598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30e2a6b1-5b47-40ef-9afc-7dce1eea945b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.312596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30e2a6b1-5b47-40ef-9afc-7dce1eea945b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.313557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30e2a6b1-5b47-40ef-9afc-7dce1eea945b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.449567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Flavor limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:21:12.450132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Image limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:21:12.450549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Flavor pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:21:12.450954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Image pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:21:12.451357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:21:12.460743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.461494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.462633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.463567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.487089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:21:12.493616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:21:12.507228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Going to run 1 instances... {{(pid=116775) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:21:12.509904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:21:12.561253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7b72b38f-9e7d-46af-9769-541872658619 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678628 Mar 08 04:21:12.564077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 146/278] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:21:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:21:12.572514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-770b0d6f-fa52-4d7f-851f-704c9a718fb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:12.574097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-770b0d6f-fa52-4d7f-851f-704c9a718fb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:12.584058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-770b0d6f-fa52-4d7f-851f-704c9a718fb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.584774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-770b0d6f-fa52-4d7f-851f-704c9a718fb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.585714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-770b0d6f-fa52-4d7f-851f-704c9a718fb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.586187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-770b0d6f-fa52-4d7f-851f-704c9a718fb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.747967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-30e2a6b1-5b47-40ef-9afc-7dce1eea945b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:12.765616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-30e2a6b1-5b47-40ef-9afc-7dce1eea945b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1315 microversion: 2.1 time: 0.467452 Mar 08 04:21:12.768105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 133/279] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:12 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:12.775826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a530db1d-cf88-430a-8928-4f5e8dd3b7af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:12.776433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a530db1d-cf88-430a-8928-4f5e8dd3b7af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:12.864226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a530db1d-cf88-430a-8928-4f5e8dd3b7af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:12.868228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-770b0d6f-fa52-4d7f-851f-704c9a718fb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:12.884415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a530db1d-cf88-430a-8928-4f5e8dd3b7af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1240 microversion: 2.1 time: 0.115275 Mar 08 04:21:12.885031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 134/280] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:12 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1240 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:12.895014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-770b0d6f-fa52-4d7f-851f-704c9a718fb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.314240 Mar 08 04:21:12.895846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 147/281] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:12 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:12.901238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d400c93c-87f2-4caf-9627-4b9a242a6e11 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:12.902129 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d400c93c-87f2-4caf-9627-4b9a242a6e11 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:12.904136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-474f7e04-ecf9-48f1-ae6f-3b4ea3af8a7a req-6c11f698-3064-4bd2-9aa3-5a225d5a1f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59f2363-5bf8-4f46-972a-4e16d0e4bbd1", "name": "network-vif-deleted", "tag": "43c1641b-04c0-4d4b-b349-9375016443ef"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:12.910289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d400c93c-87f2-4caf-9627-4b9a242a6e11 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.910987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d400c93c-87f2-4caf-9627-4b9a242a6e11 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.911863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d400c93c-87f2-4caf-9627-4b9a242a6e11 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.912664 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d400c93c-87f2-4caf-9627-4b9a242a6e11 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.916420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-474f7e04-ecf9-48f1-ae6f-3b4ea3af8a7a req-6c11f698-3064-4bd2-9aa3-5a225d5a1f45 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.916841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-474f7e04-ecf9-48f1-ae6f-3b4ea3af8a7a req-6c11f698-3064-4bd2-9aa3-5a225d5a1f45 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.928955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-474f7e04-ecf9-48f1-ae6f-3b4ea3af8a7a req-6c11f698-3064-4bd2-9aa3-5a225d5a1f45 service nova] Creating event network-vif-deleted:43c1641b-04c0-4d4b-b349-9375016443ef for instance f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 on hv-cinder-73306 Mar 08 04:21:12.934398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-474f7e04-ecf9-48f1-ae6f-3b4ea3af8a7a req-6c11f698-3064-4bd2-9aa3-5a225d5a1f45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038102 Mar 08 04:21:12.935417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 135/282] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:12.943644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5dcf3913-a711-4823-abd2-8a737d4f6eac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:12.944518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5dcf3913-a711-4823-abd2-8a737d4f6eac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:12.950758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dcf3913-a711-4823-abd2-8a737d4f6eac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.951209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dcf3913-a711-4823-abd2-8a737d4f6eac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:12.952140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dcf3913-a711-4823-abd2-8a737d4f6eac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:12.952581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dcf3913-a711-4823-abd2-8a737d4f6eac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.119457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d400c93c-87f2-4caf-9627-4b9a242a6e11 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:13.127378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d400c93c-87f2-4caf-9627-4b9a242a6e11 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1510 microversion: 2.1 time: 0.230384 Mar 08 04:21:13.128147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 148/283] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:13.140514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:13.141747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:13.142761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5dcf3913-a711-4823-abd2-8a737d4f6eac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:13.148064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:13.148541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.149335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:13.150057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.150778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5dcf3913-a711-4823-abd2-8a737d4f6eac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.213620 Mar 08 04:21:13.151356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 136/284] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:13.183205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:13.183654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.184110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lazy-loading 'fault' on Instance uuid f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:21:13.233748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:13.242324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-01f7569f-b052-415b-96cd-89bb048d9392 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 200 len: 1304 microversion: 2.1 time: 0.108116 Mar 08 04:21:13.242984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 149/285] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:13 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:13.507242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-13d586d9-d5ec-4ecd-b909-18939286061c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9686a24-607e-464a-a065-6dc9bee25c5c", "device": "/dev/sdb"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:13.508827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-13d586d9-d5ec-4ecd-b909-18939286061c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:13.515064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13d586d9-d5ec-4ecd-b909-18939286061c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:13.515500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13d586d9-d5ec-4ecd-b909-18939286061c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.516400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13d586d9-d5ec-4ecd-b909-18939286061c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:13.516835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13d586d9-d5ec-4ecd-b909-18939286061c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.786427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6ede7a6f-3e8f-4629-8835-08cd116c9054 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:13.786718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6ede7a6f-3e8f-4629-8835-08cd116c9054 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:13.803536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ede7a6f-3e8f-4629-8835-08cd116c9054 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:13.804482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ede7a6f-3e8f-4629-8835-08cd116c9054 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.806111 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ede7a6f-3e8f-4629-8835-08cd116c9054 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:13.806951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ede7a6f-3e8f-4629-8835-08cd116c9054 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.837239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-13d586d9-d5ec-4ecd-b909-18939286061c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "POST /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333224 Mar 08 04:21:13.843202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 137/286] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:21:13 2022] POST /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:13.902821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-889a1580-8dc8-4d7b-8c76-de7f716042bc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:13.905160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-889a1580-8dc8-4d7b-8c76-de7f716042bc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:13.913414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-889a1580-8dc8-4d7b-8c76-de7f716042bc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:13.914029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-889a1580-8dc8-4d7b-8c76-de7f716042bc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.914897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-889a1580-8dc8-4d7b-8c76-de7f716042bc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:13.915411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-889a1580-8dc8-4d7b-8c76-de7f716042bc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:13.994051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-889a1580-8dc8-4d7b-8c76-de7f716042bc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:14.002090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-889a1580-8dc8-4d7b-8c76-de7f716042bc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1298 microversion: 2.1 time: 0.103803 Mar 08 04:21:14.002799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 138/287] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:13 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:14.007782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9d7f3842-15e2-44ef-9a14-fee4f5f94fc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:14.009619 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9d7f3842-15e2-44ef-9a14-fee4f5f94fc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:14.018566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d7f3842-15e2-44ef-9a14-fee4f5f94fc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:14.019131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d7f3842-15e2-44ef-9a14-fee4f5f94fc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:14.021256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d7f3842-15e2-44ef-9a14-fee4f5f94fc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:14.021959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d7f3842-15e2-44ef-9a14-fee4f5f94fc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:14.028792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6ede7a6f-3e8f-4629-8835-08cd116c9054 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:14.038339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6ede7a6f-3e8f-4629-8835-08cd116c9054 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1315 microversion: 2.1 time: 0.257884 Mar 08 04:21:14.039578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 150/288] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:13 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:14.145070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-eafb91ac-c4d5-4272-bd3c-efe45b91743b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:14.145696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eafb91ac-c4d5-4272-bd3c-efe45b91743b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:14.153075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eafb91ac-c4d5-4272-bd3c-efe45b91743b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:14.153572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eafb91ac-c4d5-4272-bd3c-efe45b91743b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:14.154361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eafb91ac-c4d5-4272-bd3c-efe45b91743b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:14.154795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eafb91ac-c4d5-4272-bd3c-efe45b91743b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:14.209353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9d7f3842-15e2-44ef-9a14-fee4f5f94fc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:14.219055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9d7f3842-15e2-44ef-9a14-fee4f5f94fc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.214923 Mar 08 04:21:14.220276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 139/289] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:14 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:14.225258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f63200af-f897-4142-aeab-4a030e47dcf8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:14.226066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f63200af-f897-4142-aeab-4a030e47dcf8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:14.231847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f63200af-f897-4142-aeab-4a030e47dcf8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:14.232354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f63200af-f897-4142-aeab-4a030e47dcf8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:14.233113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f63200af-f897-4142-aeab-4a030e47dcf8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:14.233555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f63200af-f897-4142-aeab-4a030e47dcf8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:14.359629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-eafb91ac-c4d5-4272-bd3c-efe45b91743b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:14.368038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eafb91ac-c4d5-4272-bd3c-efe45b91743b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1516 microversion: 2.1 time: 0.227163 Mar 08 04:21:14.372561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 151/290] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:14.377164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-250d8245-7fe9-4762-bde4-45093a3833a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:14.378020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-250d8245-7fe9-4762-bde4-45093a3833a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: f59f2363-5bf8-4f46-972a-4e16d0e4bbd1] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:14.385721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-250d8245-7fe9-4762-bde4-45093a3833a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:14.386259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-250d8245-7fe9-4762-bde4-45093a3833a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:14.387341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-250d8245-7fe9-4762-bde4-45093a3833a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:14.388017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-250d8245-7fe9-4762-bde4-45093a3833a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:14.404346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-250d8245-7fe9-4762-bde4-45093a3833a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] HTTP exception thrown: Instance f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 could not be found. Mar 08 04:21:14.405020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-250d8245-7fe9-4762-bde4-45093a3833a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Returning 404 to user: Instance f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:21:14.406064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-250d8245-7fe9-4762-bde4-45093a3833a1 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1" status: 404 len: 111 microversion: 2.1 time: 0.034480 Mar 08 04:21:14.417683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 152/291] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:14 2022] GET /compute/v2.1/servers/f59f2363-5bf8-4f46-972a-4e16d0e4bbd1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:21:14.444571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f63200af-f897-4142-aeab-4a030e47dcf8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:14.456140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f63200af-f897-4142-aeab-4a030e47dcf8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.234656 Mar 08 04:21:14.458690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 140/292] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:14.534565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1281207187", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "networks": [{"uuid": "dba40b89-9401-401c-ab98-b3081100c82f"}]}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:14.598286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.network.neutron [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] validate_networks() for [('dba40b89-9401-401c-ab98-b3081100c82f', None, None, None, None, None)] {{(pid=116775) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:21:15.006008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Flavor limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:21:15.006449 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Image limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:21:15.006911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Flavor pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:21:15.007311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Image pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:21:15.007712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:21:15.016343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.016985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.018008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.018446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.019422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f762ab45-4010-4856-88c0-b4b65cbf9003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:15.020030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f762ab45-4010-4856-88c0-b4b65cbf9003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:15.026800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f762ab45-4010-4856-88c0-b4b65cbf9003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.027280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f762ab45-4010-4856-88c0-b4b65cbf9003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.028225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f762ab45-4010-4856-88c0-b4b65cbf9003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.028818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f762ab45-4010-4856-88c0-b4b65cbf9003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.035541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Getting quotas for project 21a2431c1a3a402f93d42ece33c568eb. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:21:15.039395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Getting quotas for user f56858073f1f4a9ab49f3833c2bf77e0 and project 21a2431c1a3a402f93d42ece33c568eb. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:21:15.052044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Going to run 1 instances... {{(pid=116775) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:21:15.054211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:21:15.103377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-528d2805-f04f-44a2-b303-46de85fdf85b tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573128 Mar 08 04:21:15.103987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 153/293] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:21:15.109448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1e10e609-cbe8-4b3c-b0d3-6046865b495b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:15.110127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1e10e609-cbe8-4b3c-b0d3-6046865b495b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:15.116485 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e10e609-cbe8-4b3c-b0d3-6046865b495b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.116929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e10e609-cbe8-4b3c-b0d3-6046865b495b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.117901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e10e609-cbe8-4b3c-b0d3-6046865b495b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.118475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e10e609-cbe8-4b3c-b0d3-6046865b495b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.243063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f762ab45-4010-4856-88c0-b4b65cbf9003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:15.263648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f762ab45-4010-4856-88c0-b4b65cbf9003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.247917 Mar 08 04:21:15.273468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 141/294] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:15 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:15.288973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-669aa043-991f-45af-a28b-8984ebc4215a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:15.289943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-669aa043-991f-45af-a28b-8984ebc4215a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:15.333576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1e10e609-cbe8-4b3c-b0d3-6046865b495b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:15.348517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1e10e609-cbe8-4b3c-b0d3-6046865b495b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1315 microversion: 2.1 time: 0.243107 Mar 08 04:21:15.349559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 154/295] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:15 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:15.366483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-72d88d37-d13f-4e57-b5a4-9d7cfbdcff27 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:15.367929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-72d88d37-d13f-4e57-b5a4-9d7cfbdcff27 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:15.375274 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72d88d37-d13f-4e57-b5a4-9d7cfbdcff27 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.376075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72d88d37-d13f-4e57-b5a4-9d7cfbdcff27 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.377237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72d88d37-d13f-4e57-b5a4-9d7cfbdcff27 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.377909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72d88d37-d13f-4e57-b5a4-9d7cfbdcff27 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.382420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-669aa043-991f-45af-a28b-8984ebc4215a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:15.389764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-669aa043-991f-45af-a28b-8984ebc4215a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1214 microversion: 2.1 time: 0.114765 Mar 08 04:21:15.390472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 142/296] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:15 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:15.467198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-775c521c-362c-4f11-be5c-205a53de2390 req-7a6ab364-f482-4755-a79d-2d2a2a76c087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c4a684-9cf2-4913-8f00-3833940f7184", "tag": "efdaa5ea-6b22-4b8e-b80a-61fc6f368338"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:15.485338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-775c521c-362c-4f11-be5c-205a53de2390 req-7a6ab364-f482-4755-a79d-2d2a2a76c087 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.486079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-775c521c-362c-4f11-be5c-205a53de2390 req-7a6ab364-f482-4755-a79d-2d2a2a76c087 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.499501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-775c521c-362c-4f11-be5c-205a53de2390 req-7a6ab364-f482-4755-a79d-2d2a2a76c087 service nova] Creating event network-changed:efdaa5ea-6b22-4b8e-b80a-61fc6f368338 for instance 46c4a684-9cf2-4913-8f00-3833940f7184 on hv-cinder-73306 Mar 08 04:21:15.506263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-775c521c-362c-4f11-be5c-205a53de2390 req-7a6ab364-f482-4755-a79d-2d2a2a76c087 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042672 Mar 08 04:21:15.507279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 143/297] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:21:15.513841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e02bbbe4-471a-4e56-9e76-0fbc19e46c2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:15.514585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e02bbbe4-471a-4e56-9e76-0fbc19e46c2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:15.521470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e02bbbe4-471a-4e56-9e76-0fbc19e46c2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.522190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e02bbbe4-471a-4e56-9e76-0fbc19e46c2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.523123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e02bbbe4-471a-4e56-9e76-0fbc19e46c2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.523785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e02bbbe4-471a-4e56-9e76-0fbc19e46c2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.596158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-72d88d37-d13f-4e57-b5a4-9d7cfbdcff27 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:15.608649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-72d88d37-d13f-4e57-b5a4-9d7cfbdcff27 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.257810 Mar 08 04:21:15.609376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 155/298] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:15 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:15.734615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e02bbbe4-471a-4e56-9e76-0fbc19e46c2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:15.748697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e02bbbe4-471a-4e56-9e76-0fbc19e46c2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.240087 Mar 08 04:21:15.759856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 144/299] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:15 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:15.835485 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0b6047be-5e11-4880-8767-fcaf95b619c0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:15.836170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0b6047be-5e11-4880-8767-fcaf95b619c0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:15.842870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b6047be-5e11-4880-8767-fcaf95b619c0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.843538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b6047be-5e11-4880-8767-fcaf95b619c0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.844536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b6047be-5e11-4880-8767-fcaf95b619c0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.845366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b6047be-5e11-4880-8767-fcaf95b619c0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.884581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-3afdb1e3-57ea-40d0-8772-13e4473478f7 req-ecd10203-181c-47c3-9c95-a633733d193f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5482da2d-a290-4a63-a09f-583238ed6c8b", "name": "network-vif-plugged", "status": "completed", "tag": "a5291667-857d-4950-9ea1-dd103057d8b9"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:15.901481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-3afdb1e3-57ea-40d0-8772-13e4473478f7 req-ecd10203-181c-47c3-9c95-a633733d193f service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:15.902352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-3afdb1e3-57ea-40d0-8772-13e4473478f7 req-ecd10203-181c-47c3-9c95-a633733d193f service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:15.943375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-3afdb1e3-57ea-40d0-8772-13e4473478f7 req-ecd10203-181c-47c3-9c95-a633733d193f service nova] Creating event network-vif-plugged:a5291667-857d-4950-9ea1-dd103057d8b9 for instance 5482da2d-a290-4a63-a09f-583238ed6c8b on hv-cinder-73306 Mar 08 04:21:15.968015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-3afdb1e3-57ea-40d0-8772-13e4473478f7 req-ecd10203-181c-47c3-9c95-a633733d193f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087043 Mar 08 04:21:15.968990 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 145/300] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:21:16.068257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0b6047be-5e11-4880-8767-fcaf95b619c0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:16.076633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0b6047be-5e11-4880-8767-fcaf95b619c0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1516 microversion: 2.1 time: 0.245431 Mar 08 04:21:16.088800 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 156/301] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:16.097813 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-60cde3a3-a559-42db-a414-2fe8363b530f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0d3412e-507c-447c-9df9-95f37e221809"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:16.098998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-60cde3a3-a559-42db-a414-2fe8363b530f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:16.105905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60cde3a3-a559-42db-a414-2fe8363b530f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.106720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60cde3a3-a559-42db-a414-2fe8363b530f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.107739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60cde3a3-a559-42db-a414-2fe8363b530f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.108226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60cde3a3-a559-42db-a414-2fe8363b530f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.280235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-72b1c329-f08a-40a8-8cc2-a2305a297959 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:16.280836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-72b1c329-f08a-40a8-8cc2-a2305a297959 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:16.287877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72b1c329-f08a-40a8-8cc2-a2305a297959 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.288520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72b1c329-f08a-40a8-8cc2-a2305a297959 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.289377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72b1c329-f08a-40a8-8cc2-a2305a297959 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.289850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72b1c329-f08a-40a8-8cc2-a2305a297959 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.368172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-60cde3a3-a559-42db-a414-2fe8363b530f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277356 Mar 08 04:21:16.369403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 146/302] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:21:16 2022] POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:21:16.378393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4183a3c5-6588-472c-b3f0-f0d499db156f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:16.379261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4183a3c5-6588-472c-b3f0-f0d499db156f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:16.398056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4183a3c5-6588-472c-b3f0-f0d499db156f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.398599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4183a3c5-6588-472c-b3f0-f0d499db156f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.399647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4183a3c5-6588-472c-b3f0-f0d499db156f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.400185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4183a3c5-6588-472c-b3f0-f0d499db156f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.462812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-72b1c329-f08a-40a8-8cc2-a2305a297959 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:16.470103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-72b1c329-f08a-40a8-8cc2-a2305a297959 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.193586 Mar 08 04:21:16.470667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 157/303] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:16 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:16.475133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bdfc5f4f-ac34-494c-a68b-ab533397a545 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:16.475744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bdfc5f4f-ac34-494c-a68b-ab533397a545 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:16.481419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bdfc5f4f-ac34-494c-a68b-ab533397a545 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.481967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bdfc5f4f-ac34-494c-a68b-ab533397a545 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.482801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bdfc5f4f-ac34-494c-a68b-ab533397a545 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.483237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bdfc5f4f-ac34-494c-a68b-ab533397a545 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.550789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bdfc5f4f-ac34-494c-a68b-ab533397a545 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:16.557787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bdfc5f4f-ac34-494c-a68b-ab533397a545 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1266 microversion: 2.1 time: 0.086163 Mar 08 04:21:16.558674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 158/304] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:16 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:16.576299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4183a3c5-6588-472c-b3f0-f0d499db156f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:16.584110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4183a3c5-6588-472c-b3f0-f0d499db156f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1315 microversion: 2.1 time: 0.213343 Mar 08 04:21:16.584670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 147/305] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:16 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:16.626832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-62eabe0a-0128-47de-b902-cfdc7b057ddc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:16.627437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-62eabe0a-0128-47de-b902-cfdc7b057ddc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:16.633754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62eabe0a-0128-47de-b902-cfdc7b057ddc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.634208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62eabe0a-0128-47de-b902-cfdc7b057ddc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.634983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62eabe0a-0128-47de-b902-cfdc7b057ddc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.635520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62eabe0a-0128-47de-b902-cfdc7b057ddc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.766726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2ddd35a4-4851-4563-840e-a0b5b18ced17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:16.767589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2ddd35a4-4851-4563-840e-a0b5b18ced17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:16.774014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ddd35a4-4851-4563-840e-a0b5b18ced17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.774647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ddd35a4-4851-4563-840e-a0b5b18ced17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.775807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ddd35a4-4851-4563-840e-a0b5b18ced17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:16.776405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ddd35a4-4851-4563-840e-a0b5b18ced17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:16.788786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-62eabe0a-0128-47de-b902-cfdc7b057ddc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:16.799008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-62eabe0a-0128-47de-b902-cfdc7b057ddc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.175736 Mar 08 04:21:16.799805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 159/306] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:16.942709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2ddd35a4-4851-4563-840e-a0b5b18ced17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:16.950526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2ddd35a4-4851-4563-840e-a0b5b18ced17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.187693 Mar 08 04:21:16.951343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 148/307] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:16 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:17.488228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0ba9fada-665a-4db2-b73f-6557ecec8e82 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:17.488930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0ba9fada-665a-4db2-b73f-6557ecec8e82 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:17.495718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba9fada-665a-4db2-b73f-6557ecec8e82 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.496390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba9fada-665a-4db2-b73f-6557ecec8e82 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:17.497167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba9fada-665a-4db2-b73f-6557ecec8e82 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.497603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba9fada-665a-4db2-b73f-6557ecec8e82 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:17.575601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-88b47e8f-b318-46d1-b36d-46f9e5b23cba tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:17.577964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-88b47e8f-b318-46d1-b36d-46f9e5b23cba tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:17.587398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88b47e8f-b318-46d1-b36d-46f9e5b23cba tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.588162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88b47e8f-b318-46d1-b36d-46f9e5b23cba tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:17.589119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88b47e8f-b318-46d1-b36d-46f9e5b23cba tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.589867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88b47e8f-b318-46d1-b36d-46f9e5b23cba tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:17.643977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0ba9fada-665a-4db2-b73f-6557ecec8e82 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:17.651345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0ba9fada-665a-4db2-b73f-6557ecec8e82 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.168312 Mar 08 04:21:17.657601 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 160/308] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:17 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:17.659950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-88b47e8f-b318-46d1-b36d-46f9e5b23cba tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:17.667722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-88b47e8f-b318-46d1-b36d-46f9e5b23cba tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1272 microversion: 2.1 time: 0.096138 Mar 08 04:21:17.677753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 149/309] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:17 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:17.678960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-193ab948-050b-4bcc-b9cc-01f60251033b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:17.679773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-193ab948-050b-4bcc-b9cc-01f60251033b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:17.685590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-193ab948-050b-4bcc-b9cc-01f60251033b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.686092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-193ab948-050b-4bcc-b9cc-01f60251033b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:17.686879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-193ab948-050b-4bcc-b9cc-01f60251033b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.687314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-193ab948-050b-4bcc-b9cc-01f60251033b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:17.817547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4ad06c3a-0311-4fcf-8271-b426e65b52cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:17.818433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4ad06c3a-0311-4fcf-8271-b426e65b52cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:17.825744 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ad06c3a-0311-4fcf-8271-b426e65b52cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.826565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ad06c3a-0311-4fcf-8271-b426e65b52cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:17.827678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ad06c3a-0311-4fcf-8271-b426e65b52cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.828524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ad06c3a-0311-4fcf-8271-b426e65b52cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:17.850330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-193ab948-050b-4bcc-b9cc-01f60251033b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:17.860178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-193ab948-050b-4bcc-b9cc-01f60251033b tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1315 microversion: 2.1 time: 0.200580 Mar 08 04:21:17.864539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 161/310] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:17 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:17.968450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3ed24027-d57e-4a62-b7b2-f1a44023502b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:17.969471 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3ed24027-d57e-4a62-b7b2-f1a44023502b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:17.975852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ed24027-d57e-4a62-b7b2-f1a44023502b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.976624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ed24027-d57e-4a62-b7b2-f1a44023502b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:17.977635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ed24027-d57e-4a62-b7b2-f1a44023502b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:17.978213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ed24027-d57e-4a62-b7b2-f1a44023502b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:18.065899 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4ad06c3a-0311-4fcf-8271-b426e65b52cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:18.073925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4ad06c3a-0311-4fcf-8271-b426e65b52cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.261081 Mar 08 04:21:18.083998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 150/311] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:17 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:18.160308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3ed24027-d57e-4a62-b7b2-f1a44023502b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:18.168197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3ed24027-d57e-4a62-b7b2-f1a44023502b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.204364 Mar 08 04:21:18.168764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 162/312] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:18.539400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-e985312a-77a1-4860-b86a-b84d8c7d2b43 req-06737595-641c-4220-b4ec-d6977d79cb81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15560a8a-764b-4343-b74b-089d0e4d91ce", "tag": "7b1b12a4-573a-477f-8465-6ab8d7873fb3"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:18.571246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-e985312a-77a1-4860-b86a-b84d8c7d2b43 req-06737595-641c-4220-b4ec-d6977d79cb81 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:18.571857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-e985312a-77a1-4860-b86a-b84d8c7d2b43 req-06737595-641c-4220-b4ec-d6977d79cb81 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:18.584593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-e985312a-77a1-4860-b86a-b84d8c7d2b43 req-06737595-641c-4220-b4ec-d6977d79cb81 service nova] Creating event network-changed:7b1b12a4-573a-477f-8465-6ab8d7873fb3 for instance 15560a8a-764b-4343-b74b-089d0e4d91ce on hv-cinder-73306 Mar 08 04:21:18.590670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-e985312a-77a1-4860-b86a-b84d8c7d2b43 req-06737595-641c-4220-b4ec-d6977d79cb81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063103 Mar 08 04:21:18.591397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 151/313] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:18.673905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dfb6fc77-c955-4416-98f5-79ad4c9a79a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:18.674508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dfb6fc77-c955-4416-98f5-79ad4c9a79a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:18.681013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc77-c955-4416-98f5-79ad4c9a79a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:18.681471 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc77-c955-4416-98f5-79ad4c9a79a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:18.682267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc77-c955-4416-98f5-79ad4c9a79a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:18.682704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc77-c955-4416-98f5-79ad4c9a79a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:18.685647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-05d06e07-a722-4178-8009-a2c8dd7155c5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:18.686373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-05d06e07-a722-4178-8009-a2c8dd7155c5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:18.692659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05d06e07-a722-4178-8009-a2c8dd7155c5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:18.693107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05d06e07-a722-4178-8009-a2c8dd7155c5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:18.693918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05d06e07-a722-4178-8009-a2c8dd7155c5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:18.694359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05d06e07-a722-4178-8009-a2c8dd7155c5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:18.885249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dfb6fc77-c955-4416-98f5-79ad4c9a79a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:18.893104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dfb6fc77-c955-4416-98f5-79ad4c9a79a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.223065 Mar 08 04:21:18.893698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 163/314] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:18 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:18.896641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-05d06e07-a722-4178-8009-a2c8dd7155c5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:18.899457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fdac063d-356b-4b97-b355-9202749188c1 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:18.900071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fdac063d-356b-4b97-b355-9202749188c1 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:18.905300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-05d06e07-a722-4178-8009-a2c8dd7155c5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.223714 Mar 08 04:21:18.905822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fdac063d-356b-4b97-b355-9202749188c1 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:18.906279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fdac063d-356b-4b97-b355-9202749188c1 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:18.907975 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fdac063d-356b-4b97-b355-9202749188c1 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:18.908416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fdac063d-356b-4b97-b355-9202749188c1 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:18.915464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 152/315] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:18 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:19.045836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fdac063d-356b-4b97-b355-9202749188c1 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:19.053779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fdac063d-356b-4b97-b355-9202749188c1 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1464 microversion: 2.1 time: 0.159090 Mar 08 04:21:19.054462 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 164/316] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:18 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:19.091225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-234e6b57-74fa-46a0-9159-354726cf0bd3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:19.091984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-234e6b57-74fa-46a0-9159-354726cf0bd3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:19.093539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-07f01fc0-0fcd-4e66-9927-d2234f420c07 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:19.094733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-07f01fc0-0fcd-4e66-9927-d2234f420c07 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:19.099124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-234e6b57-74fa-46a0-9159-354726cf0bd3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.099682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-234e6b57-74fa-46a0-9159-354726cf0bd3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.100694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-234e6b57-74fa-46a0-9159-354726cf0bd3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.100961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07f01fc0-0fcd-4e66-9927-d2234f420c07 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.101323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-234e6b57-74fa-46a0-9159-354726cf0bd3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.101423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07f01fc0-0fcd-4e66-9927-d2234f420c07 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.102213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07f01fc0-0fcd-4e66-9927-d2234f420c07 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.102652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07f01fc0-0fcd-4e66-9927-d2234f420c07 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.130002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-07f01fc0-0fcd-4e66-9927-d2234f420c07 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:21:19.215660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-07f01fc0-0fcd-4e66-9927-d2234f420c07 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 204 len: 0 microversion: 2.1 time: 0.125487 Mar 08 04:21:19.219578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 165/317] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:21:19 2022] DELETE /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 04:21:19.226504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-453500c8-560e-40d6-9fe4-725cf79a2083 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:19.227207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-453500c8-560e-40d6-9fe4-725cf79a2083 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:19.234170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-453500c8-560e-40d6-9fe4-725cf79a2083 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.235190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-453500c8-560e-40d6-9fe4-725cf79a2083 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.235983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-453500c8-560e-40d6-9fe4-725cf79a2083 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.236571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-453500c8-560e-40d6-9fe4-725cf79a2083 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.272402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-234e6b57-74fa-46a0-9159-354726cf0bd3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:19.283617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-234e6b57-74fa-46a0-9159-354726cf0bd3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.196346 Mar 08 04:21:19.284774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 153/318] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:19.289701 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f7ae9e39-0b51-4ed4-bd8f-b9cbce730906 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:19.290475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f7ae9e39-0b51-4ed4-bd8f-b9cbce730906 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:19.297560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7ae9e39-0b51-4ed4-bd8f-b9cbce730906 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.297772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7ae9e39-0b51-4ed4-bd8f-b9cbce730906 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.299102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7ae9e39-0b51-4ed4-bd8f-b9cbce730906 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.299572 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7ae9e39-0b51-4ed4-bd8f-b9cbce730906 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.428553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-453500c8-560e-40d6-9fe4-725cf79a2083 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:19.436523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-453500c8-560e-40d6-9fe4-725cf79a2083 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.215793 Mar 08 04:21:19.439847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 166/319] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:19 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:19.483037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f7ae9e39-0b51-4ed4-bd8f-b9cbce730906 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:19.490676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f7ae9e39-0b51-4ed4-bd8f-b9cbce730906 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1470 microversion: 2.1 time: 0.204764 Mar 08 04:21:19.491373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 154/320] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:19 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:19.910340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-67dc3913-7cf9-420f-8743-49bd49eefa8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:19.910991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-67dc3913-7cf9-420f-8743-49bd49eefa8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:19.917284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67dc3913-7cf9-420f-8743-49bd49eefa8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.917989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67dc3913-7cf9-420f-8743-49bd49eefa8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.918745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67dc3913-7cf9-420f-8743-49bd49eefa8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.919180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67dc3913-7cf9-420f-8743-49bd49eefa8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.924455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c46fd437-630f-4312-8ec9-a9c75b17c03d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:19.925181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c46fd437-630f-4312-8ec9-a9c75b17c03d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:19.932697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c46fd437-630f-4312-8ec9-a9c75b17c03d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.933396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c46fd437-630f-4312-8ec9-a9c75b17c03d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:19.934738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c46fd437-630f-4312-8ec9-a9c75b17c03d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:19.935402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c46fd437-630f-4312-8ec9-a9c75b17c03d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:20.122795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-67dc3913-7cf9-420f-8743-49bd49eefa8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:20.129521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c46fd437-630f-4312-8ec9-a9c75b17c03d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:20.131119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-67dc3913-7cf9-420f-8743-49bd49eefa8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.225282 Mar 08 04:21:20.131692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 167/321] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:19 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:20.136939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c46fd437-630f-4312-8ec9-a9c75b17c03d tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.217316 Mar 08 04:21:20.137487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 155/322] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:19 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:20.145182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-f8a807ca-48ea-4c33-bd3d-36adeb64b004 req-acd2caa9-734d-4578-9946-4328801a7379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4208bcea-e0a6-4c9d-956c-477a87d388ca", "name": "network-vif-plugged", "status": "completed", "tag": "5ed21f05-392d-4365-8c94-f119e23a8232"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:20.153064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-f8a807ca-48ea-4c33-bd3d-36adeb64b004 req-acd2caa9-734d-4578-9946-4328801a7379 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:20.153498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-f8a807ca-48ea-4c33-bd3d-36adeb64b004 req-acd2caa9-734d-4578-9946-4328801a7379 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:20.165242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-f8a807ca-48ea-4c33-bd3d-36adeb64b004 req-acd2caa9-734d-4578-9946-4328801a7379 service nova] Creating event network-vif-plugged:5ed21f05-392d-4365-8c94-f119e23a8232 for instance 4208bcea-e0a6-4c9d-956c-477a87d388ca on hv-cinder-73306 Mar 08 04:21:20.170889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-f8a807ca-48ea-4c33-bd3d-36adeb64b004 req-acd2caa9-734d-4578-9946-4328801a7379 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029223 Mar 08 04:21:20.171446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 168/323] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:20.300455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4e277e3a-1b2c-40ac-9f70-fbda0973e6a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:20.301059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4e277e3a-1b2c-40ac-9f70-fbda0973e6a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:20.306840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e277e3a-1b2c-40ac-9f70-fbda0973e6a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:20.307633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e277e3a-1b2c-40ac-9f70-fbda0973e6a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:20.308419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e277e3a-1b2c-40ac-9f70-fbda0973e6a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:20.308856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e277e3a-1b2c-40ac-9f70-fbda0973e6a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:20.452860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4e277e3a-1b2c-40ac-9f70-fbda0973e6a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:20.460584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-586b017e-3cbd-42d6-9945-e2c36a73e750 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:20.461674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-586b017e-3cbd-42d6-9945-e2c36a73e750 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:20.462747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4e277e3a-1b2c-40ac-9f70-fbda0973e6a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.165939 Mar 08 04:21:20.472780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 156/324] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:20 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:20.472957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-586b017e-3cbd-42d6-9945-e2c36a73e750 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:20.472957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-586b017e-3cbd-42d6-9945-e2c36a73e750 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:20.472957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-586b017e-3cbd-42d6-9945-e2c36a73e750 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:20.472957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-586b017e-3cbd-42d6-9945-e2c36a73e750 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:20.510127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a7f7bf58-973e-4023-a1fc-93140e64b016 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:20.511369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a7f7bf58-973e-4023-a1fc-93140e64b016 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:20.520260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7f7bf58-973e-4023-a1fc-93140e64b016 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:20.521458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7f7bf58-973e-4023-a1fc-93140e64b016 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:20.522344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7f7bf58-973e-4023-a1fc-93140e64b016 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:20.523345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7f7bf58-973e-4023-a1fc-93140e64b016 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:20.639921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-586b017e-3cbd-42d6-9945-e2c36a73e750 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:20.653701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-586b017e-3cbd-42d6-9945-e2c36a73e750 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.198830 Mar 08 04:21:20.661752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 169/325] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:20.696309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a7f7bf58-973e-4023-a1fc-93140e64b016 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:20.703847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a7f7bf58-973e-4023-a1fc-93140e64b016 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1470 microversion: 2.1 time: 0.199411 Mar 08 04:21:20.704510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 157/326] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:20 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:21.147746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-059ecc4c-9474-4339-a95d-dcd1b22df953 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:21.148355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-059ecc4c-9474-4339-a95d-dcd1b22df953 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:21.153486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cf08a35b-7dc7-43b4-bdcc-7c77da4963cd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:21.154114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cf08a35b-7dc7-43b4-bdcc-7c77da4963cd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:21.154831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-059ecc4c-9474-4339-a95d-dcd1b22df953 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.155276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-059ecc4c-9474-4339-a95d-dcd1b22df953 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.156071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-059ecc4c-9474-4339-a95d-dcd1b22df953 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.156555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-059ecc4c-9474-4339-a95d-dcd1b22df953 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.160908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf08a35b-7dc7-43b4-bdcc-7c77da4963cd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.161351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf08a35b-7dc7-43b4-bdcc-7c77da4963cd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.162139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf08a35b-7dc7-43b4-bdcc-7c77da4963cd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.162568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf08a35b-7dc7-43b4-bdcc-7c77da4963cd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.359043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-059ecc4c-9474-4339-a95d-dcd1b22df953 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:21.362741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cf08a35b-7dc7-43b4-bdcc-7c77da4963cd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:21.371280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-059ecc4c-9474-4339-a95d-dcd1b22df953 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.227201 Mar 08 04:21:21.381702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 170/327] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:21 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:21.382119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cf08a35b-7dc7-43b4-bdcc-7c77da4963cd tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.222970 Mar 08 04:21:21.382119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 158/328] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:21 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:21.480913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-71e44b26-8b50-42c7-82c1-ee06e6696eeb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:21.481555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-71e44b26-8b50-42c7-82c1-ee06e6696eeb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:21.488383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71e44b26-8b50-42c7-82c1-ee06e6696eeb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.488831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71e44b26-8b50-42c7-82c1-ee06e6696eeb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.489652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71e44b26-8b50-42c7-82c1-ee06e6696eeb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.490103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71e44b26-8b50-42c7-82c1-ee06e6696eeb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.658311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-71e44b26-8b50-42c7-82c1-ee06e6696eeb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:21.668276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-71e44b26-8b50-42c7-82c1-ee06e6696eeb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.191672 Mar 08 04:21:21.670216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 171/329] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:21 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:21.672696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-aecb67f6-51d0-4760-bd33-128243fbd2dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:21.673692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-aecb67f6-51d0-4760-bd33-128243fbd2dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:21.679548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aecb67f6-51d0-4760-bd33-128243fbd2dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.679993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aecb67f6-51d0-4760-bd33-128243fbd2dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.680832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aecb67f6-51d0-4760-bd33-128243fbd2dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.681210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aecb67f6-51d0-4760-bd33-128243fbd2dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.721569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-81b5613b-e328-4693-a62c-9a5a3d7673e9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:21.722227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-81b5613b-e328-4693-a62c-9a5a3d7673e9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:21.732954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81b5613b-e328-4693-a62c-9a5a3d7673e9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.732954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81b5613b-e328-4693-a62c-9a5a3d7673e9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.732954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81b5613b-e328-4693-a62c-9a5a3d7673e9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:21.733364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81b5613b-e328-4693-a62c-9a5a3d7673e9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:21.870779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-aecb67f6-51d0-4760-bd33-128243fbd2dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:21.878882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-aecb67f6-51d0-4760-bd33-128243fbd2dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.211351 Mar 08 04:21:21.888343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 159/330] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:21 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:21.949978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-81b5613b-e328-4693-a62c-9a5a3d7673e9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:21.958571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-81b5613b-e328-4693-a62c-9a5a3d7673e9 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1470 microversion: 2.1 time: 0.241520 Mar 08 04:21:21.959346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 172/331] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:21 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1470 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:22.076848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-1649c48c-f990-447d-a9c1-9e37993dcda4 req-6c854d27-7a30-47d7-9482-47c6b989c1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5482da2d-a290-4a63-a09f-583238ed6c8b", "name": "network-vif-deleted", "tag": "a5291667-857d-4950-9ea1-dd103057d8b9"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:22.086899 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-1649c48c-f990-447d-a9c1-9e37993dcda4 req-6c854d27-7a30-47d7-9482-47c6b989c1f8 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.087402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-1649c48c-f990-447d-a9c1-9e37993dcda4 req-6c854d27-7a30-47d7-9482-47c6b989c1f8 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.101794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-1649c48c-f990-447d-a9c1-9e37993dcda4 req-6c854d27-7a30-47d7-9482-47c6b989c1f8 service nova] Creating event network-vif-deleted:a5291667-857d-4950-9ea1-dd103057d8b9 for instance 5482da2d-a290-4a63-a09f-583238ed6c8b on hv-cinder-73306 Mar 08 04:21:22.107032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-1649c48c-f990-447d-a9c1-9e37993dcda4 req-6c854d27-7a30-47d7-9482-47c6b989c1f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033752 Mar 08 04:21:22.108249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 160/332] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:22.184597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-8a17c45a-2db7-4298-bdf7-ebdae2c2aa25 req-0fd09f87-d3cb-4e6d-b588-0c39b3fc2bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c4a684-9cf2-4913-8f00-3833940f7184", "name": "network-vif-plugged", "status": "completed", "tag": "efdaa5ea-6b22-4b8e-b80a-61fc6f368338"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:22.195003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-8a17c45a-2db7-4298-bdf7-ebdae2c2aa25 req-0fd09f87-d3cb-4e6d-b588-0c39b3fc2bf1 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.195532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-8a17c45a-2db7-4298-bdf7-ebdae2c2aa25 req-0fd09f87-d3cb-4e6d-b588-0c39b3fc2bf1 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.207105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-8a17c45a-2db7-4298-bdf7-ebdae2c2aa25 req-0fd09f87-d3cb-4e6d-b588-0c39b3fc2bf1 service nova] Creating event network-vif-plugged:efdaa5ea-6b22-4b8e-b80a-61fc6f368338 for instance 46c4a684-9cf2-4913-8f00-3833940f7184 on hv-cinder-73306 Mar 08 04:21:22.212105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-8a17c45a-2db7-4298-bdf7-ebdae2c2aa25 req-0fd09f87-d3cb-4e6d-b588-0c39b3fc2bf1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031087 Mar 08 04:21:22.212683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 173/333] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:22.391520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1ee91551-b5f2-44a3-811a-c35606f48ee3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:22.391716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f4783149-2707-432e-ab34-f740de1215a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:22.392240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1ee91551-b5f2-44a3-811a-c35606f48ee3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:22.392358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f4783149-2707-432e-ab34-f740de1215a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:22.398252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1ee91551-b5f2-44a3-811a-c35606f48ee3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.398700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1ee91551-b5f2-44a3-811a-c35606f48ee3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.399450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4783149-2707-432e-ab34-f740de1215a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.399569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1ee91551-b5f2-44a3-811a-c35606f48ee3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.399903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4783149-2707-432e-ab34-f740de1215a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.400019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1ee91551-b5f2-44a3-811a-c35606f48ee3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.400682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4783149-2707-432e-ab34-f740de1215a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.401108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4783149-2707-432e-ab34-f740de1215a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.598736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1ee91551-b5f2-44a3-811a-c35606f48ee3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:22.602692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f4783149-2707-432e-ab34-f740de1215a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:22.605978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1ee91551-b5f2-44a3-811a-c35606f48ee3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.219159 Mar 08 04:21:22.606573 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 174/334] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:22 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:22.609739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f4783149-2707-432e-ab34-f740de1215a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.223259 Mar 08 04:21:22.610291 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 161/335] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:22 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:22.686848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e2d45f2d-cdfc-489c-9305-daa553591030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:22.687454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e2d45f2d-cdfc-489c-9305-daa553591030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:22.693860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2d45f2d-cdfc-489c-9305-daa553591030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.694313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2d45f2d-cdfc-489c-9305-daa553591030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.695073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2d45f2d-cdfc-489c-9305-daa553591030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.695506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2d45f2d-cdfc-489c-9305-daa553591030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.834797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e2d45f2d-cdfc-489c-9305-daa553591030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:22.841946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e2d45f2d-cdfc-489c-9305-daa553591030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.159148 Mar 08 04:21:22.842501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 175/336] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:22 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:22.895322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-62ae2786-393a-40fc-8165-b809188a6231 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:22.895927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-62ae2786-393a-40fc-8165-b809188a6231 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:22.901653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-62ae2786-393a-40fc-8165-b809188a6231 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.902126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-62ae2786-393a-40fc-8165-b809188a6231 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.902885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-62ae2786-393a-40fc-8165-b809188a6231 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.903317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-62ae2786-393a-40fc-8165-b809188a6231 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.975542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a91c7b86-4dd5-42cc-ba11-3765e1dcd88f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:22.976050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a91c7b86-4dd5-42cc-ba11-3765e1dcd88f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:22.981790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a91c7b86-4dd5-42cc-ba11-3765e1dcd88f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.982233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a91c7b86-4dd5-42cc-ba11-3765e1dcd88f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:22.982978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a91c7b86-4dd5-42cc-ba11-3765e1dcd88f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:22.983407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a91c7b86-4dd5-42cc-ba11-3765e1dcd88f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:23.049643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a91c7b86-4dd5-42cc-ba11-3765e1dcd88f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:23.056692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-62ae2786-393a-40fc-8165-b809188a6231 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:23.056847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a91c7b86-4dd5-42cc-ba11-3765e1dcd88f tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1428 microversion: 2.1 time: 0.085161 Mar 08 04:21:23.057331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 176/337] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:22 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:23.065476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-62ae2786-393a-40fc-8165-b809188a6231 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.173914 Mar 08 04:21:23.066142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 162/338] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:23.622867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5c263ad7-4583-4ded-8aff-0a7aa7ebabb5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:23.623479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5c263ad7-4583-4ded-8aff-0a7aa7ebabb5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:23.626630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4a00bb49-e7ed-41a3-9a80-b8856b49f4ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:23.627241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4a00bb49-e7ed-41a3-9a80-b8856b49f4ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:23.630349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c263ad7-4583-4ded-8aff-0a7aa7ebabb5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:23.630795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c263ad7-4583-4ded-8aff-0a7aa7ebabb5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:23.631567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c263ad7-4583-4ded-8aff-0a7aa7ebabb5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:23.632003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c263ad7-4583-4ded-8aff-0a7aa7ebabb5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:23.633198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a00bb49-e7ed-41a3-9a80-b8856b49f4ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:23.633650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a00bb49-e7ed-41a3-9a80-b8856b49f4ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:23.634434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a00bb49-e7ed-41a3-9a80-b8856b49f4ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:23.634875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a00bb49-e7ed-41a3-9a80-b8856b49f4ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:23.825072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4a00bb49-e7ed-41a3-9a80-b8856b49f4ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:23.834485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4a00bb49-e7ed-41a3-9a80-b8856b49f4ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.212035 Mar 08 04:21:23.835317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 163/339] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:23 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:23.836676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5c263ad7-4583-4ded-8aff-0a7aa7ebabb5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:23.845114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5c263ad7-4583-4ded-8aff-0a7aa7ebabb5 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.225455 Mar 08 04:21:23.845858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 177/340] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:23 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:23.859250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-daeb3619-b98b-4b7f-9e61-ceab19f08187 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:23.859942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-daeb3619-b98b-4b7f-9e61-ceab19f08187 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:23.866044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-daeb3619-b98b-4b7f-9e61-ceab19f08187 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:23.866497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-daeb3619-b98b-4b7f-9e61-ceab19f08187 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:23.867276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-daeb3619-b98b-4b7f-9e61-ceab19f08187 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:23.867707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-daeb3619-b98b-4b7f-9e61-ceab19f08187 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:24.001460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-daeb3619-b98b-4b7f-9e61-ceab19f08187 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:24.008549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-daeb3619-b98b-4b7f-9e61-ceab19f08187 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1260 microversion: 2.1 time: 0.153023 Mar 08 04:21:24.009102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 164/341] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:24.074261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dba6a826-b8d6-4c12-8435-c1c2c0fef79e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:24.074895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dba6a826-b8d6-4c12-8435-c1c2c0fef79e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:24.081755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dba6a826-b8d6-4c12-8435-c1c2c0fef79e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:24.082203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dba6a826-b8d6-4c12-8435-c1c2c0fef79e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:24.082705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f27822d3-dee6-43ed-b6ac-8a56305988d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:24.082968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dba6a826-b8d6-4c12-8435-c1c2c0fef79e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:24.083304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f27822d3-dee6-43ed-b6ac-8a56305988d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:24.083439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dba6a826-b8d6-4c12-8435-c1c2c0fef79e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:24.089118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f27822d3-dee6-43ed-b6ac-8a56305988d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:24.089560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f27822d3-dee6-43ed-b6ac-8a56305988d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:24.090350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f27822d3-dee6-43ed-b6ac-8a56305988d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:24.090786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f27822d3-dee6-43ed-b6ac-8a56305988d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:24.147994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dba6a826-b8d6-4c12-8435-c1c2c0fef79e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:24.155228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dba6a826-b8d6-4c12-8435-c1c2c0fef79e tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1428 microversion: 2.1 time: 0.084731 Mar 08 04:21:24.155792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 178/342] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:24 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:24.232867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f27822d3-dee6-43ed-b6ac-8a56305988d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:24.240538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f27822d3-dee6-43ed-b6ac-8a56305988d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1723 microversion: 2.1 time: 0.162885 Mar 08 04:21:24.241095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 165/343] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:24.851860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-652770ef-6e12-4237-9c3e-f17cbd1648a0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:24.852619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-652770ef-6e12-4237-9c3e-f17cbd1648a0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:24.861608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-652770ef-6e12-4237-9c3e-f17cbd1648a0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:24.862092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-652770ef-6e12-4237-9c3e-f17cbd1648a0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:24.862240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c15d9c86-bcf6-44c4-b84d-367f4b1d01a7 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:24.862773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c15d9c86-bcf6-44c4-b84d-367f4b1d01a7 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:24.862884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-652770ef-6e12-4237-9c3e-f17cbd1648a0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:24.863298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-652770ef-6e12-4237-9c3e-f17cbd1648a0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:24.872394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c15d9c86-bcf6-44c4-b84d-367f4b1d01a7 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:24.872394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c15d9c86-bcf6-44c4-b84d-367f4b1d01a7 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:24.873177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c15d9c86-bcf6-44c4-b84d-367f4b1d01a7 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:24.873614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c15d9c86-bcf6-44c4-b84d-367f4b1d01a7 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.072560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-652770ef-6e12-4237-9c3e-f17cbd1648a0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:25.075201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c15d9c86-bcf6-44c4-b84d-367f4b1d01a7 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:25.080776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-652770ef-6e12-4237-9c3e-f17cbd1648a0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.233174 Mar 08 04:21:25.081350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 179/344] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:24 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:25.083757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c15d9c86-bcf6-44c4-b84d-367f4b1d01a7 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.226210 Mar 08 04:21:25.086328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ba9d6e02-75fc-4a0a-a82a-d1071ba92c93 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:25.087285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ba9d6e02-75fc-4a0a-a82a-d1071ba92c93 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:25.093228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 166/345] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:24 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:25.093414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba9d6e02-75fc-4a0a-a82a-d1071ba92c93 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.094082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba9d6e02-75fc-4a0a-a82a-d1071ba92c93 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.094890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba9d6e02-75fc-4a0a-a82a-d1071ba92c93 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.095326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba9d6e02-75fc-4a0a-a82a-d1071ba92c93 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.174024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:25.174660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:25.180453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.180905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.181779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.182336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.212417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.212885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.213331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lazy-loading 'fault' on Instance uuid 5482da2d-a290-4a63-a09f-583238ed6c8b {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:21:25.234113 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ba9d6e02-75fc-4a0a-a82a-d1071ba92c93 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:25.242239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ba9d6e02-75fc-4a0a-a82a-d1071ba92c93 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1444 microversion: 2.1 time: 0.159674 Mar 08 04:21:25.242801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 180/346] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:25.256886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-184710e8-3696-4a39-8498-380c212d4272 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:25.257490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-184710e8-3696-4a39-8498-380c212d4272 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:25.263298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9779db0a09d04a0fb3e27f8c58b38ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c2f59b362541308c7e35540918b59b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:25.263444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-184710e8-3696-4a39-8498-380c212d4272 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.263778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-184710e8-3696-4a39-8498-380c212d4272 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.264540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-184710e8-3696-4a39-8498-380c212d4272 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.264976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-184710e8-3696-4a39-8498-380c212d4272 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.271436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-07a5aa55-86c3-4c07-b025-d403a1d30fe4 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 200 len: 1305 microversion: 2.1 time: 0.102760 Mar 08 04:21:25.272008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 167/347] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:25 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:25.276334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0ef0d5f0-27a9-42b8-8467-5459af28560c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:25.276927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0ef0d5f0-27a9-42b8-8467-5459af28560c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:25.283569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ef0d5f0-27a9-42b8-8467-5459af28560c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.284009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ef0d5f0-27a9-42b8-8467-5459af28560c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.284774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ef0d5f0-27a9-42b8-8467-5459af28560c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.285200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ef0d5f0-27a9-42b8-8467-5459af28560c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.458878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-184710e8-3696-4a39-8498-380c212d4272 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:25.466692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-184710e8-3696-4a39-8498-380c212d4272 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1700 microversion: 2.1 time: 0.213509 Mar 08 04:21:25.467344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 181/348] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1700 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:25.473398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0ef0d5f0-27a9-42b8-8467-5459af28560c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:25.484860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0ef0d5f0-27a9-42b8-8467-5459af28560c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1444 microversion: 2.1 time: 0.211405 Mar 08 04:21:25.485972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 168/349] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1444 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:25.489897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b5f2a2d8-d89c-461b-8197-92fd1b5abf86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:25.497143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5f2a2d8-d89c-461b-8197-92fd1b5abf86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.497593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5f2a2d8-d89c-461b-8197-92fd1b5abf86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.522963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b5f2a2d8-d89c-461b-8197-92fd1b5abf86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Going to try to start instance {{(pid=116775) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 08 04:21:25.569071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b5f2a2d8-d89c-461b-8197-92fd1b5abf86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/action" status: 202 len: 0 microversion: 2.1 time: 0.084453 Mar 08 04:21:25.569876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 182/350] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:21:25 2022] POST /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 04:21:25.577923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-155a652d-8f33-4247-82c6-bebde0dd2fc2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:25.579377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-155a652d-8f33-4247-82c6-bebde0dd2fc2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:25.585609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-155a652d-8f33-4247-82c6-bebde0dd2fc2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.586077 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-155a652d-8f33-4247-82c6-bebde0dd2fc2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.587036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-155a652d-8f33-4247-82c6-bebde0dd2fc2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:25.587628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-155a652d-8f33-4247-82c6-bebde0dd2fc2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:25.756875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-155a652d-8f33-4247-82c6-bebde0dd2fc2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:25.766212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-155a652d-8f33-4247-82c6-bebde0dd2fc2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1709 microversion: 2.1 time: 0.191177 Mar 08 04:21:25.766778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 169/351] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:26.100582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-959be2b6-2621-40f3-b198-716ae69ead0c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:26.101827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-959be2b6-2621-40f3-b198-716ae69ead0c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:26.103908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a14cac40-78a0-4a5e-8ec9-d62a103f172e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:26.105621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a14cac40-78a0-4a5e-8ec9-d62a103f172e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:26.109213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-959be2b6-2621-40f3-b198-716ae69ead0c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:26.111082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-959be2b6-2621-40f3-b198-716ae69ead0c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:26.112377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-959be2b6-2621-40f3-b198-716ae69ead0c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:26.113157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-959be2b6-2621-40f3-b198-716ae69ead0c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:26.114678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a14cac40-78a0-4a5e-8ec9-d62a103f172e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:26.115127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a14cac40-78a0-4a5e-8ec9-d62a103f172e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:26.116579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a14cac40-78a0-4a5e-8ec9-d62a103f172e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:26.117021 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a14cac40-78a0-4a5e-8ec9-d62a103f172e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:26.441027 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a14cac40-78a0-4a5e-8ec9-d62a103f172e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:26.444447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-959be2b6-2621-40f3-b198-716ae69ead0c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:26.449213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a14cac40-78a0-4a5e-8ec9-d62a103f172e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.352154 Mar 08 04:21:26.458635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 170/352] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:26 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:26.458635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8225db8d-6fe6-427f-a8ec-c409f1856ed6 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:26.458635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8225db8d-6fe6-427f-a8ec-c409f1856ed6 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] [instance: 5482da2d-a290-4a63-a09f-583238ed6c8b] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:26.460802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-959be2b6-2621-40f3-b198-716ae69ead0c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.366295 Mar 08 04:21:26.462644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8225db8d-6fe6-427f-a8ec-c409f1856ed6 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:26.463091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8225db8d-6fe6-427f-a8ec-c409f1856ed6 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:26.463887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8225db8d-6fe6-427f-a8ec-c409f1856ed6 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:26.464661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8225db8d-6fe6-427f-a8ec-c409f1856ed6 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:26.468136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 183/353] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:26 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:26.479641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-8225db8d-6fe6-427f-a8ec-c409f1856ed6 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] HTTP exception thrown: Instance 5482da2d-a290-4a63-a09f-583238ed6c8b could not be found. Mar 08 04:21:26.480412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8225db8d-6fe6-427f-a8ec-c409f1856ed6 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] Returning 404 to user: Instance 5482da2d-a290-4a63-a09f-583238ed6c8b could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:21:26.481243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8225db8d-6fe6-427f-a8ec-c409f1856ed6 tempest-VolumesNegativeTest-1032762071 tempest-VolumesNegativeTest-1032762071-project] 10.222.0.30 "GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b" status: 404 len: 111 microversion: 2.1 time: 0.030552 Mar 08 04:21:26.487214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 171/354] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:26 2022] GET /compute/v2.1/servers/5482da2d-a290-4a63-a09f-583238ed6c8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:21:26.784509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-21be2c47-243a-4f75-97c5-f37ab07b12cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:26.785336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-21be2c47-243a-4f75-97c5-f37ab07b12cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:26.791593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-21be2c47-243a-4f75-97c5-f37ab07b12cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:26.791977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-21be2c47-243a-4f75-97c5-f37ab07b12cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:26.793120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-21be2c47-243a-4f75-97c5-f37ab07b12cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:26.793467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-21be2c47-243a-4f75-97c5-f37ab07b12cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:27.077308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-21be2c47-243a-4f75-97c5-f37ab07b12cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:27.088202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-21be2c47-243a-4f75-97c5-f37ab07b12cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1709 microversion: 2.1 time: 0.308575 Mar 08 04:21:27.088917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 184/355] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:26 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1709 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:27.477638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2cc6448f-3fb9-4d22-920a-91a28b0addc1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:27.478986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fbffb2ca-a383-491b-a169-e514b2afe174 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:27.479350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2cc6448f-3fb9-4d22-920a-91a28b0addc1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:27.480595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fbffb2ca-a383-491b-a169-e514b2afe174 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:27.493598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2cc6448f-3fb9-4d22-920a-91a28b0addc1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:27.496305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbffb2ca-a383-491b-a169-e514b2afe174 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:27.496634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2cc6448f-3fb9-4d22-920a-91a28b0addc1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:27.497441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2cc6448f-3fb9-4d22-920a-91a28b0addc1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:27.497910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2cc6448f-3fb9-4d22-920a-91a28b0addc1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:27.503023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbffb2ca-a383-491b-a169-e514b2afe174 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:27.503871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbffb2ca-a383-491b-a169-e514b2afe174 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:27.504312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbffb2ca-a383-491b-a169-e514b2afe174 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:27.844745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2cc6448f-3fb9-4d22-920a-91a28b0addc1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:27.860115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2cc6448f-3fb9-4d22-920a-91a28b0addc1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.386006 Mar 08 04:21:27.861010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 185/356] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:27 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:27.882519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fbffb2ca-a383-491b-a169-e514b2afe174 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:27.891271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fbffb2ca-a383-491b-a169-e514b2afe174 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.425226 Mar 08 04:21:27.892045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 172/357] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:27 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:28.106202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4ac77d50-743d-4c3e-a807-cfeae9a58544 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:28.106818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4ac77d50-743d-4c3e-a807-cfeae9a58544 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:28.115356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ac77d50-743d-4c3e-a807-cfeae9a58544 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:28.115503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ac77d50-743d-4c3e-a807-cfeae9a58544 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:28.116238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ac77d50-743d-4c3e-a807-cfeae9a58544 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:28.116672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ac77d50-743d-4c3e-a807-cfeae9a58544 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:28.341446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4ac77d50-743d-4c3e-a807-cfeae9a58544 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:28.352050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4ac77d50-743d-4c3e-a807-cfeae9a58544 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1709 microversion: 2.1 time: 0.249767 Mar 08 04:21:28.352639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 186/358] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:28 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1709 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:28.670785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-9a297a7b-49f8-43f8-83d3-ac5db53bd432 req-7594ce40-093e-42a2-9609-32d1f67c16f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4208bcea-e0a6-4c9d-956c-477a87d388ca", "tag": "5ed21f05-392d-4365-8c94-f119e23a8232"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:28.681570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-9a297a7b-49f8-43f8-83d3-ac5db53bd432 req-7594ce40-093e-42a2-9609-32d1f67c16f4 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:28.682359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-9a297a7b-49f8-43f8-83d3-ac5db53bd432 req-7594ce40-093e-42a2-9609-32d1f67c16f4 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:28.693974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-9a297a7b-49f8-43f8-83d3-ac5db53bd432 req-7594ce40-093e-42a2-9609-32d1f67c16f4 service nova] Creating event network-changed:5ed21f05-392d-4365-8c94-f119e23a8232 for instance 4208bcea-e0a6-4c9d-956c-477a87d388ca on hv-cinder-73306 Mar 08 04:21:28.700151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-9a297a7b-49f8-43f8-83d3-ac5db53bd432 req-7594ce40-093e-42a2-9609-32d1f67c16f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033498 Mar 08 04:21:28.701115 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 173/359] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:28.878041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-857cd223-5e13-4042-bad3-bb41ad237a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:28.878765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-857cd223-5e13-4042-bad3-bb41ad237a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:28.888192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-857cd223-5e13-4042-bad3-bb41ad237a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:28.888649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-857cd223-5e13-4042-bad3-bb41ad237a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:28.889432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-857cd223-5e13-4042-bad3-bb41ad237a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:28.890080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-857cd223-5e13-4042-bad3-bb41ad237a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:28.911212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a3255e3f-924b-4386-9806-752c4cbee0da tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:28.911915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a3255e3f-924b-4386-9806-752c4cbee0da tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:28.920276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3255e3f-924b-4386-9806-752c4cbee0da tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:28.921043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3255e3f-924b-4386-9806-752c4cbee0da tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:28.924890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3255e3f-924b-4386-9806-752c4cbee0da tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:28.925720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3255e3f-924b-4386-9806-752c4cbee0da tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:29.205219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a3255e3f-924b-4386-9806-752c4cbee0da tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:29.221892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a3255e3f-924b-4386-9806-752c4cbee0da tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.308172 Mar 08 04:21:29.221892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 174/360] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:28 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:29.230411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-857cd223-5e13-4042-bad3-bb41ad237a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:29.239079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-857cd223-5e13-4042-bad3-bb41ad237a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1366 microversion: 2.1 time: 0.365087 Mar 08 04:21:29.251506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 187/361] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:28 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:29.309678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-47e65b41-dc9f-49af-a12c-a55c5789cab5 req-f571232a-36db-4aee-8ab6-fe82c45017fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15560a8a-764b-4343-b74b-089d0e4d91ce", "name": "network-vif-plugged", "status": "completed", "tag": "7b1b12a4-573a-477f-8465-6ab8d7873fb3"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:29.332122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-47e65b41-dc9f-49af-a12c-a55c5789cab5 req-f571232a-36db-4aee-8ab6-fe82c45017fb service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:29.336165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-47e65b41-dc9f-49af-a12c-a55c5789cab5 req-f571232a-36db-4aee-8ab6-fe82c45017fb service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:29.355849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-47e65b41-dc9f-49af-a12c-a55c5789cab5 req-f571232a-36db-4aee-8ab6-fe82c45017fb service nova] Creating event network-vif-plugged:7b1b12a4-573a-477f-8465-6ab8d7873fb3 for instance 15560a8a-764b-4343-b74b-089d0e4d91ce on hv-cinder-73306 Mar 08 04:21:29.362887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-47e65b41-dc9f-49af-a12c-a55c5789cab5 req-f571232a-36db-4aee-8ab6-fe82c45017fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056820 Mar 08 04:21:29.364204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 175/362] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:29.370551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-605bb7e1-6e1a-437f-97e9-02f1a4b63bdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:29.374329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-605bb7e1-6e1a-437f-97e9-02f1a4b63bdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:29.394191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-605bb7e1-6e1a-437f-97e9-02f1a4b63bdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:29.394904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-605bb7e1-6e1a-437f-97e9-02f1a4b63bdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:29.398115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-605bb7e1-6e1a-437f-97e9-02f1a4b63bdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:29.399040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-605bb7e1-6e1a-437f-97e9-02f1a4b63bdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:29.694492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-605bb7e1-6e1a-437f-97e9-02f1a4b63bdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:29.707421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-605bb7e1-6e1a-437f-97e9-02f1a4b63bdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1709 microversion: 2.1 time: 0.340953 Mar 08 04:21:29.708323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 188/363] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1709 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:30.235182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-be4d8690-4f02-4f77-8fc0-be921ede5b0f tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:30.235881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-be4d8690-4f02-4f77-8fc0-be921ede5b0f tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:30.242300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be4d8690-4f02-4f77-8fc0-be921ede5b0f tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:30.243367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be4d8690-4f02-4f77-8fc0-be921ede5b0f tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:30.244306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be4d8690-4f02-4f77-8fc0-be921ede5b0f tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:30.244889 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be4d8690-4f02-4f77-8fc0-be921ede5b0f tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:30.258577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0b7c2a14-e3aa-405a-9669-ba8dfea7c193 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:30.259769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0b7c2a14-e3aa-405a-9669-ba8dfea7c193 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:30.268940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b7c2a14-e3aa-405a-9669-ba8dfea7c193 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:30.269438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b7c2a14-e3aa-405a-9669-ba8dfea7c193 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:30.270416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b7c2a14-e3aa-405a-9669-ba8dfea7c193 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:30.271138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b7c2a14-e3aa-405a-9669-ba8dfea7c193 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:30.488966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0b7c2a14-e3aa-405a-9669-ba8dfea7c193 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:30.492220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-be4d8690-4f02-4f77-8fc0-be921ede5b0f tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:30.497593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0b7c2a14-e3aa-405a-9669-ba8dfea7c193 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1556 microversion: 2.1 time: 0.242828 Mar 08 04:21:30.498270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 189/364] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:30 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1556 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:30.502944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-be4d8690-4f02-4f77-8fc0-be921ede5b0f tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.275121 Mar 08 04:21:30.503592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 176/365] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:30 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:30.513880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5024b544-312b-48dd-8163-828f69f4a1c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:30.514619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5024b544-312b-48dd-8163-828f69f4a1c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:30.521248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5024b544-312b-48dd-8163-828f69f4a1c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:30.521793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5024b544-312b-48dd-8163-828f69f4a1c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:30.522977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5024b544-312b-48dd-8163-828f69f4a1c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:30.523409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5024b544-312b-48dd-8163-828f69f4a1c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:30.616017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5024b544-312b-48dd-8163-828f69f4a1c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106083 Mar 08 04:21:30.616632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 190/366] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 04:21:30 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:30.725576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b024c769-0bd4-4930-b576-d16e10ec8586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:30.726306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b024c769-0bd4-4930-b576-d16e10ec8586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:30.732547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b024c769-0bd4-4930-b576-d16e10ec8586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:30.733104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b024c769-0bd4-4930-b576-d16e10ec8586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:30.735349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b024c769-0bd4-4930-b576-d16e10ec8586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:30.735637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b024c769-0bd4-4930-b576-d16e10ec8586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:30.985509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b024c769-0bd4-4930-b576-d16e10ec8586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:30.993800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b024c769-0bd4-4930-b576-d16e10ec8586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1713 microversion: 2.1 time: 0.271974 Mar 08 04:21:30.994468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 177/367] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1713 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:31.520203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-04d46805-2edc-451f-b971-617f3fa5972a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:31.520806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-04d46805-2edc-451f-b971-617f3fa5972a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:31.528739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04d46805-2edc-451f-b971-617f3fa5972a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:31.529476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04d46805-2edc-451f-b971-617f3fa5972a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:31.530457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04d46805-2edc-451f-b971-617f3fa5972a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:31.530950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04d46805-2edc-451f-b971-617f3fa5972a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:31.772306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-04d46805-2edc-451f-b971-617f3fa5972a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:31.779626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-04d46805-2edc-451f-b971-617f3fa5972a tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.263827 Mar 08 04:21:31.780187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 191/368] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:31 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:31.865393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-a279bdcf-e449-4109-ab86-06f55136deb7 req-2a5abc7f-e963-42a7-9bc5-cdaa88cb0d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c4a684-9cf2-4913-8f00-3833940f7184", "tag": "efdaa5ea-6b22-4b8e-b80a-61fc6f368338"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:31.873722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-a279bdcf-e449-4109-ab86-06f55136deb7 req-2a5abc7f-e963-42a7-9bc5-cdaa88cb0d54 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:31.874174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-a279bdcf-e449-4109-ab86-06f55136deb7 req-2a5abc7f-e963-42a7-9bc5-cdaa88cb0d54 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:31.886078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-a279bdcf-e449-4109-ab86-06f55136deb7 req-2a5abc7f-e963-42a7-9bc5-cdaa88cb0d54 service nova] Creating event network-changed:efdaa5ea-6b22-4b8e-b80a-61fc6f368338 for instance 46c4a684-9cf2-4913-8f00-3833940f7184 on hv-cinder-73306 Mar 08 04:21:31.891601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-a279bdcf-e449-4109-ab86-06f55136deb7 req-2a5abc7f-e963-42a7-9bc5-cdaa88cb0d54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029674 Mar 08 04:21:31.892191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 178/369] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:32.472984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-53a2174d-736d-42dc-b98d-02b0a5703f64 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:32.474049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-53a2174d-736d-42dc-b98d-02b0a5703f64 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:32.480876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53a2174d-736d-42dc-b98d-02b0a5703f64 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:32.481330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53a2174d-736d-42dc-b98d-02b0a5703f64 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:32.482134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53a2174d-736d-42dc-b98d-02b0a5703f64 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:32.482577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53a2174d-736d-42dc-b98d-02b0a5703f64 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:32.508926 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-53a2174d-736d-42dc-b98d-02b0a5703f64 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lazy-loading 'flavor' on Instance uuid 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:21:32.638548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-53a2174d-736d-42dc-b98d-02b0a5703f64 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action" status: 200 len: 32 microversion: 2.1 time: 0.170282 Mar 08 04:21:32.639172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 192/370] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:21:32 2022] POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 04:21:32.648983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4dfa9c80-b56c-4615-ad43-6c5bb2ff3c2d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:32.649692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4dfa9c80-b56c-4615-ad43-6c5bb2ff3c2d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:32.655824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4dfa9c80-b56c-4615-ad43-6c5bb2ff3c2d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:32.656286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4dfa9c80-b56c-4615-ad43-6c5bb2ff3c2d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:32.657405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4dfa9c80-b56c-4615-ad43-6c5bb2ff3c2d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:32.657881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4dfa9c80-b56c-4615-ad43-6c5bb2ff3c2d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:32.798170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4dfa9c80-b56c-4615-ad43-6c5bb2ff3c2d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:32.798335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8aac05a2-4440-4836-a38c-00a5e9705fe9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:32.798982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8aac05a2-4440-4836-a38c-00a5e9705fe9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:32.805235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8aac05a2-4440-4836-a38c-00a5e9705fe9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:32.805697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8aac05a2-4440-4836-a38c-00a5e9705fe9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:32.806240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4dfa9c80-b56c-4615-ad43-6c5bb2ff3c2d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.161381 Mar 08 04:21:32.806708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8aac05a2-4440-4836-a38c-00a5e9705fe9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:32.806820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 179/371] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:32.807143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8aac05a2-4440-4836-a38c-00a5e9705fe9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:32.941947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8aac05a2-4440-4836-a38c-00a5e9705fe9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:32.949017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8aac05a2-4440-4836-a38c-00a5e9705fe9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.155127 Mar 08 04:21:32.949567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 193/372] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:32 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:33.823749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-69c2711c-d4d6-4fe2-8584-b152206ba237 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:33.824355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-69c2711c-d4d6-4fe2-8584-b152206ba237 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:33.832032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69c2711c-d4d6-4fe2-8584-b152206ba237 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:33.832412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69c2711c-d4d6-4fe2-8584-b152206ba237 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:33.833202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69c2711c-d4d6-4fe2-8584-b152206ba237 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:33.833640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69c2711c-d4d6-4fe2-8584-b152206ba237 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:33.967080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-560401c0-e9cf-482b-904d-38e907d411f9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:33.967826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-560401c0-e9cf-482b-904d-38e907d411f9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:33.974484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-560401c0-e9cf-482b-904d-38e907d411f9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:33.975223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-560401c0-e9cf-482b-904d-38e907d411f9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:33.976195 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-560401c0-e9cf-482b-904d-38e907d411f9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:33.976819 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-560401c0-e9cf-482b-904d-38e907d411f9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:33.994019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-69c2711c-d4d6-4fe2-8584-b152206ba237 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:34.002923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-69c2711c-d4d6-4fe2-8584-b152206ba237 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.182997 Mar 08 04:21:34.003905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 180/373] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:34.124508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-560401c0-e9cf-482b-904d-38e907d411f9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:34.133793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-560401c0-e9cf-482b-904d-38e907d411f9 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1314 microversion: 2.1 time: 0.171216 Mar 08 04:21:34.134405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 194/374] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:33 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:35.020936 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-680b1141-552f-40e5-9f3c-97ea5e887efc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:35.021472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-680b1141-552f-40e5-9f3c-97ea5e887efc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:35.027754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-680b1141-552f-40e5-9f3c-97ea5e887efc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:35.028203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-680b1141-552f-40e5-9f3c-97ea5e887efc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:35.028969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-680b1141-552f-40e5-9f3c-97ea5e887efc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:35.029401 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-680b1141-552f-40e5-9f3c-97ea5e887efc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:35.150897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d47f2193-a918-4f12-97b0-727a8c53d595 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:35.151562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d47f2193-a918-4f12-97b0-727a8c53d595 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:35.158382 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-680b1141-552f-40e5-9f3c-97ea5e887efc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:35.159202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d47f2193-a918-4f12-97b0-727a8c53d595 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:35.159661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d47f2193-a918-4f12-97b0-727a8c53d595 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:35.160448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d47f2193-a918-4f12-97b0-727a8c53d595 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:35.161117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d47f2193-a918-4f12-97b0-727a8c53d595 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:35.166668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-680b1141-552f-40e5-9f3c-97ea5e887efc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.149667 Mar 08 04:21:35.167467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 181/375] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:35.294007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d47f2193-a918-4f12-97b0-727a8c53d595 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:35.301250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d47f2193-a918-4f12-97b0-727a8c53d595 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1498 microversion: 2.1 time: 0.154261 Mar 08 04:21:35.301842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 195/376] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:35 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:21:35.853180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-59431400-3fcb-40ef-9c6d-70f6035d9381 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:35.853693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-59431400-3fcb-40ef-9c6d-70f6035d9381 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:35.859616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59431400-3fcb-40ef-9c6d-70f6035d9381 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:35.860063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59431400-3fcb-40ef-9c6d-70f6035d9381 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:35.860817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59431400-3fcb-40ef-9c6d-70f6035d9381 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:35.861248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59431400-3fcb-40ef-9c6d-70f6035d9381 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:35.883927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-59431400-3fcb-40ef-9c6d-70f6035d9381 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Going to try to terminate instance {{(pid=116774) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:21:35.956156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-59431400-3fcb-40ef-9c6d-70f6035d9381 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 204 len: 0 microversion: 2.1 time: 0.106458 Mar 08 04:21:35.956745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 182/377] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:21:35 2022] DELETE /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:21:35.965533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2ad3eb59-b35e-4521-a263-b1e33e062ffe tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:35.966724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2ad3eb59-b35e-4521-a263-b1e33e062ffe tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:35.974101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ad3eb59-b35e-4521-a263-b1e33e062ffe tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:35.974546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ad3eb59-b35e-4521-a263-b1e33e062ffe tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:35.975383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ad3eb59-b35e-4521-a263-b1e33e062ffe tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:35.975817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ad3eb59-b35e-4521-a263-b1e33e062ffe tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:36.104169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ad3eb59-b35e-4521-a263-b1e33e062ffe tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:36.111705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2ad3eb59-b35e-4521-a263-b1e33e062ffe tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1504 microversion: 2.1 time: 0.150643 Mar 08 04:21:36.112270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 196/378] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:35 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:36.183638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-184e1d07-597b-4aed-86fe-86539d72dc7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:36.184340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-184e1d07-597b-4aed-86fe-86539d72dc7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:36.190956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-184e1d07-597b-4aed-86fe-86539d72dc7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:36.191410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-184e1d07-597b-4aed-86fe-86539d72dc7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:36.192179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-184e1d07-597b-4aed-86fe-86539d72dc7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:36.192617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-184e1d07-597b-4aed-86fe-86539d72dc7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:36.328728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-184e1d07-597b-4aed-86fe-86539d72dc7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:36.336536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-184e1d07-597b-4aed-86fe-86539d72dc7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.157120 Mar 08 04:21:36.337097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 183/379] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:37.129468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f9474fa1-340b-40d1-b241-ee4961461969 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:37.130017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f9474fa1-340b-40d1-b241-ee4961461969 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:37.136171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9474fa1-340b-40d1-b241-ee4961461969 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:37.136612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9474fa1-340b-40d1-b241-ee4961461969 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:37.137366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9474fa1-340b-40d1-b241-ee4961461969 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:37.137828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9474fa1-340b-40d1-b241-ee4961461969 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:37.270191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f9474fa1-340b-40d1-b241-ee4961461969 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:37.277436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f9474fa1-340b-40d1-b241-ee4961461969 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1504 microversion: 2.1 time: 0.152482 Mar 08 04:21:37.278030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 197/380] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:37 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:37.353545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dbe9f27a-6fc8-4e4e-a7af-9a572137034c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:37.354235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dbe9f27a-6fc8-4e4e-a7af-9a572137034c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:37.361262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbe9f27a-6fc8-4e4e-a7af-9a572137034c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:37.361733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbe9f27a-6fc8-4e4e-a7af-9a572137034c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:37.362496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbe9f27a-6fc8-4e4e-a7af-9a572137034c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:37.362926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbe9f27a-6fc8-4e4e-a7af-9a572137034c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:37.495739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dbe9f27a-6fc8-4e4e-a7af-9a572137034c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:37.504106 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dbe9f27a-6fc8-4e4e-a7af-9a572137034c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.154413 Mar 08 04:21:37.504655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 184/381] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:37.626029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6dca5b81-a175-48a5-b398-cef0c6d4555b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:37.626518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6dca5b81-a175-48a5-b398-cef0c6d4555b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:37.632375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6dca5b81-a175-48a5-b398-cef0c6d4555b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:37.632814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6dca5b81-a175-48a5-b398-cef0c6d4555b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:37.633568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6dca5b81-a175-48a5-b398-cef0c6d4555b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:37.634023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6dca5b81-a175-48a5-b398-cef0c6d4555b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:37.757456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-6dca5b81-a175-48a5-b398-cef0c6d4555b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lazy-loading 'services' on Instance uuid e369a590-728c-4108-9f1c-d685ab4a0c92 {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:21:37.871363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6dca5b81-a175-48a5-b398-cef0c6d4555b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92/os-volume_attachments/e9686a24-607e-464a-a065-6dc9bee25c5c" status: 202 len: 0 microversion: 2.1 time: 0.249258 Mar 08 04:21:37.871935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 198/382] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:21:37 2022] DELETE /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92/os-volume_attachments/e9686a24-607e-464a-a065-6dc9bee25c5c => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:21:38.294755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b8ca049c-dea9-4505-a6c3-f9165c0ed4f3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:38.295393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b8ca049c-dea9-4505-a6c3-f9165c0ed4f3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:38.301215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8ca049c-dea9-4505-a6c3-f9165c0ed4f3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:38.301683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8ca049c-dea9-4505-a6c3-f9165c0ed4f3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:38.302528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8ca049c-dea9-4505-a6c3-f9165c0ed4f3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:38.302964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8ca049c-dea9-4505-a6c3-f9165c0ed4f3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:38.436441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b8ca049c-dea9-4505-a6c3-f9165c0ed4f3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56858073f1f4a9ab49f3833c2bf77e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a2431c1a3a402f93d42ece33c568eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:38.444424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b8ca049c-dea9-4505-a6c3-f9165c0ed4f3 tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 200 len: 1504 microversion: 2.1 time: 0.153568 Mar 08 04:21:38.444991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 185/383] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:38 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:38.522488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c2ca713b-41b6-4307-a4f3-ef3d299287d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:38.523153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c2ca713b-41b6-4307-a4f3-ef3d299287d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:38.529859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2ca713b-41b6-4307-a4f3-ef3d299287d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:38.530307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2ca713b-41b6-4307-a4f3-ef3d299287d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:38.531111 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2ca713b-41b6-4307-a4f3-ef3d299287d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:38.531549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2ca713b-41b6-4307-a4f3-ef3d299287d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:38.680082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c2ca713b-41b6-4307-a4f3-ef3d299287d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:38.689078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c2ca713b-41b6-4307-a4f3-ef3d299287d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.171021 Mar 08 04:21:38.690083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 199/384] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:38 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:38.707786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-acbdce1c-a510-49e9-8514-2ec918ee8884 req-ea95c70a-16b7-4588-939c-aaf715721151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15560a8a-764b-4343-b74b-089d0e4d91ce", "name": "network-vif-deleted", "tag": "7b1b12a4-573a-477f-8465-6ab8d7873fb3"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:38.716431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-acbdce1c-a510-49e9-8514-2ec918ee8884 req-ea95c70a-16b7-4588-939c-aaf715721151 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:38.716968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-acbdce1c-a510-49e9-8514-2ec918ee8884 req-ea95c70a-16b7-4588-939c-aaf715721151 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:38.742312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-acbdce1c-a510-49e9-8514-2ec918ee8884 req-ea95c70a-16b7-4588-939c-aaf715721151 service nova] Creating event network-vif-deleted:7b1b12a4-573a-477f-8465-6ab8d7873fb3 for instance 15560a8a-764b-4343-b74b-089d0e4d91ce on hv-cinder-73306 Mar 08 04:21:38.748252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-acbdce1c-a510-49e9-8514-2ec918ee8884 req-ea95c70a-16b7-4588-939c-aaf715721151 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044274 Mar 08 04:21:38.748844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 186/385] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:39.461692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c26dc023-b462-4d64-a154-e89959015b4e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:39.462323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c26dc023-b462-4d64-a154-e89959015b4e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] [instance: 15560a8a-764b-4343-b74b-089d0e4d91ce] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:39.468734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c26dc023-b462-4d64-a154-e89959015b4e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:39.469180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c26dc023-b462-4d64-a154-e89959015b4e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:39.469960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c26dc023-b462-4d64-a154-e89959015b4e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:39.470389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c26dc023-b462-4d64-a154-e89959015b4e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:39.483043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-c26dc023-b462-4d64-a154-e89959015b4e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] HTTP exception thrown: Instance 15560a8a-764b-4343-b74b-089d0e4d91ce could not be found. Mar 08 04:21:39.483553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c26dc023-b462-4d64-a154-e89959015b4e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] Returning 404 to user: Instance 15560a8a-764b-4343-b74b-089d0e4d91ce could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:21:39.484453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c26dc023-b462-4d64-a154-e89959015b4e tempest-VolumesActionsTest-1412562755 tempest-VolumesActionsTest-1412562755-project] 10.222.0.30 "GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce" status: 404 len: 111 microversion: 2.1 time: 0.026667 Mar 08 04:21:39.484951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 200/386] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:39 2022] GET /compute/v2.1/servers/15560a8a-764b-4343-b74b-089d0e4d91ce => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:21:39.708163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-067f90d5-3c50-462a-8e32-6743a1a881da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:39.708976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-067f90d5-3c50-462a-8e32-6743a1a881da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:39.715187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-067f90d5-3c50-462a-8e32-6743a1a881da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:39.715669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-067f90d5-3c50-462a-8e32-6743a1a881da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:39.716432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-067f90d5-3c50-462a-8e32-6743a1a881da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:39.716860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-067f90d5-3c50-462a-8e32-6743a1a881da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:39.857570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-067f90d5-3c50-462a-8e32-6743a1a881da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:39.866220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-067f90d5-3c50-462a-8e32-6743a1a881da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.163254 Mar 08 04:21:39.866802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 187/387] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:40.040805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-34145973-4fdd-41d3-8cf4-b579b4c2a677 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:40.041314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-34145973-4fdd-41d3-8cf4-b579b4c2a677 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:40.047929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-34145973-4fdd-41d3-8cf4-b579b4c2a677 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:40.048467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-34145973-4fdd-41d3-8cf4-b579b4c2a677 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:40.049300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-34145973-4fdd-41d3-8cf4-b579b4c2a677 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:40.049837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-34145973-4fdd-41d3-8cf4-b579b4c2a677 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:40.076714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-34145973-4fdd-41d3-8cf4-b579b4c2a677 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:21:40.156956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-34145973-4fdd-41d3-8cf4-b579b4c2a677 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 204 len: 0 microversion: 2.1 time: 0.118732 Mar 08 04:21:40.157643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 201/388] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:21:40 2022] DELETE /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:21:40.165771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-55b4aab1-d17c-49df-b7cf-9a73c6b17751 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:40.166390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-55b4aab1-d17c-49df-b7cf-9a73c6b17751 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:40.174196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55b4aab1-d17c-49df-b7cf-9a73c6b17751 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:40.177812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55b4aab1-d17c-49df-b7cf-9a73c6b17751 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:40.177812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55b4aab1-d17c-49df-b7cf-9a73c6b17751 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:40.177812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55b4aab1-d17c-49df-b7cf-9a73c6b17751 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:40.315068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-55b4aab1-d17c-49df-b7cf-9a73c6b17751 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:40.322329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-55b4aab1-d17c-49df-b7cf-9a73c6b17751 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1513 microversion: 2.1 time: 0.160376 Mar 08 04:21:40.322892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 188/389] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:40 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:40.884191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dbe4b57c-036c-4e2f-9250-98d0e43a3a01 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:40.884894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dbe4b57c-036c-4e2f-9250-98d0e43a3a01 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:40.891483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dbe4b57c-036c-4e2f-9250-98d0e43a3a01 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:40.891931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dbe4b57c-036c-4e2f-9250-98d0e43a3a01 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:40.892697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dbe4b57c-036c-4e2f-9250-98d0e43a3a01 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:40.893132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dbe4b57c-036c-4e2f-9250-98d0e43a3a01 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:41.033341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dbe4b57c-036c-4e2f-9250-98d0e43a3a01 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:41.040984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dbe4b57c-036c-4e2f-9250-98d0e43a3a01 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.160983 Mar 08 04:21:41.041550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 202/390] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:41.339928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5cb55caf-018b-4c3b-988f-74febf938ff7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:41.340448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5cb55caf-018b-4c3b-988f-74febf938ff7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:41.347584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5cb55caf-018b-4c3b-988f-74febf938ff7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:41.348024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5cb55caf-018b-4c3b-988f-74febf938ff7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:41.348781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5cb55caf-018b-4c3b-988f-74febf938ff7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:41.349215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5cb55caf-018b-4c3b-988f-74febf938ff7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:41.682047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5cb55caf-018b-4c3b-988f-74febf938ff7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:41.690042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5cb55caf-018b-4c3b-988f-74febf938ff7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1513 microversion: 2.1 time: 0.354044 Mar 08 04:21:41.690603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 189/391] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:41 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1513 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:42.057551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cf0ac4e3-1b8b-4c29-8f7f-782054f50568 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:42.058181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cf0ac4e3-1b8b-4c29-8f7f-782054f50568 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:42.064443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf0ac4e3-1b8b-4c29-8f7f-782054f50568 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:42.064893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf0ac4e3-1b8b-4c29-8f7f-782054f50568 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:42.065672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf0ac4e3-1b8b-4c29-8f7f-782054f50568 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:42.066162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf0ac4e3-1b8b-4c29-8f7f-782054f50568 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:42.197589 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cf0ac4e3-1b8b-4c29-8f7f-782054f50568 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:42.205909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cf0ac4e3-1b8b-4c29-8f7f-782054f50568 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.152137 Mar 08 04:21:42.206469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 203/392] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:42 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:42.706766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-31240003-eee1-4605-8f7e-84904adbc0fa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:42.707377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-31240003-eee1-4605-8f7e-84904adbc0fa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:42.713678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31240003-eee1-4605-8f7e-84904adbc0fa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:42.714130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31240003-eee1-4605-8f7e-84904adbc0fa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:42.714893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31240003-eee1-4605-8f7e-84904adbc0fa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:42.715329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31240003-eee1-4605-8f7e-84904adbc0fa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:42.848183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-31240003-eee1-4605-8f7e-84904adbc0fa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:42.855797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-31240003-eee1-4605-8f7e-84904adbc0fa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1513 microversion: 2.1 time: 0.152514 Mar 08 04:21:42.856007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 190/393] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:42 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:43.223137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e7171e6a-17a4-4d8c-92d8-bdde5d71d95e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:43.223746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e7171e6a-17a4-4d8c-92d8-bdde5d71d95e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:43.230011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7171e6a-17a4-4d8c-92d8-bdde5d71d95e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:43.230463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7171e6a-17a4-4d8c-92d8-bdde5d71d95e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:43.231232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7171e6a-17a4-4d8c-92d8-bdde5d71d95e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:43.231689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7171e6a-17a4-4d8c-92d8-bdde5d71d95e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:43.359891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e7171e6a-17a4-4d8c-92d8-bdde5d71d95e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:43.367643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e7171e6a-17a4-4d8c-92d8-bdde5d71d95e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.148314 Mar 08 04:21:43.368206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 204/394] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:43.872367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-52a22413-9af7-4e94-a92c-9f4ece9bf131 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:43.872977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-52a22413-9af7-4e94-a92c-9f4ece9bf131 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:43.879458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52a22413-9af7-4e94-a92c-9f4ece9bf131 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:43.879909 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52a22413-9af7-4e94-a92c-9f4ece9bf131 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:43.880683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52a22413-9af7-4e94-a92c-9f4ece9bf131 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:43.881120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52a22413-9af7-4e94-a92c-9f4ece9bf131 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:44.013062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-52a22413-9af7-4e94-a92c-9f4ece9bf131 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:44.021194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-52a22413-9af7-4e94-a92c-9f4ece9bf131 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 200 len: 1513 microversion: 2.1 time: 0.152722 Mar 08 04:21:44.021779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 191/395] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:43 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:44.173247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-78683920-3ec8-4889-9c72-6ee0e2c66afd req-1a45186d-405b-4ddf-a3a6-14f8fdde504e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e369a590-728c-4108-9f1c-d685ab4a0c92", "name": "network-vif-deleted", "tag": "58a443b2-b10c-4c0d-b138-65b75997b871"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:44.181330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-78683920-3ec8-4889-9c72-6ee0e2c66afd req-1a45186d-405b-4ddf-a3a6-14f8fdde504e service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:44.181868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-78683920-3ec8-4889-9c72-6ee0e2c66afd req-1a45186d-405b-4ddf-a3a6-14f8fdde504e service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:44.193267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-78683920-3ec8-4889-9c72-6ee0e2c66afd req-1a45186d-405b-4ddf-a3a6-14f8fdde504e service nova] Creating event network-vif-deleted:58a443b2-b10c-4c0d-b138-65b75997b871 for instance e369a590-728c-4108-9f1c-d685ab4a0c92 on hv-cinder-73306 Mar 08 04:21:44.198413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-78683920-3ec8-4889-9c72-6ee0e2c66afd req-1a45186d-405b-4ddf-a3a6-14f8fdde504e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029012 Mar 08 04:21:44.198996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 205/396] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:44.384922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-66a41f1f-afe7-4652-b3a7-57d5ee150700 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:44.385521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-66a41f1f-afe7-4652-b3a7-57d5ee150700 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:44.392895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66a41f1f-afe7-4652-b3a7-57d5ee150700 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:44.393597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66a41f1f-afe7-4652-b3a7-57d5ee150700 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:44.395972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66a41f1f-afe7-4652-b3a7-57d5ee150700 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:44.396439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66a41f1f-afe7-4652-b3a7-57d5ee150700 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:44.532833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-66a41f1f-afe7-4652-b3a7-57d5ee150700 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:44.541246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-66a41f1f-afe7-4652-b3a7-57d5ee150700 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.160195 Mar 08 04:21:44.545893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 192/397] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:45.039438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-878a7bfb-7c40-4024-8826-2430dc75fda4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:45.040130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-878a7bfb-7c40-4024-8826-2430dc75fda4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: e369a590-728c-4108-9f1c-d685ab4a0c92] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:45.047691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-878a7bfb-7c40-4024-8826-2430dc75fda4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:45.048142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-878a7bfb-7c40-4024-8826-2430dc75fda4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:45.048937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-878a7bfb-7c40-4024-8826-2430dc75fda4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:45.049356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-878a7bfb-7c40-4024-8826-2430dc75fda4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:45.063160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-878a7bfb-7c40-4024-8826-2430dc75fda4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] HTTP exception thrown: Instance e369a590-728c-4108-9f1c-d685ab4a0c92 could not be found. Mar 08 04:21:45.063999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-878a7bfb-7c40-4024-8826-2430dc75fda4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Returning 404 to user: Instance e369a590-728c-4108-9f1c-d685ab4a0c92 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:21:45.064833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-878a7bfb-7c40-4024-8826-2430dc75fda4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92" status: 404 len: 111 microversion: 2.1 time: 0.030339 Mar 08 04:21:45.065729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 206/398] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:45 2022] GET /compute/v2.1/servers/e369a590-728c-4108-9f1c-d685ab4a0c92 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:21:45.558371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-95b55927-c585-4278-b006-6a05bd1c49df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:45.559057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-95b55927-c585-4278-b006-6a05bd1c49df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:45.570270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95b55927-c585-4278-b006-6a05bd1c49df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:45.570724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95b55927-c585-4278-b006-6a05bd1c49df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:45.571737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95b55927-c585-4278-b006-6a05bd1c49df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:45.572387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95b55927-c585-4278-b006-6a05bd1c49df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:45.726111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-95b55927-c585-4278-b006-6a05bd1c49df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:45.734940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-95b55927-c585-4278-b006-6a05bd1c49df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.180740 Mar 08 04:21:45.735688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 193/399] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:46.752833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0ece3830-e0b2-4370-b09a-1a9e940ea67e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:46.753454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0ece3830-e0b2-4370-b09a-1a9e940ea67e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:46.760051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ece3830-e0b2-4370-b09a-1a9e940ea67e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:46.760749 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ece3830-e0b2-4370-b09a-1a9e940ea67e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:46.761525 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ece3830-e0b2-4370-b09a-1a9e940ea67e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:46.761990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ece3830-e0b2-4370-b09a-1a9e940ea67e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:46.919011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0ece3830-e0b2-4370-b09a-1a9e940ea67e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:46.928937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0ece3830-e0b2-4370-b09a-1a9e940ea67e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.180279 Mar 08 04:21:46.930489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 207/400] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:47.946914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e1d8f99d-120a-475f-8736-80ca7a5740f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:47.947706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e1d8f99d-120a-475f-8736-80ca7a5740f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:47.954737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1d8f99d-120a-475f-8736-80ca7a5740f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:47.955535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1d8f99d-120a-475f-8736-80ca7a5740f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:47.956508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1d8f99d-120a-475f-8736-80ca7a5740f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:47.957106 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1d8f99d-120a-475f-8736-80ca7a5740f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:48.112653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e1d8f99d-120a-475f-8736-80ca7a5740f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:48.121133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e1d8f99d-120a-475f-8736-80ca7a5740f5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.178015 Mar 08 04:21:48.122261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 194/401] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:49.139349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3dff2415-4a9c-4cdc-8ce8-c77a2d77771c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:49.140788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3dff2415-4a9c-4cdc-8ce8-c77a2d77771c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:49.147862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3dff2415-4a9c-4cdc-8ce8-c77a2d77771c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:49.148376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3dff2415-4a9c-4cdc-8ce8-c77a2d77771c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:49.149183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3dff2415-4a9c-4cdc-8ce8-c77a2d77771c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:49.149621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3dff2415-4a9c-4cdc-8ce8-c77a2d77771c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:49.322162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3dff2415-4a9c-4cdc-8ce8-c77a2d77771c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:49.331453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3dff2415-4a9c-4cdc-8ce8-c77a2d77771c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.196367 Mar 08 04:21:49.332236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 208/402] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:50.350531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f636e9c2-61ac-4de7-aab4-c7920089dedd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:50.351739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f636e9c2-61ac-4de7-aab4-c7920089dedd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:50.358923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f636e9c2-61ac-4de7-aab4-c7920089dedd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:50.359617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f636e9c2-61ac-4de7-aab4-c7920089dedd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:50.360811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f636e9c2-61ac-4de7-aab4-c7920089dedd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:50.361355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f636e9c2-61ac-4de7-aab4-c7920089dedd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:50.517181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f636e9c2-61ac-4de7-aab4-c7920089dedd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:50.526852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f636e9c2-61ac-4de7-aab4-c7920089dedd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.179942 Mar 08 04:21:50.527708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 195/403] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:50 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:51.553584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9b51de09-ed0b-432a-bd70-5cba9cc4b1e7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:51.554327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9b51de09-ed0b-432a-bd70-5cba9cc4b1e7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:51.565920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b51de09-ed0b-432a-bd70-5cba9cc4b1e7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:51.566781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b51de09-ed0b-432a-bd70-5cba9cc4b1e7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:51.567561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b51de09-ed0b-432a-bd70-5cba9cc4b1e7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:51.567994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b51de09-ed0b-432a-bd70-5cba9cc4b1e7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:51.732775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9b51de09-ed0b-432a-bd70-5cba9cc4b1e7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:51.743581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9b51de09-ed0b-432a-bd70-5cba9cc4b1e7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.195748 Mar 08 04:21:51.744314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 209/404] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:52.766109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8cc460e3-4891-4d29-b9cd-c8aead039735 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:52.766824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8cc460e3-4891-4d29-b9cd-c8aead039735 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:52.773288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8cc460e3-4891-4d29-b9cd-c8aead039735 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:52.773757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8cc460e3-4891-4d29-b9cd-c8aead039735 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:52.774766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8cc460e3-4891-4d29-b9cd-c8aead039735 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:52.775504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8cc460e3-4891-4d29-b9cd-c8aead039735 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:52.924782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8cc460e3-4891-4d29-b9cd-c8aead039735 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:52.934796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8cc460e3-4891-4d29-b9cd-c8aead039735 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.173307 Mar 08 04:21:52.935669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 196/405] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:53.953550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e4e1019e-c285-4bed-9608-20e2f59ad443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:53.954246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e4e1019e-c285-4bed-9608-20e2f59ad443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:53.969105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4e1019e-c285-4bed-9608-20e2f59ad443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:53.969558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4e1019e-c285-4bed-9608-20e2f59ad443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:53.970390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4e1019e-c285-4bed-9608-20e2f59ad443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:53.970825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4e1019e-c285-4bed-9608-20e2f59ad443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:54.111488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e4e1019e-c285-4bed-9608-20e2f59ad443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:54.119770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e4e1019e-c285-4bed-9608-20e2f59ad443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.170979 Mar 08 04:21:54.120349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 210/406] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:55.141288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1758895229", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "networks": [{"uuid": "d5a2bc00-60f7-4e70-97b4-aff42319728f"}]}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:55.143233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-78464b83-78c9-44d0-9f57-443ede5a67fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:55.143924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-78464b83-78c9-44d0-9f57-443ede5a67fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:55.150851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78464b83-78c9-44d0-9f57-443ede5a67fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:55.151827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78464b83-78c9-44d0-9f57-443ede5a67fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:55.152817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78464b83-78c9-44d0-9f57-443ede5a67fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:55.153425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78464b83-78c9-44d0-9f57-443ede5a67fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:55.217976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.network.neutron [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] validate_networks() for [('d5a2bc00-60f7-4e70-97b4-aff42319728f', None, None, None, None, None)] {{(pid=116775) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:21:55.382651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-78464b83-78c9-44d0-9f57-443ede5a67fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:55.399753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-78464b83-78c9-44d0-9f57-443ede5a67fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.266938 Mar 08 04:21:55.413230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 197/407] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:55.742976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Flavor limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:21:55.744125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Image limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:21:55.744941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Flavor pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:21:55.746041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Image pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:21:55.747010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:21:55.761291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:55.762172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:55.763582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:55.764694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:55.796056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Getting quotas for project d987f379b42346f8bab2101aa92d9fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:21:55.802610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Getting quotas for user 7eab40b003f9475982a8e0afe7226d2b and project d987f379b42346f8bab2101aa92d9fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:21:55.820676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Going to run 1 instances... {{(pid=116775) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:21:55.825025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:21:55.917530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1ff261ab-8971-44cf-9a05-51ee73432671 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780027 Mar 08 04:21:55.923701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 211/408] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:21:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:21:55.932868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-122305e1-e7e2-4d21-ae62-0860ebe8501a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:55.934228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-122305e1-e7e2-4d21-ae62-0860ebe8501a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:56.011978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-122305e1-e7e2-4d21-ae62-0860ebe8501a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:56.021412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-122305e1-e7e2-4d21-ae62-0860ebe8501a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1219 microversion: 2.1 time: 0.095631 Mar 08 04:21:56.022901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 198/409] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:55 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:56.422574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-185b76f1-edc5-4ad1-a34f-61895af06ce5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:56.423353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-185b76f1-edc5-4ad1-a34f-61895af06ce5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:56.435120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-185b76f1-edc5-4ad1-a34f-61895af06ce5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:56.435987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-185b76f1-edc5-4ad1-a34f-61895af06ce5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:56.438188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-185b76f1-edc5-4ad1-a34f-61895af06ce5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:56.438856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-185b76f1-edc5-4ad1-a34f-61895af06ce5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:56.597762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-185b76f1-edc5-4ad1-a34f-61895af06ce5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:56.606720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-185b76f1-edc5-4ad1-a34f-61895af06ce5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.190142 Mar 08 04:21:56.607870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 212/410] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:57.053747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e2e3bb3a-f083-4140-ad4a-f2066e9abe48 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:57.055544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e2e3bb3a-f083-4140-ad4a-f2066e9abe48 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:57.080014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2e3bb3a-f083-4140-ad4a-f2066e9abe48 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:57.080529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2e3bb3a-f083-4140-ad4a-f2066e9abe48 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:57.081252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2e3bb3a-f083-4140-ad4a-f2066e9abe48 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:57.082942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2e3bb3a-f083-4140-ad4a-f2066e9abe48 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:57.171652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e2e3bb3a-f083-4140-ad4a-f2066e9abe48 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:57.181057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e2e3bb3a-f083-4140-ad4a-f2066e9abe48 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1279 microversion: 2.1 time: 0.144619 Mar 08 04:21:57.182020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 199/411] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:57 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1279 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:57.625084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b34904c9-1194-46c2-97e7-afff408c3a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:57.625713 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b34904c9-1194-46c2-97e7-afff408c3a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:57.642184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b34904c9-1194-46c2-97e7-afff408c3a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:57.642955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b34904c9-1194-46c2-97e7-afff408c3a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:57.643989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b34904c9-1194-46c2-97e7-afff408c3a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:57.644607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b34904c9-1194-46c2-97e7-afff408c3a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:57.841404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b34904c9-1194-46c2-97e7-afff408c3a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:57.854868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b34904c9-1194-46c2-97e7-afff408c3a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.234072 Mar 08 04:21:57.855857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 213/412] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:58.198503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-13f72b9a-5ab8-406c-bc96-cc7754e5853f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:58.199779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-13f72b9a-5ab8-406c-bc96-cc7754e5853f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:58.207643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13f72b9a-5ab8-406c-bc96-cc7754e5853f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:58.208547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13f72b9a-5ab8-406c-bc96-cc7754e5853f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:58.209534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13f72b9a-5ab8-406c-bc96-cc7754e5853f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:58.210207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13f72b9a-5ab8-406c-bc96-cc7754e5853f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:58.355406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-13f72b9a-5ab8-406c-bc96-cc7754e5853f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:58.364409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-13f72b9a-5ab8-406c-bc96-cc7754e5853f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1319 microversion: 2.1 time: 0.170111 Mar 08 04:21:58.365749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 200/413] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:58 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:58.735766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-ff70937c-af3f-4a50-af78-7a76aa3da307 req-a07d6fc0-dbd2-4ed4-a6c8-708ec2e1cc58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d0c157-7b91-4fe9-aa50-c33e2e1f18ef", "tag": "2771b3b1-8e55-423b-b896-353c71b4a88f"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:21:58.759890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-ff70937c-af3f-4a50-af78-7a76aa3da307 req-a07d6fc0-dbd2-4ed4-a6c8-708ec2e1cc58 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:58.762740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-ff70937c-af3f-4a50-af78-7a76aa3da307 req-a07d6fc0-dbd2-4ed4-a6c8-708ec2e1cc58 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:58.780825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-ff70937c-af3f-4a50-af78-7a76aa3da307 req-a07d6fc0-dbd2-4ed4-a6c8-708ec2e1cc58 service nova] Creating event network-changed:2771b3b1-8e55-423b-b896-353c71b4a88f for instance 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef on hv-cinder-73306 Mar 08 04:21:58.788203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-ff70937c-af3f-4a50-af78-7a76aa3da307 req-a07d6fc0-dbd2-4ed4-a6c8-708ec2e1cc58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056404 Mar 08 04:21:58.789323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 214/414] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:21:58.872455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-97e14c22-18dc-4daf-acae-27fdc3c247f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:58.873464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-97e14c22-18dc-4daf-acae-27fdc3c247f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:58.890543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97e14c22-18dc-4daf-acae-27fdc3c247f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:58.890988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97e14c22-18dc-4daf-acae-27fdc3c247f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:58.891824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97e14c22-18dc-4daf-acae-27fdc3c247f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:58.892266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97e14c22-18dc-4daf-acae-27fdc3c247f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:59.068386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-97e14c22-18dc-4daf-acae-27fdc3c247f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:59.077614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-97e14c22-18dc-4daf-acae-27fdc3c247f6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.208430 Mar 08 04:21:59.078762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 201/415] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:21:59.384704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2def9e86-dfb9-4bab-b775-9961adfae787 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:21:59.386095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2def9e86-dfb9-4bab-b775-9961adfae787 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:21:59.392744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2def9e86-dfb9-4bab-b775-9961adfae787 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:59.393440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2def9e86-dfb9-4bab-b775-9961adfae787 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:59.394430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2def9e86-dfb9-4bab-b775-9961adfae787 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:21:59.395044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2def9e86-dfb9-4bab-b775-9961adfae787 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:21:59.563805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2def9e86-dfb9-4bab-b775-9961adfae787 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:21:59.573586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2def9e86-dfb9-4bab-b775-9961adfae787 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1319 microversion: 2.1 time: 0.192962 Mar 08 04:21:59.574940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 215/416] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:21:59 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:00.095942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2e66c8b1-ed9e-439a-8876-e76dc187b8d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:00.096527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2e66c8b1-ed9e-439a-8876-e76dc187b8d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:00.115407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e66c8b1-ed9e-439a-8876-e76dc187b8d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:00.115860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e66c8b1-ed9e-439a-8876-e76dc187b8d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:00.116860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e66c8b1-ed9e-439a-8876-e76dc187b8d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:00.117313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e66c8b1-ed9e-439a-8876-e76dc187b8d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:00.305629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2e66c8b1-ed9e-439a-8876-e76dc187b8d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:00.315174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2e66c8b1-ed9e-439a-8876-e76dc187b8d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.224036 Mar 08 04:22:00.316182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 202/417] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:00.594593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7464694e-69e5-4a0f-9732-4a8ecc8e3460 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:00.595449 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7464694e-69e5-4a0f-9732-4a8ecc8e3460 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:00.602610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7464694e-69e5-4a0f-9732-4a8ecc8e3460 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:00.603212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7464694e-69e5-4a0f-9732-4a8ecc8e3460 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:00.604187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7464694e-69e5-4a0f-9732-4a8ecc8e3460 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:00.604626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7464694e-69e5-4a0f-9732-4a8ecc8e3460 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:00.786350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7464694e-69e5-4a0f-9732-4a8ecc8e3460 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:00.794336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7464694e-69e5-4a0f-9732-4a8ecc8e3460 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1319 microversion: 2.1 time: 0.206045 Mar 08 04:22:00.795373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 216/418] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:00 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:22:01.353653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f90a035d-b83b-4a2f-88df-9f7a03d2c08a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:01.354214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f90a035d-b83b-4a2f-88df-9f7a03d2c08a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:01.361159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f90a035d-b83b-4a2f-88df-9f7a03d2c08a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:01.361602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f90a035d-b83b-4a2f-88df-9f7a03d2c08a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:01.362381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f90a035d-b83b-4a2f-88df-9f7a03d2c08a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:01.362812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f90a035d-b83b-4a2f-88df-9f7a03d2c08a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:01.494324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f90a035d-b83b-4a2f-88df-9f7a03d2c08a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:01.502064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f90a035d-b83b-4a2f-88df-9f7a03d2c08a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.152261 Mar 08 04:22:01.502629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 203/419] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:01.811717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4e9b6af1-ecbc-4513-9b12-680be2582ac3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:01.812353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4e9b6af1-ecbc-4513-9b12-680be2582ac3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:01.818546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e9b6af1-ecbc-4513-9b12-680be2582ac3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:01.819072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e9b6af1-ecbc-4513-9b12-680be2582ac3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:01.819846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e9b6af1-ecbc-4513-9b12-680be2582ac3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:01.820284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e9b6af1-ecbc-4513-9b12-680be2582ac3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:01.955437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4e9b6af1-ecbc-4513-9b12-680be2582ac3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:01.962653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4e9b6af1-ecbc-4513-9b12-680be2582ac3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1319 microversion: 2.1 time: 0.154676 Mar 08 04:22:01.963223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 217/420] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:01 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:02.519181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0964ee58-54da-4580-820f-96cf1af11684 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:02.519843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0964ee58-54da-4580-820f-96cf1af11684 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:02.526360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0964ee58-54da-4580-820f-96cf1af11684 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:02.526761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0964ee58-54da-4580-820f-96cf1af11684 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:02.527658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0964ee58-54da-4580-820f-96cf1af11684 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:02.528156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0964ee58-54da-4580-820f-96cf1af11684 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:02.662398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0964ee58-54da-4580-820f-96cf1af11684 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:02.669969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0964ee58-54da-4580-820f-96cf1af11684 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.154751 Mar 08 04:22:02.670668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 204/421] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:02.979863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d997163f-48e3-4f38-bdd6-579cb5dff406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:02.980474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d997163f-48e3-4f38-bdd6-579cb5dff406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:02.987347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d997163f-48e3-4f38-bdd6-579cb5dff406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:02.987796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d997163f-48e3-4f38-bdd6-579cb5dff406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:02.988559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d997163f-48e3-4f38-bdd6-579cb5dff406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:02.988992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d997163f-48e3-4f38-bdd6-579cb5dff406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:03.121163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d997163f-48e3-4f38-bdd6-579cb5dff406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:03.128320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d997163f-48e3-4f38-bdd6-579cb5dff406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1319 microversion: 2.1 time: 0.152353 Mar 08 04:22:03.128869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 218/422] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:02 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:03.687921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a8f1b405-2cac-4944-ad5b-97f8d8f52108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:03.688532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a8f1b405-2cac-4944-ad5b-97f8d8f52108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:03.694771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f1b405-2cac-4944-ad5b-97f8d8f52108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:03.695225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f1b405-2cac-4944-ad5b-97f8d8f52108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:03.695999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f1b405-2cac-4944-ad5b-97f8d8f52108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:03.696650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f1b405-2cac-4944-ad5b-97f8d8f52108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:03.932108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a8f1b405-2cac-4944-ad5b-97f8d8f52108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:03.943234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a8f1b405-2cac-4944-ad5b-97f8d8f52108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.259667 Mar 08 04:22:03.948217 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 205/423] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:04.145323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-adff4af9-c3b6-4e96-834c-8e0c3cd06eb2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:04.145960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-adff4af9-c3b6-4e96-834c-8e0c3cd06eb2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:04.152407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adff4af9-c3b6-4e96-834c-8e0c3cd06eb2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:04.152858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adff4af9-c3b6-4e96-834c-8e0c3cd06eb2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:04.153630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adff4af9-c3b6-4e96-834c-8e0c3cd06eb2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:04.154091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adff4af9-c3b6-4e96-834c-8e0c3cd06eb2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:04.329619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-adff4af9-c3b6-4e96-834c-8e0c3cd06eb2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:04.337070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-adff4af9-c3b6-4e96-834c-8e0c3cd06eb2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1319 microversion: 2.1 time: 0.195716 Mar 08 04:22:04.337620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 219/424] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:04 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:22:04.960062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-edb23224-310e-433b-a55d-8f914a4d8836 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:04.960665 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-edb23224-310e-433b-a55d-8f914a4d8836 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:04.966824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-edb23224-310e-433b-a55d-8f914a4d8836 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:04.967277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-edb23224-310e-433b-a55d-8f914a4d8836 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:04.968041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-edb23224-310e-433b-a55d-8f914a4d8836 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:04.968478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-edb23224-310e-433b-a55d-8f914a4d8836 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:05.101158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-edb23224-310e-433b-a55d-8f914a4d8836 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:05.109132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-edb23224-310e-433b-a55d-8f914a4d8836 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.152739 Mar 08 04:22:05.109723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 206/425] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:05.355771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-70853061-bfca-497c-888f-d26d5144e797 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:05.356981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-70853061-bfca-497c-888f-d26d5144e797 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:05.364155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-70853061-bfca-497c-888f-d26d5144e797 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:05.364720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-70853061-bfca-497c-888f-d26d5144e797 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:05.365847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-70853061-bfca-497c-888f-d26d5144e797 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:05.366625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-70853061-bfca-497c-888f-d26d5144e797 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:05.429367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-d9d0301e-4583-4537-91d1-804926ba253d req-8023e3ca-b3ed-4789-8f59-e494307cd2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d0c157-7b91-4fe9-aa50-c33e2e1f18ef", "name": "network-vif-plugged", "status": "completed", "tag": "2771b3b1-8e55-423b-b896-353c71b4a88f"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:22:05.444651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-d9d0301e-4583-4537-91d1-804926ba253d req-8023e3ca-b3ed-4789-8f59-e494307cd2c2 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:05.446581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-d9d0301e-4583-4537-91d1-804926ba253d req-8023e3ca-b3ed-4789-8f59-e494307cd2c2 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:05.464020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-d9d0301e-4583-4537-91d1-804926ba253d req-8023e3ca-b3ed-4789-8f59-e494307cd2c2 service nova] Creating event network-vif-plugged:2771b3b1-8e55-423b-b896-353c71b4a88f for instance 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef on hv-cinder-73306 Mar 08 04:22:05.470906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-d9d0301e-4583-4537-91d1-804926ba253d req-8023e3ca-b3ed-4789-8f59-e494307cd2c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045555 Mar 08 04:22:05.472265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 207/426] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:05.534730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-70853061-bfca-497c-888f-d26d5144e797 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:05.552267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-70853061-bfca-497c-888f-d26d5144e797 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1319 microversion: 2.1 time: 0.201252 Mar 08 04:22:05.552869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 220/427] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:05 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:06.127415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-43e4fcbc-329d-47bd-8a83-35245d9b78c8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:06.128043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-43e4fcbc-329d-47bd-8a83-35245d9b78c8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:06.134535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-43e4fcbc-329d-47bd-8a83-35245d9b78c8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:06.134984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-43e4fcbc-329d-47bd-8a83-35245d9b78c8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:06.135751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-43e4fcbc-329d-47bd-8a83-35245d9b78c8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:06.136188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-43e4fcbc-329d-47bd-8a83-35245d9b78c8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:06.267182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-43e4fcbc-329d-47bd-8a83-35245d9b78c8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:06.274796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-43e4fcbc-329d-47bd-8a83-35245d9b78c8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.152379 Mar 08 04:22:06.275358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 208/428] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:06.568475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9a79e394-8506-46a4-aae2-1bc26d4ac29d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:06.569081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9a79e394-8506-46a4-aae2-1bc26d4ac29d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:06.575666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9a79e394-8506-46a4-aae2-1bc26d4ac29d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:06.576102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9a79e394-8506-46a4-aae2-1bc26d4ac29d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:06.576966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9a79e394-8506-46a4-aae2-1bc26d4ac29d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:06.577407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9a79e394-8506-46a4-aae2-1bc26d4ac29d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:06.720614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9a79e394-8506-46a4-aae2-1bc26d4ac29d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:06.727854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9a79e394-8506-46a4-aae2-1bc26d4ac29d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1319 microversion: 2.1 time: 0.163189 Mar 08 04:22:06.728416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 221/429] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:06 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:07.291929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-21270d3f-5400-404a-9836-f38cb25a6379 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:07.292534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-21270d3f-5400-404a-9836-f38cb25a6379 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:07.298845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21270d3f-5400-404a-9836-f38cb25a6379 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:07.299298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21270d3f-5400-404a-9836-f38cb25a6379 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:07.300063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21270d3f-5400-404a-9836-f38cb25a6379 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:07.300505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21270d3f-5400-404a-9836-f38cb25a6379 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:07.429389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-21270d3f-5400-404a-9836-f38cb25a6379 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:07.437968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-21270d3f-5400-404a-9836-f38cb25a6379 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.149877 Mar 08 04:22:07.438528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 209/430] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:07.744578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ab2cb844-bd37-4d94-9dfd-553bbc4025a4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:07.745188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ab2cb844-bd37-4d94-9dfd-553bbc4025a4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:07.752130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab2cb844-bd37-4d94-9dfd-553bbc4025a4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:07.752577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab2cb844-bd37-4d94-9dfd-553bbc4025a4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:07.753338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab2cb844-bd37-4d94-9dfd-553bbc4025a4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:07.753796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab2cb844-bd37-4d94-9dfd-553bbc4025a4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:07.890171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ab2cb844-bd37-4d94-9dfd-553bbc4025a4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:07.899048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ab2cb844-bd37-4d94-9dfd-553bbc4025a4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1507 microversion: 2.1 time: 0.158570 Mar 08 04:22:07.899607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 222/431] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:07 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:07.916408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9f2f8fd4-65a3-40c9-a512-2d06d0658a6d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00a2f503-8d11-475a-b09f-35f61659ba75", "device": "/dev/sdb"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:22:07.917494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9f2f8fd4-65a3-40c9-a512-2d06d0658a6d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:07.923443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f2f8fd4-65a3-40c9-a512-2d06d0658a6d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:07.923897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f2f8fd4-65a3-40c9-a512-2d06d0658a6d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:07.924668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f2f8fd4-65a3-40c9-a512-2d06d0658a6d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:07.925106 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f2f8fd4-65a3-40c9-a512-2d06d0658a6d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:08.454850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2d139f06-cc86-45ca-a81f-eed4fbac7925 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:08.455457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2d139f06-cc86-45ca-a81f-eed4fbac7925 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:08.461260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2d139f06-cc86-45ca-a81f-eed4fbac7925 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:08.461732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2d139f06-cc86-45ca-a81f-eed4fbac7925 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:08.462491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2d139f06-cc86-45ca-a81f-eed4fbac7925 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:08.462928 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2d139f06-cc86-45ca-a81f-eed4fbac7925 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:08.594258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2d139f06-cc86-45ca-a81f-eed4fbac7925 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:08.601892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2d139f06-cc86-45ca-a81f-eed4fbac7925 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.151073 Mar 08 04:22:08.602448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 223/432] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:22:09.083486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9f2f8fd4-65a3-40c9-a512-2d06d0658a6d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "POST /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.170764 Mar 08 04:22:09.084293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 210/433] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:22:07 2022] POST /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments => generated 194 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:09.619256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ee1c1ae9-0ec2-4620-8eb4-f35baf545a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:09.619863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ee1c1ae9-0ec2-4620-8eb4-f35baf545a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:09.626800 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee1c1ae9-0ec2-4620-8eb4-f35baf545a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:09.627268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee1c1ae9-0ec2-4620-8eb4-f35baf545a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:09.628013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee1c1ae9-0ec2-4620-8eb4-f35baf545a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:09.628449 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee1c1ae9-0ec2-4620-8eb4-f35baf545a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:09.757366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ee1c1ae9-0ec2-4620-8eb4-f35baf545a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:09.766117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ee1c1ae9-0ec2-4620-8eb4-f35baf545a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.150725 Mar 08 04:22:09.766685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 224/434] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:09 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:10.785366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ab8b4419-8612-43b1-845e-7d5a2d613a3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:10.786010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ab8b4419-8612-43b1-845e-7d5a2d613a3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:10.792618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ab8b4419-8612-43b1-845e-7d5a2d613a3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:10.793070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ab8b4419-8612-43b1-845e-7d5a2d613a3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:10.793859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ab8b4419-8612-43b1-845e-7d5a2d613a3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:10.794292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ab8b4419-8612-43b1-845e-7d5a2d613a3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:10.931859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ab8b4419-8612-43b1-845e-7d5a2d613a3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:10.940170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ab8b4419-8612-43b1-845e-7d5a2d613a3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.161052 Mar 08 04:22:10.940747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 211/435] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:11.957979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-018ca383-adc2-4b2e-829f-8d5b7c56cf74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:11.958580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-018ca383-adc2-4b2e-829f-8d5b7c56cf74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:11.964779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-018ca383-adc2-4b2e-829f-8d5b7c56cf74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:11.965223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-018ca383-adc2-4b2e-829f-8d5b7c56cf74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:11.966004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-018ca383-adc2-4b2e-829f-8d5b7c56cf74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:11.966441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-018ca383-adc2-4b2e-829f-8d5b7c56cf74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:12.097649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-018ca383-adc2-4b2e-829f-8d5b7c56cf74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:12.107908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-018ca383-adc2-4b2e-829f-8d5b7c56cf74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.153699 Mar 08 04:22:12.108588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 225/436] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:13.124506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-837aecec-5b71-4031-a51a-62cfb2ced388 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:13.125095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-837aecec-5b71-4031-a51a-62cfb2ced388 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:13.131314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-837aecec-5b71-4031-a51a-62cfb2ced388 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:13.131759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-837aecec-5b71-4031-a51a-62cfb2ced388 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:13.132535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-837aecec-5b71-4031-a51a-62cfb2ced388 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:13.132958 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-837aecec-5b71-4031-a51a-62cfb2ced388 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:13.275342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-837aecec-5b71-4031-a51a-62cfb2ced388 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:13.284428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-837aecec-5b71-4031-a51a-62cfb2ced388 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1548 microversion: 2.1 time: 0.163837 Mar 08 04:22:13.285001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 212/437] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:13.302556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c01a7e9a-2d1e-4dcc-8df4-8424271bedb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:13.303091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c01a7e9a-2d1e-4dcc-8df4-8424271bedb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:13.309588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c01a7e9a-2d1e-4dcc-8df4-8424271bedb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:13.310506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c01a7e9a-2d1e-4dcc-8df4-8424271bedb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:13.311375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c01a7e9a-2d1e-4dcc-8df4-8424271bedb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:13.312020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c01a7e9a-2d1e-4dcc-8df4-8424271bedb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:13.409788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-c01a7e9a-2d1e-4dcc-8df4-8424271bedb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] HTTP exception thrown: Cannot 'detach_volume' instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 while it is in vm_state rescued Mar 08 04:22:13.410371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c01a7e9a-2d1e-4dcc-8df4-8424271bedb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Returning 409 to user: Cannot 'detach_volume' instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 while it is in vm_state rescued {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:22:13.411316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c01a7e9a-2d1e-4dcc-8df4-8424271bedb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments/f0d3412e-507c-447c-9df9-95f37e221809" status: 409 len: 152 microversion: 2.1 time: 0.113091 Mar 08 04:22:13.411860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 226/438] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:22:13 2022] DELETE /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments/f0d3412e-507c-447c-9df9-95f37e221809 => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 08 04:22:13.420276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2864f843-cfea-4b4d-bc01-d42eda8b7481 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:22:13.420924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2864f843-cfea-4b4d-bc01-d42eda8b7481 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:13.426751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2864f843-cfea-4b4d-bc01-d42eda8b7481 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:13.427278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2864f843-cfea-4b4d-bc01-d42eda8b7481 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:13.428122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2864f843-cfea-4b4d-bc01-d42eda8b7481 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:13.428648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2864f843-cfea-4b4d-bc01-d42eda8b7481 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:13.497207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2864f843-cfea-4b4d-bc01-d42eda8b7481 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action" status: 202 len: 0 microversion: 2.1 time: 0.080655 Mar 08 04:22:13.498982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 213/439] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:22:13 2022] POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:22:13.508227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bc89e529-a631-4a80-b9ff-b95f9624ba26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:13.508845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bc89e529-a631-4a80-b9ff-b95f9624ba26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:13.516846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bc89e529-a631-4a80-b9ff-b95f9624ba26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:13.517587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bc89e529-a631-4a80-b9ff-b95f9624ba26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:13.518900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bc89e529-a631-4a80-b9ff-b95f9624ba26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:13.519327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bc89e529-a631-4a80-b9ff-b95f9624ba26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:13.711316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bc89e529-a631-4a80-b9ff-b95f9624ba26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:13.719376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bc89e529-a631-4a80-b9ff-b95f9624ba26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1556 microversion: 2.1 time: 0.215133 Mar 08 04:22:13.720182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 227/440] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:14.737190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1a99ee8f-0bc2-4041-85b3-ecd6a22eb2d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:14.737944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1a99ee8f-0bc2-4041-85b3-ecd6a22eb2d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:14.745204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a99ee8f-0bc2-4041-85b3-ecd6a22eb2d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:14.745825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a99ee8f-0bc2-4041-85b3-ecd6a22eb2d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:14.746994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a99ee8f-0bc2-4041-85b3-ecd6a22eb2d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:14.747431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a99ee8f-0bc2-4041-85b3-ecd6a22eb2d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:14.884322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1a99ee8f-0bc2-4041-85b3-ecd6a22eb2d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:14.892748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1a99ee8f-0bc2-4041-85b3-ecd6a22eb2d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1556 microversion: 2.1 time: 0.159914 Mar 08 04:22:14.893302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 214/441] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:15.910457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-20f856af-f86a-4e4a-94e2-ed13cadd1817 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:15.911176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-20f856af-f86a-4e4a-94e2-ed13cadd1817 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:15.917338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20f856af-f86a-4e4a-94e2-ed13cadd1817 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:15.917820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20f856af-f86a-4e4a-94e2-ed13cadd1817 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:15.918573 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20f856af-f86a-4e4a-94e2-ed13cadd1817 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:15.919001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20f856af-f86a-4e4a-94e2-ed13cadd1817 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:16.046649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-20f856af-f86a-4e4a-94e2-ed13cadd1817 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:16.054194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-20f856af-f86a-4e4a-94e2-ed13cadd1817 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1556 microversion: 2.1 time: 0.147834 Mar 08 04:22:16.054758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 228/442] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:17.070956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-aba5d3a7-049a-4b84-8709-64888522730a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:17.071518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-aba5d3a7-049a-4b84-8709-64888522730a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:17.078655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aba5d3a7-049a-4b84-8709-64888522730a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:17.079101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aba5d3a7-049a-4b84-8709-64888522730a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:17.079860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aba5d3a7-049a-4b84-8709-64888522730a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:17.080290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aba5d3a7-049a-4b84-8709-64888522730a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:17.210664 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-aba5d3a7-049a-4b84-8709-64888522730a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:17.218840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-aba5d3a7-049a-4b84-8709-64888522730a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1562 microversion: 2.1 time: 0.151757 Mar 08 04:22:17.219408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 215/443] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:17.286249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-db5bd67f-cf45-42cf-8cfd-d15a4d8825d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:17.286791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-db5bd67f-cf45-42cf-8cfd-d15a4d8825d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:17.292930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db5bd67f-cf45-42cf-8cfd-d15a4d8825d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:17.293380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db5bd67f-cf45-42cf-8cfd-d15a4d8825d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:17.294183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db5bd67f-cf45-42cf-8cfd-d15a4d8825d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:17.295177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db5bd67f-cf45-42cf-8cfd-d15a4d8825d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:17.371639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-db5bd67f-cf45-42cf-8cfd-d15a4d8825d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lazy-loading 'services' on Instance uuid 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:22:17.438757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-db5bd67f-cf45-42cf-8cfd-d15a4d8825d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments/f0d3412e-507c-447c-9df9-95f37e221809" status: 202 len: 0 microversion: 2.1 time: 0.156220 Mar 08 04:22:17.439355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 229/444] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:22:17 2022] DELETE /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments/f0d3412e-507c-447c-9df9-95f37e221809 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:22:17.447596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-345b8e6a-d54f-4345-abca-2c1703760080 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:17.448607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-345b8e6a-d54f-4345-abca-2c1703760080 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:17.455179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-345b8e6a-d54f-4345-abca-2c1703760080 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:17.455625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-345b8e6a-d54f-4345-abca-2c1703760080 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:17.456398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-345b8e6a-d54f-4345-abca-2c1703760080 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:17.456835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-345b8e6a-d54f-4345-abca-2c1703760080 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:17.486915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-345b8e6a-d54f-4345-abca-2c1703760080 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043238 Mar 08 04:22:17.487770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 216/445] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:18.500103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-124519ac-c650-4148-a324-065e3ad5e50b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:18.501140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-124519ac-c650-4148-a324-065e3ad5e50b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:18.507143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-124519ac-c650-4148-a324-065e3ad5e50b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:18.507585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-124519ac-c650-4148-a324-065e3ad5e50b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:18.508334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-124519ac-c650-4148-a324-065e3ad5e50b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:18.508764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-124519ac-c650-4148-a324-065e3ad5e50b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:18.536727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-124519ac-c650-4148-a324-065e3ad5e50b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041964 Mar 08 04:22:18.537255 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 230/446] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:19.548886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c941cfe5-89af-4ff3-8371-c8d38e43eb1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:19.549865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c941cfe5-89af-4ff3-8371-c8d38e43eb1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:19.556086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c941cfe5-89af-4ff3-8371-c8d38e43eb1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:19.556530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c941cfe5-89af-4ff3-8371-c8d38e43eb1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:19.557292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c941cfe5-89af-4ff3-8371-c8d38e43eb1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:19.557761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c941cfe5-89af-4ff3-8371-c8d38e43eb1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:19.585403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c941cfe5-89af-4ff3-8371-c8d38e43eb1d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041200 Mar 08 04:22:19.585978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 217/447] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:20.596850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f39855a5-1881-4173-b838-6f3e412e549d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:20.597791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f39855a5-1881-4173-b838-6f3e412e549d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:20.604030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f39855a5-1881-4173-b838-6f3e412e549d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:20.604484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f39855a5-1881-4173-b838-6f3e412e549d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:20.605254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f39855a5-1881-4173-b838-6f3e412e549d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:20.605716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f39855a5-1881-4173-b838-6f3e412e549d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:20.634517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f39855a5-1881-4173-b838-6f3e412e549d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 Mar 08 04:22:20.635066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 231/448] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:20 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:21.646011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d5a8b420-a080-4e78-8d97-234cbe072631 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:21.646926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d5a8b420-a080-4e78-8d97-234cbe072631 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:21.653137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5a8b420-a080-4e78-8d97-234cbe072631 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:21.654149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5a8b420-a080-4e78-8d97-234cbe072631 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:21.654924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5a8b420-a080-4e78-8d97-234cbe072631 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:21.655362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5a8b420-a080-4e78-8d97-234cbe072631 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:21.683316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d5a8b420-a080-4e78-8d97-234cbe072631 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041306 Mar 08 04:22:21.683855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 218/449] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:21 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:22.695554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6e318622-ba74-4a4f-b6e6-83278f78020a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:22.696470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6e318622-ba74-4a4f-b6e6-83278f78020a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:22.703360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6e318622-ba74-4a4f-b6e6-83278f78020a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:22.703811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6e318622-ba74-4a4f-b6e6-83278f78020a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:22.704576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6e318622-ba74-4a4f-b6e6-83278f78020a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:22.705012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6e318622-ba74-4a4f-b6e6-83278f78020a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:22.733292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6e318622-ba74-4a4f-b6e6-83278f78020a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041633 Mar 08 04:22:22.733871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 232/450] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:23.744507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-327e96e6-3a25-4c3b-9d79-c04767522c93 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:23.745421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-327e96e6-3a25-4c3b-9d79-c04767522c93 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:23.751825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-327e96e6-3a25-4c3b-9d79-c04767522c93 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:23.752278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-327e96e6-3a25-4c3b-9d79-c04767522c93 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:23.753052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-327e96e6-3a25-4c3b-9d79-c04767522c93 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:23.753498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-327e96e6-3a25-4c3b-9d79-c04767522c93 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:23.781853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-327e96e6-3a25-4c3b-9d79-c04767522c93 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041268 Mar 08 04:22:23.782401 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 219/451] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:24.793282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bab23ff8-009c-41fa-843a-55a76278304a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:24.794906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bab23ff8-009c-41fa-843a-55a76278304a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:24.801014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bab23ff8-009c-41fa-843a-55a76278304a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:24.801457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bab23ff8-009c-41fa-843a-55a76278304a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:24.802253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bab23ff8-009c-41fa-843a-55a76278304a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:24.802683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bab23ff8-009c-41fa-843a-55a76278304a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:24.831193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bab23ff8-009c-41fa-843a-55a76278304a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 Mar 08 04:22:24.831737 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 233/452] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:24 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:25.843368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4d61aded-751d-4e37-886c-b12c1c82ebd0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:25.844916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4d61aded-751d-4e37-886c-b12c1c82ebd0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:25.852665 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d61aded-751d-4e37-886c-b12c1c82ebd0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:25.853114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d61aded-751d-4e37-886c-b12c1c82ebd0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:25.853923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d61aded-751d-4e37-886c-b12c1c82ebd0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:25.854365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d61aded-751d-4e37-886c-b12c1c82ebd0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:25.883297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4d61aded-751d-4e37-886c-b12c1c82ebd0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Mar 08 04:22:25.883820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 220/453] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:25 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:26.894893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d9de421a-06ac-4af4-ae47-853cb6c3223d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:26.895803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d9de421a-06ac-4af4-ae47-853cb6c3223d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:26.902015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9de421a-06ac-4af4-ae47-853cb6c3223d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:26.902461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9de421a-06ac-4af4-ae47-853cb6c3223d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:26.903216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9de421a-06ac-4af4-ae47-853cb6c3223d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:26.904288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9de421a-06ac-4af4-ae47-853cb6c3223d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:26.934044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d9de421a-06ac-4af4-ae47-853cb6c3223d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043067 Mar 08 04:22:26.935102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 234/454] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:27.946395 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f243d899-61a6-49b6-9190-b1cc93ced23b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:27.947301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f243d899-61a6-49b6-9190-b1cc93ced23b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:27.954113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f243d899-61a6-49b6-9190-b1cc93ced23b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:27.954558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f243d899-61a6-49b6-9190-b1cc93ced23b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:27.955322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f243d899-61a6-49b6-9190-b1cc93ced23b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:27.955755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f243d899-61a6-49b6-9190-b1cc93ced23b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:27.983597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f243d899-61a6-49b6-9190-b1cc93ced23b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041196 Mar 08 04:22:27.984138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 221/455] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:27 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:28.995592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-22ea1a4d-a1e7-4339-ae03-fdb36873e5f2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:28.996492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-22ea1a4d-a1e7-4339-ae03-fdb36873e5f2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:29.003243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22ea1a4d-a1e7-4339-ae03-fdb36873e5f2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:29.003687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22ea1a4d-a1e7-4339-ae03-fdb36873e5f2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:29.004442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22ea1a4d-a1e7-4339-ae03-fdb36873e5f2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:29.004873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22ea1a4d-a1e7-4339-ae03-fdb36873e5f2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:29.034620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-22ea1a4d-a1e7-4339-ae03-fdb36873e5f2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042957 Mar 08 04:22:29.035175 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 235/456] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:29.552839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d3cb5a1f-e011-49b4-8a2b-c757811f059b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:29.553582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d3cb5a1f-e011-49b4-8a2b-c757811f059b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:29.560498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d3cb5a1f-e011-49b4-8a2b-c757811f059b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:29.560975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d3cb5a1f-e011-49b4-8a2b-c757811f059b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:29.561789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d3cb5a1f-e011-49b4-8a2b-c757811f059b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:29.562230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d3cb5a1f-e011-49b4-8a2b-c757811f059b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:29.683014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-d3cb5a1f-e011-49b4-8a2b-c757811f059b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lazy-loading 'services' on Instance uuid 94db79bc-24f2-47d5-9d3b-f0a2c9da754f {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:22:29.794786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d3cb5a1f-e011-49b4-8a2b-c757811f059b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments/56c45444-90a5-4de0-85de-95176ec10068" status: 202 len: 0 microversion: 2.1 time: 0.245070 Mar 08 04:22:29.795368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 222/457] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:22:29 2022] DELETE /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments/56c45444-90a5-4de0-85de-95176ec10068 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:22:29.901612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-187cc461-cfa1-4d64-a025-0826c96dc875 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:29.902187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-187cc461-cfa1-4d64-a025-0826c96dc875 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:29.909170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-187cc461-cfa1-4d64-a025-0826c96dc875 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:29.909611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-187cc461-cfa1-4d64-a025-0826c96dc875 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:29.910417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-187cc461-cfa1-4d64-a025-0826c96dc875 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:29.910977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-187cc461-cfa1-4d64-a025-0826c96dc875 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:29.933320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-187cc461-cfa1-4d64-a025-0826c96dc875 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184/ips" status: 200 len: 150 microversion: 2.1 time: 0.035600 Mar 08 04:22:29.933892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 236/458] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:22:29 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:29.944898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-239357c2-29d9-4fff-9281-e03da460f69b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61f29fdb-515f-43d6-ab43-06e46b979899"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:22:29.946126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-239357c2-29d9-4fff-9281-e03da460f69b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:29.952233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-239357c2-29d9-4fff-9281-e03da460f69b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:29.952675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-239357c2-29d9-4fff-9281-e03da460f69b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:29.953434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-239357c2-29d9-4fff-9281-e03da460f69b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:29.953899 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-239357c2-29d9-4fff-9281-e03da460f69b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:30.030254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-239357c2-29d9-4fff-9281-e03da460f69b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Invalid volume: volume 61f29fdb-515f-43d6-ab43-06e46b979899 is already attached to instances: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 Mar 08 04:22:30.030850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-239357c2-29d9-4fff-9281-e03da460f69b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 400 to user: Invalid volume: volume 61f29fdb-515f-43d6-ab43-06e46b979899 is already attached to instances: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:22:30.031932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-239357c2-29d9-4fff-9281-e03da460f69b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091403 Mar 08 04:22:30.032477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 223/459] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:22:29 2022] POST /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:22:30.041083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-508948b7-1c61-4677-82ec-a33062982c04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:30.041608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-508948b7-1c61-4677-82ec-a33062982c04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:30.046242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a3199c60-e1f6-4b35-88e6-ab7d9d5b58ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:30.047218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a3199c60-e1f6-4b35-88e6-ab7d9d5b58ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:30.048760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-508948b7-1c61-4677-82ec-a33062982c04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:30.049215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-508948b7-1c61-4677-82ec-a33062982c04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:30.050156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-508948b7-1c61-4677-82ec-a33062982c04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:30.050601 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-508948b7-1c61-4677-82ec-a33062982c04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:30.053579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3199c60-e1f6-4b35-88e6-ab7d9d5b58ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:30.054054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3199c60-e1f6-4b35-88e6-ab7d9d5b58ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:30.054831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3199c60-e1f6-4b35-88e6-ab7d9d5b58ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:30.055274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3199c60-e1f6-4b35-88e6-ab7d9d5b58ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:30.075846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-508948b7-1c61-4677-82ec-a33062982c04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:22:30.085368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a3199c60-e1f6-4b35-88e6-ab7d9d5b58ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Mar 08 04:22:30.086171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 224/460] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:30 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:22:30.150258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-508948b7-1c61-4677-82ec-a33062982c04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 204 len: 0 microversion: 2.1 time: 0.113019 Mar 08 04:22:30.150829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 237/461] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:22:30 2022] DELETE /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:22:30.159284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-be91ac9c-78be-4c40-90b0-7f15515ca7e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:30.159973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-be91ac9c-78be-4c40-90b0-7f15515ca7e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:30.167508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be91ac9c-78be-4c40-90b0-7f15515ca7e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:30.167952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be91ac9c-78be-4c40-90b0-7f15515ca7e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:30.169278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be91ac9c-78be-4c40-90b0-7f15515ca7e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:30.169737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be91ac9c-78be-4c40-90b0-7f15515ca7e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:30.300123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-be91ac9c-78be-4c40-90b0-7f15515ca7e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:30.307466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-be91ac9c-78be-4c40-90b0-7f15515ca7e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1681 microversion: 2.1 time: 0.152174 Mar 08 04:22:30.307962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 225/462] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:30 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:31.096887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4266b975-00ce-4baa-9c88-11a63ae9ef27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:31.098017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4266b975-00ce-4baa-9c88-11a63ae9ef27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:31.104291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4266b975-00ce-4baa-9c88-11a63ae9ef27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:31.104782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4266b975-00ce-4baa-9c88-11a63ae9ef27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:31.105563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4266b975-00ce-4baa-9c88-11a63ae9ef27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:31.106017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4266b975-00ce-4baa-9c88-11a63ae9ef27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:31.136249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4266b975-00ce-4baa-9c88-11a63ae9ef27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Mar 08 04:22:31.136798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 238/463] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:31.325593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-04aa35b0-d0f7-4c78-b98f-4a55d20820f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:31.326155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-04aa35b0-d0f7-4c78-b98f-4a55d20820f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:31.332386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04aa35b0-d0f7-4c78-b98f-4a55d20820f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:31.332831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04aa35b0-d0f7-4c78-b98f-4a55d20820f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:31.333588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04aa35b0-d0f7-4c78-b98f-4a55d20820f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:31.334085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04aa35b0-d0f7-4c78-b98f-4a55d20820f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:31.461836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-04aa35b0-d0f7-4c78-b98f-4a55d20820f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:31.469484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-04aa35b0-d0f7-4c78-b98f-4a55d20820f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1681 microversion: 2.1 time: 0.147837 Mar 08 04:22:31.470076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 226/464] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:31 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:32.147901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-90839913-da4a-4527-bc0d-3fed52c780e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:32.148814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-90839913-da4a-4527-bc0d-3fed52c780e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:32.155778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90839913-da4a-4527-bc0d-3fed52c780e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:32.156599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90839913-da4a-4527-bc0d-3fed52c780e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:32.157446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90839913-da4a-4527-bc0d-3fed52c780e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:32.157901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90839913-da4a-4527-bc0d-3fed52c780e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:32.186707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-90839913-da4a-4527-bc0d-3fed52c780e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042852 Mar 08 04:22:32.187268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 239/465] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:22:32.488456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ca7e2e70-4f2a-426f-b45f-6632dd942f36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:32.489386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ca7e2e70-4f2a-426f-b45f-6632dd942f36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:32.497774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e70-4f2a-426f-b45f-6632dd942f36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:32.498568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e70-4f2a-426f-b45f-6632dd942f36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:32.499585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e70-4f2a-426f-b45f-6632dd942f36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:32.500072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e70-4f2a-426f-b45f-6632dd942f36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:32.577074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ca7e2e70-4f2a-426f-b45f-6632dd942f36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:22:32.586014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ca7e2e70-4f2a-426f-b45f-6632dd942f36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 200 len: 1613 microversion: 2.1 time: 0.101351 Mar 08 04:22:32.586690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 227/466] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:32 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:22:32.630164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-bbe45d6b-5292-4adf-8bd3-4973f65a675e req-73ed67ba-7251-4dc7-9522-98dda6420731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c4a684-9cf2-4913-8f00-3833940f7184", "name": "network-vif-deleted", "tag": "efdaa5ea-6b22-4b8e-b80a-61fc6f368338"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:22:32.639083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-bbe45d6b-5292-4adf-8bd3-4973f65a675e req-73ed67ba-7251-4dc7-9522-98dda6420731 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:32.639846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-bbe45d6b-5292-4adf-8bd3-4973f65a675e req-73ed67ba-7251-4dc7-9522-98dda6420731 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:32.665365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-bbe45d6b-5292-4adf-8bd3-4973f65a675e req-73ed67ba-7251-4dc7-9522-98dda6420731 service nova] Creating event network-vif-deleted:efdaa5ea-6b22-4b8e-b80a-61fc6f368338 for instance 46c4a684-9cf2-4913-8f00-3833940f7184 on hv-cinder-73306 Mar 08 04:22:32.670796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-bbe45d6b-5292-4adf-8bd3-4973f65a675e req-73ed67ba-7251-4dc7-9522-98dda6420731 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044246 Mar 08 04:22:32.671956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 240/467] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:33.197551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1ff795a9-bf63-489e-b428-b97281e49155 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:33.198682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1ff795a9-bf63-489e-b428-b97281e49155 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:33.205257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ff795a9-bf63-489e-b428-b97281e49155 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:33.205897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ff795a9-bf63-489e-b428-b97281e49155 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:33.206670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ff795a9-bf63-489e-b428-b97281e49155 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:33.207268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ff795a9-bf63-489e-b428-b97281e49155 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:33.238357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1ff795a9-bf63-489e-b428-b97281e49155 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Mar 08 04:22:33.238857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 228/468] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:33.605407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b046bead-c4b0-42b4-8c2f-0b0247d67a70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:33.606181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b046bead-c4b0-42b4-8c2f-0b0247d67a70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:33.613025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b046bead-c4b0-42b4-8c2f-0b0247d67a70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:33.613479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b046bead-c4b0-42b4-8c2f-0b0247d67a70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:33.614437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b046bead-c4b0-42b4-8c2f-0b0247d67a70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:33.614881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b046bead-c4b0-42b4-8c2f-0b0247d67a70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:33.629715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-b046bead-c4b0-42b4-8c2f-0b0247d67a70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance 46c4a684-9cf2-4913-8f00-3833940f7184 could not be found. Mar 08 04:22:33.630316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b046bead-c4b0-42b4-8c2f-0b0247d67a70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance 46c4a684-9cf2-4913-8f00-3833940f7184 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:22:33.631918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b046bead-c4b0-42b4-8c2f-0b0247d67a70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 404 len: 111 microversion: 2.1 time: 0.030883 Mar 08 04:22:33.631918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 241/469] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:22:33 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:22:33.640893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-05a3db35-d37b-4bff-8ccb-e96c6c43426c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '.version_select at 0x7fe832638790>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:33.665230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-05a3db35-d37b-4bff-8ccb-e96c6c43426c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82282902" status: 202 len: 0 microversion: 2.1 time: 0.028984 Mar 08 04:22:33.666098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 229/470] 10.222.0.30 () {58 vars in 1214 bytes} [Tue Mar 8 04:22:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82282902 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:22:34.250154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-352be27b-78aa-4856-8d85-c1511d797f95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:34.251352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-352be27b-78aa-4856-8d85-c1511d797f95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:34.257681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-352be27b-78aa-4856-8d85-c1511d797f95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:34.258402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-352be27b-78aa-4856-8d85-c1511d797f95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:34.259287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-352be27b-78aa-4856-8d85-c1511d797f95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:34.259834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-352be27b-78aa-4856-8d85-c1511d797f95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:34.290792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-352be27b-78aa-4856-8d85-c1511d797f95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Mar 08 04:22:34.291410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 242/471] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:34 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:34.371118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-45fffc83-b049-45c9-9077-15448ab7217b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:34.371619 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-45fffc83-b049-45c9-9077-15448ab7217b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:34.378149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45fffc83-b049-45c9-9077-15448ab7217b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:34.378620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45fffc83-b049-45c9-9077-15448ab7217b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:34.379497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45fffc83-b049-45c9-9077-15448ab7217b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:34.379985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45fffc83-b049-45c9-9077-15448ab7217b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:34.458186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-45fffc83-b049-45c9-9077-15448ab7217b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lazy-loading 'services' on Instance uuid 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:22:34.527323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-45fffc83-b049-45c9-9077-15448ab7217b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments/61f29fdb-515f-43d6-ab43-06e46b979899" status: 202 len: 0 microversion: 2.1 time: 0.160099 Mar 08 04:22:34.527932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 230/472] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:22:34 2022] DELETE /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments/61f29fdb-515f-43d6-ab43-06e46b979899 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:22:34.537444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fe6e06bf-d160-4524-8a07-db6536de9fb9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:34.538628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fe6e06bf-d160-4524-8a07-db6536de9fb9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:34.546452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe6e06bf-d160-4524-8a07-db6536de9fb9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:34.547030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe6e06bf-d160-4524-8a07-db6536de9fb9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:34.548365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe6e06bf-d160-4524-8a07-db6536de9fb9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:34.548830 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe6e06bf-d160-4524-8a07-db6536de9fb9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:34.583828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fe6e06bf-d160-4524-8a07-db6536de9fb9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051256 Mar 08 04:22:34.584380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 243/473] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:35.304281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c023961b-16d4-4f13-88b0-ff5c37bc088d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:35.305202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c023961b-16d4-4f13-88b0-ff5c37bc088d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:35.312109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c023961b-16d4-4f13-88b0-ff5c37bc088d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:35.312557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c023961b-16d4-4f13-88b0-ff5c37bc088d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:35.313334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c023961b-16d4-4f13-88b0-ff5c37bc088d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:35.313810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c023961b-16d4-4f13-88b0-ff5c37bc088d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:35.341985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c023961b-16d4-4f13-88b0-ff5c37bc088d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042474 Mar 08 04:22:35.342535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 231/474] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:35.595911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d9e754dc-e263-4969-8ce5-c5450164271f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:35.596741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d9e754dc-e263-4969-8ce5-c5450164271f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:35.602700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9e754dc-e263-4969-8ce5-c5450164271f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:35.603146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9e754dc-e263-4969-8ce5-c5450164271f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:35.603896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9e754dc-e263-4969-8ce5-c5450164271f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:35.604326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9e754dc-e263-4969-8ce5-c5450164271f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:35.631869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d9e754dc-e263-4969-8ce5-c5450164271f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040042 Mar 08 04:22:35.633066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 244/475] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:36.353190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2d9e1eb2-ce54-4a5d-8c50-524ca673fd0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:36.354191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2d9e1eb2-ce54-4a5d-8c50-524ca673fd0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:36.361026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d9e1eb2-ce54-4a5d-8c50-524ca673fd0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:36.361473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d9e1eb2-ce54-4a5d-8c50-524ca673fd0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:36.362276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d9e1eb2-ce54-4a5d-8c50-524ca673fd0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:36.362716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d9e1eb2-ce54-4a5d-8c50-524ca673fd0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:36.390347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2d9e1eb2-ce54-4a5d-8c50-524ca673fd0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 Mar 08 04:22:36.390827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 232/476] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:36.644325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f4c74ddf-b52a-42b5-90ab-a986a8dbbf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:36.645145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f4c74ddf-b52a-42b5-90ab-a986a8dbbf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:36.651326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4c74ddf-b52a-42b5-90ab-a986a8dbbf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:36.651768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4c74ddf-b52a-42b5-90ab-a986a8dbbf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:36.652521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4c74ddf-b52a-42b5-90ab-a986a8dbbf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:36.653546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4c74ddf-b52a-42b5-90ab-a986a8dbbf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:36.681158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f4c74ddf-b52a-42b5-90ab-a986a8dbbf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040897 Mar 08 04:22:36.681704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 245/477] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:37.401566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d2e37ce3-ac18-467a-bd27-b28a76aafee2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:37.402524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d2e37ce3-ac18-467a-bd27-b28a76aafee2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:37.409366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2e37ce3-ac18-467a-bd27-b28a76aafee2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:37.409853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2e37ce3-ac18-467a-bd27-b28a76aafee2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:37.410654 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2e37ce3-ac18-467a-bd27-b28a76aafee2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:37.411099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2e37ce3-ac18-467a-bd27-b28a76aafee2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:37.439342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d2e37ce3-ac18-467a-bd27-b28a76aafee2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041812 Mar 08 04:22:37.439827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 233/478] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:37.692614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6baf9ccf-af4f-422d-a5f8-929c94500da0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:37.693439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6baf9ccf-af4f-422d-a5f8-929c94500da0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:37.699672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6baf9ccf-af4f-422d-a5f8-929c94500da0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:37.700117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6baf9ccf-af4f-422d-a5f8-929c94500da0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:37.700869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6baf9ccf-af4f-422d-a5f8-929c94500da0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:37.701299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6baf9ccf-af4f-422d-a5f8-929c94500da0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:37.728508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6baf9ccf-af4f-422d-a5f8-929c94500da0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039890 Mar 08 04:22:37.729042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 246/479] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:38.451246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2aa72b72-5e6f-431a-84ac-310e97625711 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:38.452143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2aa72b72-5e6f-431a-84ac-310e97625711 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:38.458299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2aa72b72-5e6f-431a-84ac-310e97625711 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:38.458742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2aa72b72-5e6f-431a-84ac-310e97625711 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:38.459495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2aa72b72-5e6f-431a-84ac-310e97625711 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:38.459926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2aa72b72-5e6f-431a-84ac-310e97625711 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:38.487612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2aa72b72-5e6f-431a-84ac-310e97625711 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040813 Mar 08 04:22:38.488084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 234/480] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:38 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:22:38.740492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-080fc46e-1b0e-46ce-b137-263cbd014dc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:38.741330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-080fc46e-1b0e-46ce-b137-263cbd014dc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:38.748292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-080fc46e-1b0e-46ce-b137-263cbd014dc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:38.748747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-080fc46e-1b0e-46ce-b137-263cbd014dc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:38.749514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-080fc46e-1b0e-46ce-b137-263cbd014dc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:38.749988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-080fc46e-1b0e-46ce-b137-263cbd014dc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:38.778110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-080fc46e-1b0e-46ce-b137-263cbd014dc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041510 Mar 08 04:22:38.778659 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 247/481] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:39.499050 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ec2bdb39-f641-461c-9d33-a5af2486c56a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:39.500058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ec2bdb39-f641-461c-9d33-a5af2486c56a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:39.506381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec2bdb39-f641-461c-9d33-a5af2486c56a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:39.506825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec2bdb39-f641-461c-9d33-a5af2486c56a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:39.507590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec2bdb39-f641-461c-9d33-a5af2486c56a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:39.508020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec2bdb39-f641-461c-9d33-a5af2486c56a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:39.537170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ec2bdb39-f641-461c-9d33-a5af2486c56a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042067 Mar 08 04:22:39.537637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 235/482] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:39.789370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-75c44bf9-8d6e-4c5b-8798-1b5273e7aeb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:39.790236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-75c44bf9-8d6e-4c5b-8798-1b5273e7aeb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:39.797623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75c44bf9-8d6e-4c5b-8798-1b5273e7aeb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:39.798124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75c44bf9-8d6e-4c5b-8798-1b5273e7aeb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:39.798896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75c44bf9-8d6e-4c5b-8798-1b5273e7aeb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:39.799339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75c44bf9-8d6e-4c5b-8798-1b5273e7aeb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:39.828162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-75c44bf9-8d6e-4c5b-8798-1b5273e7aeb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042839 Mar 08 04:22:39.828718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 248/483] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:40.548549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-be6ee7c7-cf4a-4420-9e76-fbdcaeb581a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:40.549453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-be6ee7c7-cf4a-4420-9e76-fbdcaeb581a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:40.555830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be6ee7c7-cf4a-4420-9e76-fbdcaeb581a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:40.556279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be6ee7c7-cf4a-4420-9e76-fbdcaeb581a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:40.557046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be6ee7c7-cf4a-4420-9e76-fbdcaeb581a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:40.557480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be6ee7c7-cf4a-4420-9e76-fbdcaeb581a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:40.585736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-be6ee7c7-cf4a-4420-9e76-fbdcaeb581a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041049 Mar 08 04:22:40.586239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 236/484] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:40.838802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e949e393-132a-46d6-921b-de72965b7385 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:40.839644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e949e393-132a-46d6-921b-de72965b7385 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:40.846461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e949e393-132a-46d6-921b-de72965b7385 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:40.846901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e949e393-132a-46d6-921b-de72965b7385 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:40.847653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e949e393-132a-46d6-921b-de72965b7385 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:40.848085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e949e393-132a-46d6-921b-de72965b7385 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:40.880713 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e949e393-132a-46d6-921b-de72965b7385 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Mar 08 04:22:40.881264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 249/485] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:41.597274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-76fd3c63-9f5d-41df-bdc2-0ffc3818d4c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:41.598152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-76fd3c63-9f5d-41df-bdc2-0ffc3818d4c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:41.604319 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76fd3c63-9f5d-41df-bdc2-0ffc3818d4c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:41.604769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76fd3c63-9f5d-41df-bdc2-0ffc3818d4c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:41.605534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76fd3c63-9f5d-41df-bdc2-0ffc3818d4c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:41.606617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76fd3c63-9f5d-41df-bdc2-0ffc3818d4c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:41.635454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-76fd3c63-9f5d-41df-bdc2-0ffc3818d4c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042175 Mar 08 04:22:41.636003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 237/486] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:41.892947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fa5f266c-35df-4ac3-a31a-983f9b2bad64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:41.893908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fa5f266c-35df-4ac3-a31a-983f9b2bad64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:41.900172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa5f266c-35df-4ac3-a31a-983f9b2bad64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:41.900625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa5f266c-35df-4ac3-a31a-983f9b2bad64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:41.901384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa5f266c-35df-4ac3-a31a-983f9b2bad64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:41.901847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa5f266c-35df-4ac3-a31a-983f9b2bad64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:41.929829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fa5f266c-35df-4ac3-a31a-983f9b2bad64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040814 Mar 08 04:22:41.930371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 250/487] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:22:42.646183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9880a7dc-7add-4414-9cb7-988db739eb71 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:42.647014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9880a7dc-7add-4414-9cb7-988db739eb71 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:42.653848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9880a7dc-7add-4414-9cb7-988db739eb71 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:42.654298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9880a7dc-7add-4414-9cb7-988db739eb71 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:42.655195 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9880a7dc-7add-4414-9cb7-988db739eb71 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:42.655643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9880a7dc-7add-4414-9cb7-988db739eb71 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:42.686189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9880a7dc-7add-4414-9cb7-988db739eb71 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Mar 08 04:22:42.686758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 238/488] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:42 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:42.941475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-25968f6c-8e8c-4508-90f3-fe92e58333a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:42.942470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-25968f6c-8e8c-4508-90f3-fe92e58333a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:42.948666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25968f6c-8e8c-4508-90f3-fe92e58333a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:42.949109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25968f6c-8e8c-4508-90f3-fe92e58333a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:42.950103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25968f6c-8e8c-4508-90f3-fe92e58333a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:42.950539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25968f6c-8e8c-4508-90f3-fe92e58333a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:42.977421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-25968f6c-8e8c-4508-90f3-fe92e58333a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039857 Mar 08 04:22:42.977992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 251/489] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:43.697379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b8f9f7a2-2da1-49de-a36a-bb74086a6317 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:43.698336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b8f9f7a2-2da1-49de-a36a-bb74086a6317 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:43.705323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8f9f7a2-2da1-49de-a36a-bb74086a6317 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:43.705808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8f9f7a2-2da1-49de-a36a-bb74086a6317 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:43.706567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8f9f7a2-2da1-49de-a36a-bb74086a6317 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:43.706996 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8f9f7a2-2da1-49de-a36a-bb74086a6317 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:43.735351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b8f9f7a2-2da1-49de-a36a-bb74086a6317 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 Mar 08 04:22:43.735894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 239/490] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:43.989290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1f90b16d-d093-4c3e-ad00-272ca7227948 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:43.990150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1f90b16d-d093-4c3e-ad00-272ca7227948 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:43.997214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f90b16d-d093-4c3e-ad00-272ca7227948 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:43.997860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f90b16d-d093-4c3e-ad00-272ca7227948 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:43.998630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f90b16d-d093-4c3e-ad00-272ca7227948 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:43.999066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f90b16d-d093-4c3e-ad00-272ca7227948 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:44.026861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1f90b16d-d093-4c3e-ad00-272ca7227948 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 Mar 08 04:22:44.027402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 252/491] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:44.748477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0c18de8f-77c2-42c8-a3f2-5675bccba738 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:44.749960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0c18de8f-77c2-42c8-a3f2-5675bccba738 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:44.759286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c18de8f-77c2-42c8-a3f2-5675bccba738 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:44.759742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c18de8f-77c2-42c8-a3f2-5675bccba738 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:44.760492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c18de8f-77c2-42c8-a3f2-5675bccba738 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:44.760927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c18de8f-77c2-42c8-a3f2-5675bccba738 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:44.789117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0c18de8f-77c2-42c8-a3f2-5675bccba738 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046198 Mar 08 04:22:44.789704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 240/492] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:45.038536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-05a8ead0-a289-4f3f-b980-98492a369892 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:45.039377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-05a8ead0-a289-4f3f-b980-98492a369892 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:45.046335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05a8ead0-a289-4f3f-b980-98492a369892 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:45.046787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05a8ead0-a289-4f3f-b980-98492a369892 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:45.047541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05a8ead0-a289-4f3f-b980-98492a369892 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:45.047968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05a8ead0-a289-4f3f-b980-98492a369892 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:45.077339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-05a8ead0-a289-4f3f-b980-98492a369892 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 Mar 08 04:22:45.077913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 253/493] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:45.800790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4c160970-3b6d-4927-bcf9-2ec65bb30ad1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:45.801615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4c160970-3b6d-4927-bcf9-2ec65bb30ad1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:45.807797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c160970-3b6d-4927-bcf9-2ec65bb30ad1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:45.808243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c160970-3b6d-4927-bcf9-2ec65bb30ad1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:45.809249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c160970-3b6d-4927-bcf9-2ec65bb30ad1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:45.809715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c160970-3b6d-4927-bcf9-2ec65bb30ad1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:45.838275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4c160970-3b6d-4927-bcf9-2ec65bb30ad1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Mar 08 04:22:45.838819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 241/494] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:46.088994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b2d761e9-8acb-421b-99bf-d1e9d7396cad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:46.089863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b2d761e9-8acb-421b-99bf-d1e9d7396cad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:46.096133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2d761e9-8acb-421b-99bf-d1e9d7396cad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:46.096575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2d761e9-8acb-421b-99bf-d1e9d7396cad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:46.097329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2d761e9-8acb-421b-99bf-d1e9d7396cad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:46.097796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2d761e9-8acb-421b-99bf-d1e9d7396cad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:46.125893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b2d761e9-8acb-421b-99bf-d1e9d7396cad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 Mar 08 04:22:46.126437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 254/495] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:46.850495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f9455dbd-67f6-4058-9fce-2b46f6cf24a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:46.851400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f9455dbd-67f6-4058-9fce-2b46f6cf24a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:46.858169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9455dbd-67f6-4058-9fce-2b46f6cf24a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:46.858615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9455dbd-67f6-4058-9fce-2b46f6cf24a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:46.859497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9455dbd-67f6-4058-9fce-2b46f6cf24a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:46.859935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9455dbd-67f6-4058-9fce-2b46f6cf24a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:46.887602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f9455dbd-67f6-4058-9fce-2b46f6cf24a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041098 Mar 08 04:22:46.888147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 242/496] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:47.137425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-25a69fe2-4da1-4fe7-a963-3c9da53d8f51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:47.138299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-25a69fe2-4da1-4fe7-a963-3c9da53d8f51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:47.144581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25a69fe2-4da1-4fe7-a963-3c9da53d8f51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:47.145026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25a69fe2-4da1-4fe7-a963-3c9da53d8f51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:47.145811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25a69fe2-4da1-4fe7-a963-3c9da53d8f51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:47.146240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25a69fe2-4da1-4fe7-a963-3c9da53d8f51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:47.175174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-25a69fe2-4da1-4fe7-a963-3c9da53d8f51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Mar 08 04:22:47.175705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 255/497] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:22:47.899195 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0c85887c-7a8d-4425-a3c0-f02f60258112 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:47.900102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0c85887c-7a8d-4425-a3c0-f02f60258112 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:47.906521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c85887c-7a8d-4425-a3c0-f02f60258112 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:47.906947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c85887c-7a8d-4425-a3c0-f02f60258112 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:47.907710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c85887c-7a8d-4425-a3c0-f02f60258112 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:47.908143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c85887c-7a8d-4425-a3c0-f02f60258112 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:47.939267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0c85887c-7a8d-4425-a3c0-f02f60258112 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Mar 08 04:22:47.939820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 243/498] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:48.186934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d5c78198-45e7-4472-bdc9-ed0ea4bb746e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:48.187838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d5c78198-45e7-4472-bdc9-ed0ea4bb746e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:48.194085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5c78198-45e7-4472-bdc9-ed0ea4bb746e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:48.194536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5c78198-45e7-4472-bdc9-ed0ea4bb746e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:48.195323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5c78198-45e7-4472-bdc9-ed0ea4bb746e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:48.195755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5c78198-45e7-4472-bdc9-ed0ea4bb746e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:48.222822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d5c78198-45e7-4472-bdc9-ed0ea4bb746e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040617 Mar 08 04:22:48.223359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 256/499] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:48.950809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d77c0866-bd8b-43c1-a8fc-dd471823a488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:48.951725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d77c0866-bd8b-43c1-a8fc-dd471823a488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:48.958045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d77c0866-bd8b-43c1-a8fc-dd471823a488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:48.958499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d77c0866-bd8b-43c1-a8fc-dd471823a488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:48.959265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d77c0866-bd8b-43c1-a8fc-dd471823a488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:48.959712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d77c0866-bd8b-43c1-a8fc-dd471823a488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:48.987793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d77c0866-bd8b-43c1-a8fc-dd471823a488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041018 Mar 08 04:22:48.988339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 244/500] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:49.234869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5852c3c2-fa19-4c98-9a5c-573205761bbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:49.235782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5852c3c2-fa19-4c98-9a5c-573205761bbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:49.242034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5852c3c2-fa19-4c98-9a5c-573205761bbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:49.242484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5852c3c2-fa19-4c98-9a5c-573205761bbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:49.243243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5852c3c2-fa19-4c98-9a5c-573205761bbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:49.243676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5852c3c2-fa19-4c98-9a5c-573205761bbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:49.271976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5852c3c2-fa19-4c98-9a5c-573205761bbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041627 Mar 08 04:22:49.272522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 257/501] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:49.999730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3b110fc9-e347-4b94-b55c-d9376849a92a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:50.001249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3b110fc9-e347-4b94-b55c-d9376849a92a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:50.006882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b110fc9-e347-4b94-b55c-d9376849a92a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:50.007420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b110fc9-e347-4b94-b55c-d9376849a92a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:50.008185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b110fc9-e347-4b94-b55c-d9376849a92a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:50.008620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b110fc9-e347-4b94-b55c-d9376849a92a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:50.037194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3b110fc9-e347-4b94-b55c-d9376849a92a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Mar 08 04:22:50.037767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 245/502] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:50.283678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9218b9e8-4aba-4e95-8f0f-69ed62dbea92 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:50.284608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9218b9e8-4aba-4e95-8f0f-69ed62dbea92 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:50.290811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9218b9e8-4aba-4e95-8f0f-69ed62dbea92 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:50.291250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9218b9e8-4aba-4e95-8f0f-69ed62dbea92 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:50.292005 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9218b9e8-4aba-4e95-8f0f-69ed62dbea92 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:50.292432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9218b9e8-4aba-4e95-8f0f-69ed62dbea92 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:50.320886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9218b9e8-4aba-4e95-8f0f-69ed62dbea92 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Mar 08 04:22:50.321420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 258/503] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:50 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:51.049819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-116ab84c-abdf-48c4-aeee-ac86dadc4c2b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:51.050753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-116ab84c-abdf-48c4-aeee-ac86dadc4c2b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:51.056999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-116ab84c-abdf-48c4-aeee-ac86dadc4c2b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:51.057452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-116ab84c-abdf-48c4-aeee-ac86dadc4c2b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:51.058248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-116ab84c-abdf-48c4-aeee-ac86dadc4c2b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:51.059430 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-116ab84c-abdf-48c4-aeee-ac86dadc4c2b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:51.086769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-116ab84c-abdf-48c4-aeee-ac86dadc4c2b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040880 Mar 08 04:22:51.087255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 246/504] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:51.332503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-449d0d85-7aa6-457f-959f-8a8b27d302d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:51.333414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-449d0d85-7aa6-457f-959f-8a8b27d302d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:51.340387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-449d0d85-7aa6-457f-959f-8a8b27d302d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:51.340828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-449d0d85-7aa6-457f-959f-8a8b27d302d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:51.341612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-449d0d85-7aa6-457f-959f-8a8b27d302d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:51.342078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-449d0d85-7aa6-457f-959f-8a8b27d302d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:51.369318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-449d0d85-7aa6-457f-959f-8a8b27d302d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Mar 08 04:22:51.369897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 259/505] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:52.098291 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5c1204f8-b267-4f56-a282-923c9afe4395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:52.099209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5c1204f8-b267-4f56-a282-923c9afe4395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:52.105589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c1204f8-b267-4f56-a282-923c9afe4395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:52.106014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c1204f8-b267-4f56-a282-923c9afe4395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:52.106776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c1204f8-b267-4f56-a282-923c9afe4395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:52.107211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c1204f8-b267-4f56-a282-923c9afe4395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:52.134247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5c1204f8-b267-4f56-a282-923c9afe4395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039897 Mar 08 04:22:52.134794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 247/506] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:52.380605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-86a1160d-3e02-486f-b6ad-c64838fd5dac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:52.381435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-86a1160d-3e02-486f-b6ad-c64838fd5dac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:52.388201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-86a1160d-3e02-486f-b6ad-c64838fd5dac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:52.388644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-86a1160d-3e02-486f-b6ad-c64838fd5dac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:52.389392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-86a1160d-3e02-486f-b6ad-c64838fd5dac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:52.389851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-86a1160d-3e02-486f-b6ad-c64838fd5dac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:52.417092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-86a1160d-3e02-486f-b6ad-c64838fd5dac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040463 Mar 08 04:22:52.417636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 260/507] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:53.146189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a4442016-b349-41a2-ae7f-d8bf808e63a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:53.147128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a4442016-b349-41a2-ae7f-d8bf808e63a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:53.153845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4442016-b349-41a2-ae7f-d8bf808e63a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:53.154297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4442016-b349-41a2-ae7f-d8bf808e63a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:53.155062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4442016-b349-41a2-ae7f-d8bf808e63a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:53.155498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4442016-b349-41a2-ae7f-d8bf808e63a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:53.183160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a4442016-b349-41a2-ae7f-d8bf808e63a7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040841 Mar 08 04:22:53.184149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 248/508] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:53.428945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9eda8859-f1a9-4801-8cc9-05d67b2f0712 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:53.429877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9eda8859-f1a9-4801-8cc9-05d67b2f0712 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:53.436934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9eda8859-f1a9-4801-8cc9-05d67b2f0712 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:53.437322 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9eda8859-f1a9-4801-8cc9-05d67b2f0712 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:53.438107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9eda8859-f1a9-4801-8cc9-05d67b2f0712 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:53.438536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9eda8859-f1a9-4801-8cc9-05d67b2f0712 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:53.465778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9eda8859-f1a9-4801-8cc9-05d67b2f0712 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040743 Mar 08 04:22:53.466309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 261/509] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:54.195230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57e3a94c-f480-4a7f-a80b-383cd346253e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:54.196168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-57e3a94c-f480-4a7f-a80b-383cd346253e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:54.202444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57e3a94c-f480-4a7f-a80b-383cd346253e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:54.202898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57e3a94c-f480-4a7f-a80b-383cd346253e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:54.203661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57e3a94c-f480-4a7f-a80b-383cd346253e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:54.204104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57e3a94c-f480-4a7f-a80b-383cd346253e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:54.234206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-57e3a94c-f480-4a7f-a80b-383cd346253e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042939 Mar 08 04:22:54.234756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 249/510] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:54 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:54.476980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-468c6864-4006-4c10-8737-eb08cf7d6d5a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:54.477836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-468c6864-4006-4c10-8737-eb08cf7d6d5a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:54.484796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-468c6864-4006-4c10-8737-eb08cf7d6d5a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:54.485241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-468c6864-4006-4c10-8737-eb08cf7d6d5a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:54.486020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-468c6864-4006-4c10-8737-eb08cf7d6d5a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:54.486451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-468c6864-4006-4c10-8737-eb08cf7d6d5a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:54.515415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-468c6864-4006-4c10-8737-eb08cf7d6d5a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042468 Mar 08 04:22:54.515962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 262/511] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:55.246337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ba7c03e8-f0a8-4f35-9b24-8b254a02d69a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:55.247279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ba7c03e8-f0a8-4f35-9b24-8b254a02d69a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:55.253897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba7c03e8-f0a8-4f35-9b24-8b254a02d69a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:55.254347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba7c03e8-f0a8-4f35-9b24-8b254a02d69a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:55.255153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba7c03e8-f0a8-4f35-9b24-8b254a02d69a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:55.255594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba7c03e8-f0a8-4f35-9b24-8b254a02d69a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:55.284735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ba7c03e8-f0a8-4f35-9b24-8b254a02d69a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042865 Mar 08 04:22:55.285281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 250/512] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:55.526878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-576adfa9-6a95-4f1e-9271-fc00282f6e74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:55.528025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-576adfa9-6a95-4f1e-9271-fc00282f6e74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:55.534518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-576adfa9-6a95-4f1e-9271-fc00282f6e74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:55.534963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-576adfa9-6a95-4f1e-9271-fc00282f6e74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:55.535721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-576adfa9-6a95-4f1e-9271-fc00282f6e74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:55.536184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-576adfa9-6a95-4f1e-9271-fc00282f6e74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:55.564317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-576adfa9-6a95-4f1e-9271-fc00282f6e74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041337 Mar 08 04:22:55.564849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 263/513] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:56.296859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-48e47d8c-3c69-482c-b210-99e9e7eb5955 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:56.297786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-48e47d8c-3c69-482c-b210-99e9e7eb5955 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:56.303921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48e47d8c-3c69-482c-b210-99e9e7eb5955 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:56.304359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48e47d8c-3c69-482c-b210-99e9e7eb5955 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:56.305116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48e47d8c-3c69-482c-b210-99e9e7eb5955 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:56.305544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48e47d8c-3c69-482c-b210-99e9e7eb5955 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:56.333227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-48e47d8c-3c69-482c-b210-99e9e7eb5955 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Mar 08 04:22:56.333790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 251/514] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:56.575721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5b7dcf4d-bb95-4dce-a820-763669dcec77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:56.576629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5b7dcf4d-bb95-4dce-a820-763669dcec77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:56.582807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5b7dcf4d-bb95-4dce-a820-763669dcec77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:56.583251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5b7dcf4d-bb95-4dce-a820-763669dcec77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:56.584011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5b7dcf4d-bb95-4dce-a820-763669dcec77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:56.584443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5b7dcf4d-bb95-4dce-a820-763669dcec77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:56.613356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5b7dcf4d-bb95-4dce-a820-763669dcec77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041578 Mar 08 04:22:56.613944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 264/515] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:57.345313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-99e85177-be24-4ce3-99b5-85f6f23b161b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:57.346252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-99e85177-be24-4ce3-99b5-85f6f23b161b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:57.352756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99e85177-be24-4ce3-99b5-85f6f23b161b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:57.353206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99e85177-be24-4ce3-99b5-85f6f23b161b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:57.354005 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99e85177-be24-4ce3-99b5-85f6f23b161b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:57.354449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99e85177-be24-4ce3-99b5-85f6f23b161b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:57.384406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-99e85177-be24-4ce3-99b5-85f6f23b161b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Mar 08 04:22:57.384968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 252/516] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:22:57.625155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-007e0f8f-e5a3-4f0f-ba75-8dd827f231c5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:57.626097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-007e0f8f-e5a3-4f0f-ba75-8dd827f231c5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:57.632269 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-007e0f8f-e5a3-4f0f-ba75-8dd827f231c5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:57.632718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-007e0f8f-e5a3-4f0f-ba75-8dd827f231c5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:57.633481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-007e0f8f-e5a3-4f0f-ba75-8dd827f231c5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:57.633956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-007e0f8f-e5a3-4f0f-ba75-8dd827f231c5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:57.661877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-007e0f8f-e5a3-4f0f-ba75-8dd827f231c5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040986 Mar 08 04:22:57.662419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 265/517] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:58.395721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-30d73cbd-396d-479b-88c6-a581c7c505c6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:58.396616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-30d73cbd-396d-479b-88c6-a581c7c505c6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:58.403337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30d73cbd-396d-479b-88c6-a581c7c505c6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:58.403778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30d73cbd-396d-479b-88c6-a581c7c505c6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:58.404534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30d73cbd-396d-479b-88c6-a581c7c505c6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:58.404961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30d73cbd-396d-479b-88c6-a581c7c505c6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:58.432750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-30d73cbd-396d-479b-88c6-a581c7c505c6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040928 Mar 08 04:22:58.434096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 253/518] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:58.673188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0d7c8a6c-b84f-4bed-bb50-42ea4c38655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:58.674127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0d7c8a6c-b84f-4bed-bb50-42ea4c38655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:58.680304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d7c8a6c-b84f-4bed-bb50-42ea4c38655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:58.680756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d7c8a6c-b84f-4bed-bb50-42ea4c38655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:58.681515 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d7c8a6c-b84f-4bed-bb50-42ea4c38655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:58.682115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d7c8a6c-b84f-4bed-bb50-42ea4c38655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:58.710472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0d7c8a6c-b84f-4bed-bb50-42ea4c38655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 Mar 08 04:22:58.711013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 266/519] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:59.444759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a2f3a906-6b41-4ea6-85fa-e1c1aea00b15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:59.445720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a2f3a906-6b41-4ea6-85fa-e1c1aea00b15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:59.452309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2f3a906-6b41-4ea6-85fa-e1c1aea00b15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:59.452764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2f3a906-6b41-4ea6-85fa-e1c1aea00b15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:59.453567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2f3a906-6b41-4ea6-85fa-e1c1aea00b15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:59.454042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2f3a906-6b41-4ea6-85fa-e1c1aea00b15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:59.483191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a2f3a906-6b41-4ea6-85fa-e1c1aea00b15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042518 Mar 08 04:22:59.483755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 254/520] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:22:59.722114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4f237944-5909-4a30-a55a-136d0c4500ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:22:59.723056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4f237944-5909-4a30-a55a-136d0c4500ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:22:59.729190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4f237944-5909-4a30-a55a-136d0c4500ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:59.729635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4f237944-5909-4a30-a55a-136d0c4500ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:59.730549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4f237944-5909-4a30-a55a-136d0c4500ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:22:59.731023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4f237944-5909-4a30-a55a-136d0c4500ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:22:59.759517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4f237944-5909-4a30-a55a-136d0c4500ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 Mar 08 04:22:59.760064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 267/521] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:22:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:00.494486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-adfb5c64-ad53-47db-ad1c-78a8517a5244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:00.495454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-adfb5c64-ad53-47db-ad1c-78a8517a5244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:00.501674 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-adfb5c64-ad53-47db-ad1c-78a8517a5244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:00.502137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-adfb5c64-ad53-47db-ad1c-78a8517a5244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:00.502893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-adfb5c64-ad53-47db-ad1c-78a8517a5244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:00.503324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-adfb5c64-ad53-47db-ad1c-78a8517a5244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:00.531515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-adfb5c64-ad53-47db-ad1c-78a8517a5244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040943 Mar 08 04:23:00.532057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 255/522] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:00.770892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-33e2b328-1237-49c1-a33f-093260208cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:00.771838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-33e2b328-1237-49c1-a33f-093260208cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:00.778897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33e2b328-1237-49c1-a33f-093260208cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:00.779822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33e2b328-1237-49c1-a33f-093260208cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:00.780107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33e2b328-1237-49c1-a33f-093260208cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:00.780810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33e2b328-1237-49c1-a33f-093260208cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:00.809290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-33e2b328-1237-49c1-a33f-093260208cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 Mar 08 04:23:00.809870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 268/523] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:01.543421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-02df46ab-d78d-4f7d-8eef-9f1e5c0cee3d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:01.544350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-02df46ab-d78d-4f7d-8eef-9f1e5c0cee3d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:01.550500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02df46ab-d78d-4f7d-8eef-9f1e5c0cee3d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:01.550944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02df46ab-d78d-4f7d-8eef-9f1e5c0cee3d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:01.551693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02df46ab-d78d-4f7d-8eef-9f1e5c0cee3d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:01.552121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02df46ab-d78d-4f7d-8eef-9f1e5c0cee3d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:01.579940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-02df46ab-d78d-4f7d-8eef-9f1e5c0cee3d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041095 Mar 08 04:23:01.580474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 256/524] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:01.820833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b2eea394-96da-4da4-b2c3-5d64dc10366b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:01.821787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b2eea394-96da-4da4-b2c3-5d64dc10366b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:01.828866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2eea394-96da-4da4-b2c3-5d64dc10366b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:01.829320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2eea394-96da-4da4-b2c3-5d64dc10366b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:01.830129 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2eea394-96da-4da4-b2c3-5d64dc10366b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:01.830571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2eea394-96da-4da4-b2c3-5d64dc10366b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:01.859538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b2eea394-96da-4da4-b2c3-5d64dc10366b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042669 Mar 08 04:23:01.860100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 269/525] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:01 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:02.591334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9b4f24ed-f82d-4432-8ed3-2339711afa9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:02.592228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9b4f24ed-f82d-4432-8ed3-2339711afa9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:02.598515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b4f24ed-f82d-4432-8ed3-2339711afa9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:02.598968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b4f24ed-f82d-4432-8ed3-2339711afa9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:02.599711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b4f24ed-f82d-4432-8ed3-2339711afa9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:02.600141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b4f24ed-f82d-4432-8ed3-2339711afa9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:02.628329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9b4f24ed-f82d-4432-8ed3-2339711afa9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040994 Mar 08 04:23:02.628863 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 257/526] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:02.871214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d3485b87-e21b-4e82-93e0-9e3ebfa9cba4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:02.872165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d3485b87-e21b-4e82-93e0-9e3ebfa9cba4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:02.878330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3485b87-e21b-4e82-93e0-9e3ebfa9cba4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:02.878778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3485b87-e21b-4e82-93e0-9e3ebfa9cba4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:02.879536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3485b87-e21b-4e82-93e0-9e3ebfa9cba4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:02.879968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3485b87-e21b-4e82-93e0-9e3ebfa9cba4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:02.908882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d3485b87-e21b-4e82-93e0-9e3ebfa9cba4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041784 Mar 08 04:23:02.909427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 270/527] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:03.639834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-32b388f8-f9c4-4a50-92b5-b1602a72d994 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:03.640768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-32b388f8-f9c4-4a50-92b5-b1602a72d994 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:03.647009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32b388f8-f9c4-4a50-92b5-b1602a72d994 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:03.647458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32b388f8-f9c4-4a50-92b5-b1602a72d994 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:03.648213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32b388f8-f9c4-4a50-92b5-b1602a72d994 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:03.648646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32b388f8-f9c4-4a50-92b5-b1602a72d994 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:03.676925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-32b388f8-f9c4-4a50-92b5-b1602a72d994 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041018 Mar 08 04:23:03.677464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 258/528] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:03.920523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-12d58d92-4c15-4de7-b2ce-1f84283b9118 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:03.921540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-12d58d92-4c15-4de7-b2ce-1f84283b9118 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:03.927674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12d58d92-4c15-4de7-b2ce-1f84283b9118 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:03.928124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12d58d92-4c15-4de7-b2ce-1f84283b9118 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:03.928894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12d58d92-4c15-4de7-b2ce-1f84283b9118 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:03.929329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12d58d92-4c15-4de7-b2ce-1f84283b9118 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:03.957546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-12d58d92-4c15-4de7-b2ce-1f84283b9118 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Mar 08 04:23:03.958117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 271/529] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:04.688942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6a78abed-3575-419f-825d-85c8434f0a54 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:04.689927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6a78abed-3575-419f-825d-85c8434f0a54 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:04.696124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a78abed-3575-419f-825d-85c8434f0a54 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:04.696569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a78abed-3575-419f-825d-85c8434f0a54 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:04.697328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a78abed-3575-419f-825d-85c8434f0a54 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:04.697791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a78abed-3575-419f-825d-85c8434f0a54 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:04.725245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6a78abed-3575-419f-825d-85c8434f0a54 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040298 Mar 08 04:23:04.725837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 259/530] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:04.969013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-509a58f2-9a82-4ef2-a9c8-c79bd55651f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:04.969974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-509a58f2-9a82-4ef2-a9c8-c79bd55651f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:04.976138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-509a58f2-9a82-4ef2-a9c8-c79bd55651f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:04.976586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-509a58f2-9a82-4ef2-a9c8-c79bd55651f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:04.977344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-509a58f2-9a82-4ef2-a9c8-c79bd55651f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:04.977821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-509a58f2-9a82-4ef2-a9c8-c79bd55651f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:05.005566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-509a58f2-9a82-4ef2-a9c8-c79bd55651f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041245 Mar 08 04:23:05.006139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 272/531] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:05.736367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-11718251-1f79-467b-94d4-d79ca763396f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:05.737302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-11718251-1f79-467b-94d4-d79ca763396f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:05.743525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11718251-1f79-467b-94d4-d79ca763396f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:05.743973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11718251-1f79-467b-94d4-d79ca763396f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:05.744741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11718251-1f79-467b-94d4-d79ca763396f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:05.745174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11718251-1f79-467b-94d4-d79ca763396f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:05.774730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-11718251-1f79-467b-94d4-d79ca763396f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042258 Mar 08 04:23:05.775285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 260/532] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:06.016916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5ecff2de-a0be-4098-b07d-4ccb95781ade tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:06.017856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5ecff2de-a0be-4098-b07d-4ccb95781ade tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:06.023750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5ecff2de-a0be-4098-b07d-4ccb95781ade tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:06.024191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5ecff2de-a0be-4098-b07d-4ccb95781ade tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:06.024942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5ecff2de-a0be-4098-b07d-4ccb95781ade tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:06.025369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5ecff2de-a0be-4098-b07d-4ccb95781ade tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:06.056055 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5ecff2de-a0be-4098-b07d-4ccb95781ade tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043043 Mar 08 04:23:06.056604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 273/533] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:06.787473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e8e27628-f8b1-4106-a2f5-4619a105ecc1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:06.788386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e8e27628-f8b1-4106-a2f5-4619a105ecc1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:06.795460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8e27628-f8b1-4106-a2f5-4619a105ecc1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:06.795913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8e27628-f8b1-4106-a2f5-4619a105ecc1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:06.796683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8e27628-f8b1-4106-a2f5-4619a105ecc1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:06.797123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8e27628-f8b1-4106-a2f5-4619a105ecc1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:06.825706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e8e27628-f8b1-4106-a2f5-4619a105ecc1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042269 Mar 08 04:23:06.826275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 261/534] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:07.067434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d004d5da-e6a8-4a0e-90d0-c83f6459809d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:07.068346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d004d5da-e6a8-4a0e-90d0-c83f6459809d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:07.074750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d004d5da-e6a8-4a0e-90d0-c83f6459809d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:07.075204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d004d5da-e6a8-4a0e-90d0-c83f6459809d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:07.075971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d004d5da-e6a8-4a0e-90d0-c83f6459809d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:07.076408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d004d5da-e6a8-4a0e-90d0-c83f6459809d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:07.104310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d004d5da-e6a8-4a0e-90d0-c83f6459809d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040716 Mar 08 04:23:07.105305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 274/535] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:07.836892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b8ae1cea-dca4-4ca9-99c7-6e75f5992054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:07.837832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b8ae1cea-dca4-4ca9-99c7-6e75f5992054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:07.844673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8ae1cea-dca4-4ca9-99c7-6e75f5992054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:07.845121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8ae1cea-dca4-4ca9-99c7-6e75f5992054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:07.845950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8ae1cea-dca4-4ca9-99c7-6e75f5992054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:07.846386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8ae1cea-dca4-4ca9-99c7-6e75f5992054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:07.875966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b8ae1cea-dca4-4ca9-99c7-6e75f5992054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042996 Mar 08 04:23:07.876522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 262/536] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:08.115333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-879c1b5d-aa9b-4d17-adee-60cf11abd764 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:08.116268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-879c1b5d-aa9b-4d17-adee-60cf11abd764 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:08.123042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-879c1b5d-aa9b-4d17-adee-60cf11abd764 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:08.123489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-879c1b5d-aa9b-4d17-adee-60cf11abd764 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:08.124246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-879c1b5d-aa9b-4d17-adee-60cf11abd764 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:08.124683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-879c1b5d-aa9b-4d17-adee-60cf11abd764 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:08.152491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-879c1b5d-aa9b-4d17-adee-60cf11abd764 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041078 Mar 08 04:23:08.153027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 275/537] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:08.887942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-089e2f16-d073-4b56-950a-7b7ff6c57e1c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:08.888852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-089e2f16-d073-4b56-950a-7b7ff6c57e1c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:08.895093 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-089e2f16-d073-4b56-950a-7b7ff6c57e1c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:08.895535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-089e2f16-d073-4b56-950a-7b7ff6c57e1c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:08.896292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-089e2f16-d073-4b56-950a-7b7ff6c57e1c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:08.896725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-089e2f16-d073-4b56-950a-7b7ff6c57e1c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:08.923884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-089e2f16-d073-4b56-950a-7b7ff6c57e1c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040512 Mar 08 04:23:08.924579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 263/538] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:09.164246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fb326470-b55f-4542-ae5b-5eb561a3368e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:09.165155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fb326470-b55f-4542-ae5b-5eb561a3368e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:09.171892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb326470-b55f-4542-ae5b-5eb561a3368e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:09.172340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb326470-b55f-4542-ae5b-5eb561a3368e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:09.173098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb326470-b55f-4542-ae5b-5eb561a3368e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:09.173534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb326470-b55f-4542-ae5b-5eb561a3368e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:09.201821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fb326470-b55f-4542-ae5b-5eb561a3368e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041447 Mar 08 04:23:09.202361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 276/539] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:09.935774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-91d7e3b3-f10f-4c60-b3a9-be53ab87bad5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:09.936702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-91d7e3b3-f10f-4c60-b3a9-be53ab87bad5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:09.942995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d7e3b3-f10f-4c60-b3a9-be53ab87bad5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:09.943441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d7e3b3-f10f-4c60-b3a9-be53ab87bad5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:09.944196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d7e3b3-f10f-4c60-b3a9-be53ab87bad5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:09.944628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d7e3b3-f10f-4c60-b3a9-be53ab87bad5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:09.971706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-91d7e3b3-f10f-4c60-b3a9-be53ab87bad5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040637 Mar 08 04:23:09.972248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 264/540] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:09 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:10.213108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4ed9d6d2-1d75-4a74-9f49-5cda23e28e6c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:10.214583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4ed9d6d2-1d75-4a74-9f49-5cda23e28e6c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:10.220777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ed9d6d2-1d75-4a74-9f49-5cda23e28e6c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:10.221226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ed9d6d2-1d75-4a74-9f49-5cda23e28e6c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:10.222007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ed9d6d2-1d75-4a74-9f49-5cda23e28e6c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:10.222442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ed9d6d2-1d75-4a74-9f49-5cda23e28e6c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:10.250577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4ed9d6d2-1d75-4a74-9f49-5cda23e28e6c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 Mar 08 04:23:10.251116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 277/541] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:10.983259 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-849b538f-9832-46d5-b943-14b8958d232d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:10.984205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-849b538f-9832-46d5-b943-14b8958d232d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:10.990412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-849b538f-9832-46d5-b943-14b8958d232d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:10.990860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-849b538f-9832-46d5-b943-14b8958d232d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:10.991631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-849b538f-9832-46d5-b943-14b8958d232d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:10.992060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-849b538f-9832-46d5-b943-14b8958d232d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:11.020420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-849b538f-9832-46d5-b943-14b8958d232d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Mar 08 04:23:11.020960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 265/542] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:11.262120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c6fce50a-a566-4e37-a174-d910f08ca2ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:11.263399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c6fce50a-a566-4e37-a174-d910f08ca2ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:11.269617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6fce50a-a566-4e37-a174-d910f08ca2ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:11.270092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6fce50a-a566-4e37-a174-d910f08ca2ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:11.270845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6fce50a-a566-4e37-a174-d910f08ca2ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:11.271273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6fce50a-a566-4e37-a174-d910f08ca2ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:11.299901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c6fce50a-a566-4e37-a174-d910f08ca2ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Mar 08 04:23:11.300437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 278/543] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:12.032642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c8a888dd-b582-41d4-bc28-d570c2a694f4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:12.033552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c8a888dd-b582-41d4-bc28-d570c2a694f4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:12.039727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c8a888dd-b582-41d4-bc28-d570c2a694f4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:12.040179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c8a888dd-b582-41d4-bc28-d570c2a694f4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:12.040943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c8a888dd-b582-41d4-bc28-d570c2a694f4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:12.041382 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c8a888dd-b582-41d4-bc28-d570c2a694f4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:12.072612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c8a888dd-b582-41d4-bc28-d570c2a694f4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 Mar 08 04:23:12.073789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 266/544] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:12.311748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-94fab605-9e72-4866-b792-5e594edc6b18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:12.312654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-94fab605-9e72-4866-b792-5e594edc6b18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:12.318844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94fab605-9e72-4866-b792-5e594edc6b18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:12.319296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94fab605-9e72-4866-b792-5e594edc6b18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:12.320058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94fab605-9e72-4866-b792-5e594edc6b18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:12.320490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94fab605-9e72-4866-b792-5e594edc6b18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:12.349467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-94fab605-9e72-4866-b792-5e594edc6b18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042146 Mar 08 04:23:12.350058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 279/545] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:13.086168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1f7ba8ea-8dc5-4a49-85f4-91ca98a14e3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:13.087026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1f7ba8ea-8dc5-4a49-85f4-91ca98a14e3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:13.093559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f7ba8ea-8dc5-4a49-85f4-91ca98a14e3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:13.094042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f7ba8ea-8dc5-4a49-85f4-91ca98a14e3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:13.094797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f7ba8ea-8dc5-4a49-85f4-91ca98a14e3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:13.095229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f7ba8ea-8dc5-4a49-85f4-91ca98a14e3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:13.123631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1f7ba8ea-8dc5-4a49-85f4-91ca98a14e3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041507 Mar 08 04:23:13.124181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 267/546] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:13.361639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a90eebf5-a143-459c-abbd-c5a367691dfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:13.362489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a90eebf5-a143-459c-abbd-c5a367691dfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:13.368631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a90eebf5-a143-459c-abbd-c5a367691dfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:13.369075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a90eebf5-a143-459c-abbd-c5a367691dfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:13.369888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a90eebf5-a143-459c-abbd-c5a367691dfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:13.370459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a90eebf5-a143-459c-abbd-c5a367691dfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:13.397075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a90eebf5-a143-459c-abbd-c5a367691dfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039492 Mar 08 04:23:13.397605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 280/547] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:14.135130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e28ae598-fb10-4eb5-9fe5-e803d459dec6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:14.136052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e28ae598-fb10-4eb5-9fe5-e803d459dec6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:14.142234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e28ae598-fb10-4eb5-9fe5-e803d459dec6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:14.142678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e28ae598-fb10-4eb5-9fe5-e803d459dec6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:14.143441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e28ae598-fb10-4eb5-9fe5-e803d459dec6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:14.143873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e28ae598-fb10-4eb5-9fe5-e803d459dec6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:14.173050 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e28ae598-fb10-4eb5-9fe5-e803d459dec6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041893 Mar 08 04:23:14.173599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 268/548] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:14.408889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c7b26478-2e8e-4055-886b-6943a37f7158 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:14.409736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c7b26478-2e8e-4055-886b-6943a37f7158 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:14.415944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c7b26478-2e8e-4055-886b-6943a37f7158 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:14.416402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c7b26478-2e8e-4055-886b-6943a37f7158 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:14.417386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c7b26478-2e8e-4055-886b-6943a37f7158 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:14.417856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c7b26478-2e8e-4055-886b-6943a37f7158 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:14.444979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c7b26478-2e8e-4055-886b-6943a37f7158 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040477 Mar 08 04:23:14.445513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 281/549] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:15.185228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-511516b0-985d-430b-8512-6e3f44606108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:15.186154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-511516b0-985d-430b-8512-6e3f44606108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:15.192642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-511516b0-985d-430b-8512-6e3f44606108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:15.193097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-511516b0-985d-430b-8512-6e3f44606108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:15.193903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-511516b0-985d-430b-8512-6e3f44606108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:15.194347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-511516b0-985d-430b-8512-6e3f44606108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:15.222242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-511516b0-985d-430b-8512-6e3f44606108 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041694 Mar 08 04:23:15.222815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 269/550] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:15.457373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fb5e1ca0-ea5f-48dc-9249-2be7aa9052e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:15.458298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fb5e1ca0-ea5f-48dc-9249-2be7aa9052e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:15.464968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb5e1ca0-ea5f-48dc-9249-2be7aa9052e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:15.465412 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb5e1ca0-ea5f-48dc-9249-2be7aa9052e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:15.466199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb5e1ca0-ea5f-48dc-9249-2be7aa9052e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:15.466629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb5e1ca0-ea5f-48dc-9249-2be7aa9052e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:15.495204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fb5e1ca0-ea5f-48dc-9249-2be7aa9052e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Mar 08 04:23:15.495767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 282/551] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:16.234028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-38b92fcf-a0d0-47ba-99c4-c761d0614a1f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:16.235054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-38b92fcf-a0d0-47ba-99c4-c761d0614a1f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:16.241168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38b92fcf-a0d0-47ba-99c4-c761d0614a1f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:16.241612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38b92fcf-a0d0-47ba-99c4-c761d0614a1f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:16.242407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38b92fcf-a0d0-47ba-99c4-c761d0614a1f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:16.242932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38b92fcf-a0d0-47ba-99c4-c761d0614a1f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:16.271407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-38b92fcf-a0d0-47ba-99c4-c761d0614a1f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041290 Mar 08 04:23:16.271974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 270/552] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:16 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:16.506805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-823908f9-09aa-4723-8787-f299d2d66377 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:16.507673 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-823908f9-09aa-4723-8787-f299d2d66377 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:16.514577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-823908f9-09aa-4723-8787-f299d2d66377 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:16.515025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-823908f9-09aa-4723-8787-f299d2d66377 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:16.515785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-823908f9-09aa-4723-8787-f299d2d66377 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:16.516219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-823908f9-09aa-4723-8787-f299d2d66377 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:16.544294 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-823908f9-09aa-4723-8787-f299d2d66377 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041458 Mar 08 04:23:16.544834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 283/553] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:17.282837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ff3ea611-d47d-4883-b41e-bd67ee9d5a4c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:17.283746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ff3ea611-d47d-4883-b41e-bd67ee9d5a4c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:17.290031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea611-d47d-4883-b41e-bd67ee9d5a4c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:17.290481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea611-d47d-4883-b41e-bd67ee9d5a4c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:17.291282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea611-d47d-4883-b41e-bd67ee9d5a4c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:17.292294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea611-d47d-4883-b41e-bd67ee9d5a4c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:17.319561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ff3ea611-d47d-4883-b41e-bd67ee9d5a4c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040902 Mar 08 04:23:17.320108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 271/554] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:17.555773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c90f1c85-82ef-4243-8beb-fffe72de8928 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:17.556716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c90f1c85-82ef-4243-8beb-fffe72de8928 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:17.563002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c90f1c85-82ef-4243-8beb-fffe72de8928 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:17.563448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c90f1c85-82ef-4243-8beb-fffe72de8928 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:17.564212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c90f1c85-82ef-4243-8beb-fffe72de8928 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:17.564647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c90f1c85-82ef-4243-8beb-fffe72de8928 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:17.593347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c90f1c85-82ef-4243-8beb-fffe72de8928 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041487 Mar 08 04:23:17.593931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 284/555] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:18.331531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f6bb962d-3e41-407d-ae15-49b88c8d07ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:18.332463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f6bb962d-3e41-407d-ae15-49b88c8d07ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:18.338302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6bb962d-3e41-407d-ae15-49b88c8d07ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:18.339582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6bb962d-3e41-407d-ae15-49b88c8d07ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:18.340362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6bb962d-3e41-407d-ae15-49b88c8d07ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:18.340794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6bb962d-3e41-407d-ae15-49b88c8d07ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:18.369359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f6bb962d-3e41-407d-ae15-49b88c8d07ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041807 Mar 08 04:23:18.371086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 272/556] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:18.604153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e5074e5a-c982-40d8-a098-422a239a1c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:18.605219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e5074e5a-c982-40d8-a098-422a239a1c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:18.611418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5074e5a-c982-40d8-a098-422a239a1c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:18.611865 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5074e5a-c982-40d8-a098-422a239a1c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:18.612615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5074e5a-c982-40d8-a098-422a239a1c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:18.613047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5074e5a-c982-40d8-a098-422a239a1c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:18.641339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e5074e5a-c982-40d8-a098-422a239a1c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041283 Mar 08 04:23:18.641917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 285/557] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:19.381341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ba1b0775-aab4-4272-8911-e7e65e7cbb88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:19.382287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ba1b0775-aab4-4272-8911-e7e65e7cbb88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:19.389109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba1b0775-aab4-4272-8911-e7e65e7cbb88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:19.389575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba1b0775-aab4-4272-8911-e7e65e7cbb88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:19.390354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba1b0775-aab4-4272-8911-e7e65e7cbb88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:19.390799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba1b0775-aab4-4272-8911-e7e65e7cbb88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:19.418209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ba1b0775-aab4-4272-8911-e7e65e7cbb88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040906 Mar 08 04:23:19.418752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 273/558] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:19.652924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bae035c6-1316-4800-a74d-bc4c27c53e9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:19.653770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bae035c6-1316-4800-a74d-bc4c27c53e9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:19.660249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bae035c6-1316-4800-a74d-bc4c27c53e9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:19.660689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bae035c6-1316-4800-a74d-bc4c27c53e9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:19.661442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bae035c6-1316-4800-a74d-bc4c27c53e9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:19.661894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bae035c6-1316-4800-a74d-bc4c27c53e9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:19.690730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bae035c6-1316-4800-a74d-bc4c27c53e9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 Mar 08 04:23:19.691285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 286/559] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:20.429460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4ae7278c-582d-4dd1-bc50-a1e14dcb96fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:20.430419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4ae7278c-582d-4dd1-bc50-a1e14dcb96fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:20.437128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ae7278c-582d-4dd1-bc50-a1e14dcb96fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:20.437570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ae7278c-582d-4dd1-bc50-a1e14dcb96fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:20.438361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ae7278c-582d-4dd1-bc50-a1e14dcb96fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:20.438792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ae7278c-582d-4dd1-bc50-a1e14dcb96fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:20.466025 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4ae7278c-582d-4dd1-bc50-a1e14dcb96fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040454 Mar 08 04:23:20.466562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 274/560] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:20 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:20.702965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4e60c536-163b-41cd-a62c-436514ba4462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:20.703922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4e60c536-163b-41cd-a62c-436514ba4462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:20.710292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e60c536-163b-41cd-a62c-436514ba4462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:20.710741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e60c536-163b-41cd-a62c-436514ba4462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:20.711499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e60c536-163b-41cd-a62c-436514ba4462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:20.711930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e60c536-163b-41cd-a62c-436514ba4462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:20.740479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4e60c536-163b-41cd-a62c-436514ba4462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041798 Mar 08 04:23:20.741029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 287/561] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:21.476816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8d3b4837-7e7a-44df-a724-a0e50f09227b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:21.477745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8d3b4837-7e7a-44df-a724-a0e50f09227b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:21.484085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d3b4837-7e7a-44df-a724-a0e50f09227b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:21.484552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d3b4837-7e7a-44df-a724-a0e50f09227b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:21.485309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d3b4837-7e7a-44df-a724-a0e50f09227b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:21.485775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d3b4837-7e7a-44df-a724-a0e50f09227b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:21.513954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8d3b4837-7e7a-44df-a724-a0e50f09227b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041138 Mar 08 04:23:21.514608 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 275/562] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:21 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:21.752441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-01b998bd-620a-45df-9146-1e10292aa4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:21.753353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-01b998bd-620a-45df-9146-1e10292aa4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:21.759667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01b998bd-620a-45df-9146-1e10292aa4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:21.760134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01b998bd-620a-45df-9146-1e10292aa4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:21.761581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01b998bd-620a-45df-9146-1e10292aa4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:21.762064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-01b998bd-620a-45df-9146-1e10292aa4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:21.790708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-01b998bd-620a-45df-9146-1e10292aa4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042771 Mar 08 04:23:21.791263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 288/563] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:22.525552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-df573238-83b0-4441-a9f3-a37bdc72d2b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:22.527172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-df573238-83b0-4441-a9f3-a37bdc72d2b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:22.533930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df573238-83b0-4441-a9f3-a37bdc72d2b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:22.534377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df573238-83b0-4441-a9f3-a37bdc72d2b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:22.535128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df573238-83b0-4441-a9f3-a37bdc72d2b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:22.535561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df573238-83b0-4441-a9f3-a37bdc72d2b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:22.563111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-df573238-83b0-4441-a9f3-a37bdc72d2b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041547 Mar 08 04:23:22.563647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 276/564] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:22.802762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a166a418-54fa-4630-9cbb-21f0313e80cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:22.803670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a166a418-54fa-4630-9cbb-21f0313e80cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:22.809953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a166a418-54fa-4630-9cbb-21f0313e80cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:22.810395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a166a418-54fa-4630-9cbb-21f0313e80cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:22.811151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a166a418-54fa-4630-9cbb-21f0313e80cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:22.811584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a166a418-54fa-4630-9cbb-21f0313e80cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:22.840506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a166a418-54fa-4630-9cbb-21f0313e80cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041677 Mar 08 04:23:22.841044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 289/565] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:23.575091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a494640d-ef47-4cbc-96a8-2e670f2c86d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:23.576004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a494640d-ef47-4cbc-96a8-2e670f2c86d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:23.582242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a494640d-ef47-4cbc-96a8-2e670f2c86d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:23.582691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a494640d-ef47-4cbc-96a8-2e670f2c86d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:23.583452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a494640d-ef47-4cbc-96a8-2e670f2c86d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:23.583885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a494640d-ef47-4cbc-96a8-2e670f2c86d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:23.612943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a494640d-ef47-4cbc-96a8-2e670f2c86d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 Mar 08 04:23:23.613492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 277/566] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:23.852138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8af14bd6-53f8-4e8c-9999-d245ea35c5c7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:23.853016 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8af14bd6-53f8-4e8c-9999-d245ea35c5c7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:23.859971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8af14bd6-53f8-4e8c-9999-d245ea35c5c7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:23.860494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8af14bd6-53f8-4e8c-9999-d245ea35c5c7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:23.861279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8af14bd6-53f8-4e8c-9999-d245ea35c5c7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:23.861745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8af14bd6-53f8-4e8c-9999-d245ea35c5c7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:23.890023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8af14bd6-53f8-4e8c-9999-d245ea35c5c7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041916 Mar 08 04:23:23.890571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 290/567] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:24.624342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c13fbdcc-77d5-4484-a80d-cead6a796fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:24.625244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c13fbdcc-77d5-4484-a80d-cead6a796fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:24.631401 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c13fbdcc-77d5-4484-a80d-cead6a796fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:24.631847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c13fbdcc-77d5-4484-a80d-cead6a796fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:24.632615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c13fbdcc-77d5-4484-a80d-cead6a796fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:24.633049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c13fbdcc-77d5-4484-a80d-cead6a796fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:24.661092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c13fbdcc-77d5-4484-a80d-cead6a796fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040602 Mar 08 04:23:24.661855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 278/568] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:24 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:24.901486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3433ce64-db55-4b2e-a87d-c614143b97f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:24.902979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3433ce64-db55-4b2e-a87d-c614143b97f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:24.909448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3433ce64-db55-4b2e-a87d-c614143b97f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:24.909925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3433ce64-db55-4b2e-a87d-c614143b97f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:24.910677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3433ce64-db55-4b2e-a87d-c614143b97f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:24.911107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3433ce64-db55-4b2e-a87d-c614143b97f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:24.938936 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3433ce64-db55-4b2e-a87d-c614143b97f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Mar 08 04:23:24.939497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 291/569] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:25.673571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-31596296-5220-4952-8022-11bf00cf2ac3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:25.675244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-31596296-5220-4952-8022-11bf00cf2ac3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:25.681757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31596296-5220-4952-8022-11bf00cf2ac3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:25.682215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31596296-5220-4952-8022-11bf00cf2ac3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:25.682998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31596296-5220-4952-8022-11bf00cf2ac3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:25.684019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31596296-5220-4952-8022-11bf00cf2ac3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:25.711594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-31596296-5220-4952-8022-11bf00cf2ac3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 Mar 08 04:23:25.712143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 279/570] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:25 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:25.950618 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-39178e85-3989-4b4e-9698-3b50b94dc07a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:25.951527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-39178e85-3989-4b4e-9698-3b50b94dc07a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:25.957727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39178e85-3989-4b4e-9698-3b50b94dc07a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:25.958177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39178e85-3989-4b4e-9698-3b50b94dc07a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:25.958933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39178e85-3989-4b4e-9698-3b50b94dc07a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:25.959367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39178e85-3989-4b4e-9698-3b50b94dc07a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:25.988604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-39178e85-3989-4b4e-9698-3b50b94dc07a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041964 Mar 08 04:23:25.989154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 292/571] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:26.723294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-77bc1642-263b-4a2f-baae-62df5cc4deba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:26.724197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-77bc1642-263b-4a2f-baae-62df5cc4deba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:26.730470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77bc1642-263b-4a2f-baae-62df5cc4deba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:26.730913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77bc1642-263b-4a2f-baae-62df5cc4deba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:26.731685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77bc1642-263b-4a2f-baae-62df5cc4deba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:26.732098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77bc1642-263b-4a2f-baae-62df5cc4deba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:26.760719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-77bc1642-263b-4a2f-baae-62df5cc4deba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041436 Mar 08 04:23:26.761911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 280/572] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:27.000472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-16b8917b-9cc1-4256-9464-e0645bd244ac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:27.001385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-16b8917b-9cc1-4256-9464-e0645bd244ac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:27.007654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-16b8917b-9cc1-4256-9464-e0645bd244ac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:27.008104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-16b8917b-9cc1-4256-9464-e0645bd244ac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:27.008866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-16b8917b-9cc1-4256-9464-e0645bd244ac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:27.009307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-16b8917b-9cc1-4256-9464-e0645bd244ac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:27.037431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-16b8917b-9cc1-4256-9464-e0645bd244ac tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040916 Mar 08 04:23:27.038009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 293/573] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:27.772618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fe1fa824-c066-43c9-b0b9-306d0b46906e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:27.773522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fe1fa824-c066-43c9-b0b9-306d0b46906e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:27.779768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe1fa824-c066-43c9-b0b9-306d0b46906e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:27.780476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe1fa824-c066-43c9-b0b9-306d0b46906e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:27.781230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe1fa824-c066-43c9-b0b9-306d0b46906e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:27.781677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe1fa824-c066-43c9-b0b9-306d0b46906e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:27.809106 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fe1fa824-c066-43c9-b0b9-306d0b46906e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040631 Mar 08 04:23:27.810252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 281/574] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:27 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:28.049505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6af07eca-764c-444b-8df9-323252fabe00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:28.050460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6af07eca-764c-444b-8df9-323252fabe00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:28.056652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6af07eca-764c-444b-8df9-323252fabe00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:28.057098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6af07eca-764c-444b-8df9-323252fabe00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:28.057891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6af07eca-764c-444b-8df9-323252fabe00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:28.058320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6af07eca-764c-444b-8df9-323252fabe00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:28.086070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6af07eca-764c-444b-8df9-323252fabe00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040412 Mar 08 04:23:28.086610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 294/575] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:28.820445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e7efa47d-f14d-4348-97ed-9419c1535244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:28.821373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e7efa47d-f14d-4348-97ed-9419c1535244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:28.828064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7efa47d-f14d-4348-97ed-9419c1535244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:28.828510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7efa47d-f14d-4348-97ed-9419c1535244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:28.829265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7efa47d-f14d-4348-97ed-9419c1535244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:28.829751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7efa47d-f14d-4348-97ed-9419c1535244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:28.857669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e7efa47d-f14d-4348-97ed-9419c1535244 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041158 Mar 08 04:23:28.858227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 282/576] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:29.097649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-437d2b70-8086-4a6a-b9c0-0f6d4ed63b97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:29.098582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-437d2b70-8086-4a6a-b9c0-0f6d4ed63b97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:29.104712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-437d2b70-8086-4a6a-b9c0-0f6d4ed63b97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:29.105168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-437d2b70-8086-4a6a-b9c0-0f6d4ed63b97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:29.105986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-437d2b70-8086-4a6a-b9c0-0f6d4ed63b97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:29.106458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-437d2b70-8086-4a6a-b9c0-0f6d4ed63b97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:29.134087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-437d2b70-8086-4a6a-b9c0-0f6d4ed63b97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040424 Mar 08 04:23:29.134632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 295/577] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:29.868729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f9457d51-13f6-4cd9-81e7-e681039d2f18 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:29.869880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f9457d51-13f6-4cd9-81e7-e681039d2f18 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:29.876510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9457d51-13f6-4cd9-81e7-e681039d2f18 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:29.876898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9457d51-13f6-4cd9-81e7-e681039d2f18 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:29.877683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9457d51-13f6-4cd9-81e7-e681039d2f18 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:29.878126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9457d51-13f6-4cd9-81e7-e681039d2f18 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:29.907345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f9457d51-13f6-4cd9-81e7-e681039d2f18 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042502 Mar 08 04:23:29.907901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 283/578] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:29 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:30.146192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ca650bff-3c92-4876-95f6-2766a1173f79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:30.147021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ca650bff-3c92-4876-95f6-2766a1173f79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:30.153973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca650bff-3c92-4876-95f6-2766a1173f79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:30.154428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca650bff-3c92-4876-95f6-2766a1173f79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:30.155457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca650bff-3c92-4876-95f6-2766a1173f79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:30.155892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca650bff-3c92-4876-95f6-2766a1173f79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:30.183470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ca650bff-3c92-4876-95f6-2766a1173f79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041328 Mar 08 04:23:30.184073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 296/579] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:30.920105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bd680695-a59a-4ff6-b932-304bf3b72eb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:30.921043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bd680695-a59a-4ff6-b932-304bf3b72eb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:30.927473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd680695-a59a-4ff6-b932-304bf3b72eb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:30.927915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd680695-a59a-4ff6-b932-304bf3b72eb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:30.928683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd680695-a59a-4ff6-b932-304bf3b72eb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:30.929117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd680695-a59a-4ff6-b932-304bf3b72eb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:30.957269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bd680695-a59a-4ff6-b932-304bf3b72eb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041643 Mar 08 04:23:30.957853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 284/580] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:30 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:31.195186 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-876400bb-6134-45b7-9817-258711ce3729 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:31.196133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-876400bb-6134-45b7-9817-258711ce3729 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:31.202533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-876400bb-6134-45b7-9817-258711ce3729 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:31.202985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-876400bb-6134-45b7-9817-258711ce3729 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:31.203744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-876400bb-6134-45b7-9817-258711ce3729 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:31.204178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-876400bb-6134-45b7-9817-258711ce3729 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:31.232531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-876400bb-6134-45b7-9817-258711ce3729 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 Mar 08 04:23:31.233075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 297/581] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:31.967784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ad8207de-15fe-4d52-821d-67c0d7eb358f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:31.968693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ad8207de-15fe-4d52-821d-67c0d7eb358f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:31.974919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad8207de-15fe-4d52-821d-67c0d7eb358f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:31.975366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad8207de-15fe-4d52-821d-67c0d7eb358f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:31.976129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad8207de-15fe-4d52-821d-67c0d7eb358f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:31.976562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad8207de-15fe-4d52-821d-67c0d7eb358f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:32.004246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ad8207de-15fe-4d52-821d-67c0d7eb358f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040449 Mar 08 04:23:32.004778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 285/582] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:32.244099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8a2a6a4a-29fc-44c4-b013-a3de8f585f2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:32.245006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8a2a6a4a-29fc-44c4-b013-a3de8f585f2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:32.251950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a2a6a4a-29fc-44c4-b013-a3de8f585f2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:32.252419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a2a6a4a-29fc-44c4-b013-a3de8f585f2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:32.253162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a2a6a4a-29fc-44c4-b013-a3de8f585f2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:32.253602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a2a6a4a-29fc-44c4-b013-a3de8f585f2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:32.281927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8a2a6a4a-29fc-44c4-b013-a3de8f585f2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041686 Mar 08 04:23:32.282490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 298/583] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:33.015293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8d707a2a-bcda-47cc-82c2-88856eb03bf3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:33.016205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8d707a2a-bcda-47cc-82c2-88856eb03bf3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:33.022482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d707a2a-bcda-47cc-82c2-88856eb03bf3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:33.022934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d707a2a-bcda-47cc-82c2-88856eb03bf3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:33.023699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d707a2a-bcda-47cc-82c2-88856eb03bf3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:33.024137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d707a2a-bcda-47cc-82c2-88856eb03bf3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:33.052920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8d707a2a-bcda-47cc-82c2-88856eb03bf3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 Mar 08 04:23:33.053404 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 286/584] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:33.293556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b873a8f6-3c7d-4b65-a50f-f88d69cdf572 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:33.294598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b873a8f6-3c7d-4b65-a50f-f88d69cdf572 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:33.300734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b873a8f6-3c7d-4b65-a50f-f88d69cdf572 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:33.301173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b873a8f6-3c7d-4b65-a50f-f88d69cdf572 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:33.301954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b873a8f6-3c7d-4b65-a50f-f88d69cdf572 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:33.302382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b873a8f6-3c7d-4b65-a50f-f88d69cdf572 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:33.329957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b873a8f6-3c7d-4b65-a50f-f88d69cdf572 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040407 Mar 08 04:23:33.330437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 299/585] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:34.064257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5b91dad2-b25f-4364-a241-5db674f4144c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:34.065166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5b91dad2-b25f-4364-a241-5db674f4144c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:34.071312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b91dad2-b25f-4364-a241-5db674f4144c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:34.071756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b91dad2-b25f-4364-a241-5db674f4144c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:34.072521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b91dad2-b25f-4364-a241-5db674f4144c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:34.072952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b91dad2-b25f-4364-a241-5db674f4144c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:34.101944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5b91dad2-b25f-4364-a241-5db674f4144c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041510 Mar 08 04:23:34.102501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 287/586] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:34 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:34.340459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9f08fe45-8206-48a2-9971-76423f6c1d50 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:34.341360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9f08fe45-8206-48a2-9971-76423f6c1d50 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:34.347754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f08fe45-8206-48a2-9971-76423f6c1d50 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:34.348196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f08fe45-8206-48a2-9971-76423f6c1d50 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:34.348957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f08fe45-8206-48a2-9971-76423f6c1d50 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:34.349387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f08fe45-8206-48a2-9971-76423f6c1d50 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:34.379683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9f08fe45-8206-48a2-9971-76423f6c1d50 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 Mar 08 04:23:34.381038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 300/587] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:35.113856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-615181b9-5de1-46ca-bac5-68af6c57f43d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:35.114692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-615181b9-5de1-46ca-bac5-68af6c57f43d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:35.120930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-615181b9-5de1-46ca-bac5-68af6c57f43d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:35.121591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-615181b9-5de1-46ca-bac5-68af6c57f43d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:35.122385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-615181b9-5de1-46ca-bac5-68af6c57f43d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:35.122824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-615181b9-5de1-46ca-bac5-68af6c57f43d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:35.149977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-615181b9-5de1-46ca-bac5-68af6c57f43d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040163 Mar 08 04:23:35.150519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 288/588] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:35.393101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-25bd9431-0167-4be9-8727-0ee453ca7b32 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:35.394015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-25bd9431-0167-4be9-8727-0ee453ca7b32 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:35.399790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25bd9431-0167-4be9-8727-0ee453ca7b32 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:35.400243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25bd9431-0167-4be9-8727-0ee453ca7b32 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:35.401004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25bd9431-0167-4be9-8727-0ee453ca7b32 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:35.401436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25bd9431-0167-4be9-8727-0ee453ca7b32 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:35.429963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-25bd9431-0167-4be9-8727-0ee453ca7b32 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041029 Mar 08 04:23:35.430505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 301/589] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:36.163134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4188f80b-ac41-4785-9de8-209d2ea1f050 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:36.164052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4188f80b-ac41-4785-9de8-209d2ea1f050 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:36.171006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4188f80b-ac41-4785-9de8-209d2ea1f050 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:36.171459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4188f80b-ac41-4785-9de8-209d2ea1f050 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:36.172227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4188f80b-ac41-4785-9de8-209d2ea1f050 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:36.172669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4188f80b-ac41-4785-9de8-209d2ea1f050 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:36.200576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4188f80b-ac41-4785-9de8-209d2ea1f050 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042095 Mar 08 04:23:36.201150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 289/590] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:36.441258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a6d867cf-fc1a-4e78-8ada-b79b98b798fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:36.442213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a6d867cf-fc1a-4e78-8ada-b79b98b798fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:36.448415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6d867cf-fc1a-4e78-8ada-b79b98b798fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:36.448857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6d867cf-fc1a-4e78-8ada-b79b98b798fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:36.449815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6d867cf-fc1a-4e78-8ada-b79b98b798fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:36.450257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6d867cf-fc1a-4e78-8ada-b79b98b798fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:36.477679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a6d867cf-fc1a-4e78-8ada-b79b98b798fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040366 Mar 08 04:23:36.478275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 302/591] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:37.211375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ecd0b6d5-e788-4943-b1dc-67ec9bcd1495 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:37.212309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ecd0b6d5-e788-4943-b1dc-67ec9bcd1495 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:37.218520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ecd0b6d5-e788-4943-b1dc-67ec9bcd1495 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:37.218968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ecd0b6d5-e788-4943-b1dc-67ec9bcd1495 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:37.219730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ecd0b6d5-e788-4943-b1dc-67ec9bcd1495 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:37.220166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ecd0b6d5-e788-4943-b1dc-67ec9bcd1495 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:37.247694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ecd0b6d5-e788-4943-b1dc-67ec9bcd1495 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040214 Mar 08 04:23:37.248236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 290/592] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:37.490080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e669be97-e251-462b-b743-685ff3ea66ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:37.490989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e669be97-e251-462b-b743-685ff3ea66ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:37.497173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e669be97-e251-462b-b743-685ff3ea66ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:37.497609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e669be97-e251-462b-b743-685ff3ea66ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:37.498394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e669be97-e251-462b-b743-685ff3ea66ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:37.498820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e669be97-e251-462b-b743-685ff3ea66ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:37.527277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e669be97-e251-462b-b743-685ff3ea66ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041077 Mar 08 04:23:37.527828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 303/593] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:38.259042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-55f1b27f-0492-4fa1-9c17-269a26121fd6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:38.259981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-55f1b27f-0492-4fa1-9c17-269a26121fd6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:38.266828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55f1b27f-0492-4fa1-9c17-269a26121fd6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:38.267275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55f1b27f-0492-4fa1-9c17-269a26121fd6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:38.268038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55f1b27f-0492-4fa1-9c17-269a26121fd6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:38.268472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55f1b27f-0492-4fa1-9c17-269a26121fd6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:38.296822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-55f1b27f-0492-4fa1-9c17-269a26121fd6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 Mar 08 04:23:38.297373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 291/594] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:38 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:38.539052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-27f62a4c-be48-470e-a484-8d96b947a624 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:38.539958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-27f62a4c-be48-470e-a484-8d96b947a624 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:38.546335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27f62a4c-be48-470e-a484-8d96b947a624 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:38.546768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27f62a4c-be48-470e-a484-8d96b947a624 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:38.547524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27f62a4c-be48-470e-a484-8d96b947a624 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:38.547960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27f62a4c-be48-470e-a484-8d96b947a624 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:38.575552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-27f62a4c-be48-470e-a484-8d96b947a624 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040449 Mar 08 04:23:38.576086 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 304/595] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:39.307264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-03b430b7-16ee-4c3e-bdc2-b055766dbd35 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:39.308175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-03b430b7-16ee-4c3e-bdc2-b055766dbd35 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:39.315258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-03b430b7-16ee-4c3e-bdc2-b055766dbd35 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:39.315705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-03b430b7-16ee-4c3e-bdc2-b055766dbd35 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:39.316469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-03b430b7-16ee-4c3e-bdc2-b055766dbd35 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:39.316906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-03b430b7-16ee-4c3e-bdc2-b055766dbd35 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:39.344544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-03b430b7-16ee-4c3e-bdc2-b055766dbd35 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041179 Mar 08 04:23:39.345119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 292/596] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:39.587074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b837e8af-e5a3-476c-9fb4-5df661105327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:39.587900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b837e8af-e5a3-476c-9fb4-5df661105327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:39.594884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b837e8af-e5a3-476c-9fb4-5df661105327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:39.595327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b837e8af-e5a3-476c-9fb4-5df661105327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:39.596080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b837e8af-e5a3-476c-9fb4-5df661105327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:39.596509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b837e8af-e5a3-476c-9fb4-5df661105327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:39.624448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b837e8af-e5a3-476c-9fb4-5df661105327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041356 Mar 08 04:23:39.624982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 305/597] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:40.289025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:23:40.289183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:23:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:23:40.356468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4b132060-7d26-4480-9f75-02164017ed67 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:40.357482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4b132060-7d26-4480-9f75-02164017ed67 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:40.363729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4b132060-7d26-4480-9f75-02164017ed67 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:40.364184 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4b132060-7d26-4480-9f75-02164017ed67 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:40.364955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4b132060-7d26-4480-9f75-02164017ed67 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:40.365396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4b132060-7d26-4480-9f75-02164017ed67 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:40.392615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4b132060-7d26-4480-9f75-02164017ed67 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040755 Mar 08 04:23:40.393172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 293/598] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:40.635995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9cdf055d-59fb-4e06-80e4-1e1ed86ac6d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:40.637444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9cdf055d-59fb-4e06-80e4-1e1ed86ac6d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:40.644250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9cdf055d-59fb-4e06-80e4-1e1ed86ac6d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:40.644699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9cdf055d-59fb-4e06-80e4-1e1ed86ac6d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:40.645453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9cdf055d-59fb-4e06-80e4-1e1ed86ac6d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:40.645909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9cdf055d-59fb-4e06-80e4-1e1ed86ac6d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:40.673608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9cdf055d-59fb-4e06-80e4-1e1ed86ac6d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041607 Mar 08 04:23:40.674176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 306/599] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:41.404543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f0a115e5-1a2c-40bb-b0d7-b93af77f04f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:41.405717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f0a115e5-1a2c-40bb-b0d7-b93af77f04f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:41.411860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f0a115e5-1a2c-40bb-b0d7-b93af77f04f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:41.412310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f0a115e5-1a2c-40bb-b0d7-b93af77f04f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:41.413064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f0a115e5-1a2c-40bb-b0d7-b93af77f04f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:41.413500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f0a115e5-1a2c-40bb-b0d7-b93af77f04f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:41.440733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f0a115e5-1a2c-40bb-b0d7-b93af77f04f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040738 Mar 08 04:23:41.441273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 294/600] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:41.685642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b7375bce-078d-4bcc-9a73-ef715e663165 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:41.686583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b7375bce-078d-4bcc-9a73-ef715e663165 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:41.692854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7375bce-078d-4bcc-9a73-ef715e663165 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:41.693308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7375bce-078d-4bcc-9a73-ef715e663165 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:41.694107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7375bce-078d-4bcc-9a73-ef715e663165 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:41.694549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7375bce-078d-4bcc-9a73-ef715e663165 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:41.725304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b7375bce-078d-4bcc-9a73-ef715e663165 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Mar 08 04:23:41.725909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 307/601] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:42.451983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a577149e-1aad-474b-930d-365a46598cb6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:42.452886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a577149e-1aad-474b-930d-365a46598cb6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:42.459015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a577149e-1aad-474b-930d-365a46598cb6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:42.459459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a577149e-1aad-474b-930d-365a46598cb6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:42.460218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a577149e-1aad-474b-930d-365a46598cb6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:42.460648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a577149e-1aad-474b-930d-365a46598cb6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:42.489253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a577149e-1aad-474b-930d-365a46598cb6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041193 Mar 08 04:23:42.490165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 295/602] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:42 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:42.737509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b904e905-5501-46f8-b5cf-dfd0f762455f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:42.738450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b904e905-5501-46f8-b5cf-dfd0f762455f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:42.744619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b904e905-5501-46f8-b5cf-dfd0f762455f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:42.745066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b904e905-5501-46f8-b5cf-dfd0f762455f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:42.745856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b904e905-5501-46f8-b5cf-dfd0f762455f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:42.746321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b904e905-5501-46f8-b5cf-dfd0f762455f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:42.775103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b904e905-5501-46f8-b5cf-dfd0f762455f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041528 Mar 08 04:23:42.775645 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 308/603] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:43.501089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6e49d1ff-6f6e-40e7-8159-32975e0d65b8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:43.502057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6e49d1ff-6f6e-40e7-8159-32975e0d65b8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:43.508272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e49d1ff-6f6e-40e7-8159-32975e0d65b8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:43.508720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e49d1ff-6f6e-40e7-8159-32975e0d65b8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:43.509488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e49d1ff-6f6e-40e7-8159-32975e0d65b8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:43.509949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e49d1ff-6f6e-40e7-8159-32975e0d65b8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:43.538284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6e49d1ff-6f6e-40e7-8159-32975e0d65b8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041797 Mar 08 04:23:43.538834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 296/604] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:43.787421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-aa38f55e-87ad-499d-8d01-e153a7dba893 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:43.788365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-aa38f55e-87ad-499d-8d01-e153a7dba893 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:43.794756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aa38f55e-87ad-499d-8d01-e153a7dba893 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:43.795316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aa38f55e-87ad-499d-8d01-e153a7dba893 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:43.796084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aa38f55e-87ad-499d-8d01-e153a7dba893 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:43.796519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aa38f55e-87ad-499d-8d01-e153a7dba893 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:43.826356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-aa38f55e-87ad-499d-8d01-e153a7dba893 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Mar 08 04:23:43.826904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 309/605] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:44.550207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4cc87be6-8fb0-4e27-92ff-201f89d19910 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:44.551125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4cc87be6-8fb0-4e27-92ff-201f89d19910 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:44.557283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4cc87be6-8fb0-4e27-92ff-201f89d19910 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:44.557764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4cc87be6-8fb0-4e27-92ff-201f89d19910 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:44.558680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4cc87be6-8fb0-4e27-92ff-201f89d19910 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:44.559844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4cc87be6-8fb0-4e27-92ff-201f89d19910 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:44.587057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4cc87be6-8fb0-4e27-92ff-201f89d19910 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040823 Mar 08 04:23:44.587595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 297/606] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:44.837464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-97a1781d-f732-43e3-9140-6c08fc59d3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:44.838417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-97a1781d-f732-43e3-9140-6c08fc59d3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:44.845080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97a1781d-f732-43e3-9140-6c08fc59d3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:44.845523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97a1781d-f732-43e3-9140-6c08fc59d3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:44.846312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97a1781d-f732-43e3-9140-6c08fc59d3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:44.846740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97a1781d-f732-43e3-9140-6c08fc59d3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:44.875576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-97a1781d-f732-43e3-9140-6c08fc59d3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042016 Mar 08 04:23:44.876134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 310/607] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:45.598961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cf910fd4-f922-4283-913a-b32ba5610690 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:45.599868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cf910fd4-f922-4283-913a-b32ba5610690 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:45.606582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf910fd4-f922-4283-913a-b32ba5610690 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:45.607033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf910fd4-f922-4283-913a-b32ba5610690 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:45.607808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf910fd4-f922-4283-913a-b32ba5610690 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:45.608243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf910fd4-f922-4283-913a-b32ba5610690 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:45.636596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cf910fd4-f922-4283-913a-b32ba5610690 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041540 Mar 08 04:23:45.638626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 298/608] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:45.887397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-148d01d5-b54d-48f7-a7bd-02e752b939b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:45.888297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-148d01d5-b54d-48f7-a7bd-02e752b939b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:45.894534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-148d01d5-b54d-48f7-a7bd-02e752b939b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:45.894989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-148d01d5-b54d-48f7-a7bd-02e752b939b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:45.895742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-148d01d5-b54d-48f7-a7bd-02e752b939b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:45.896173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-148d01d5-b54d-48f7-a7bd-02e752b939b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:45.924327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-148d01d5-b54d-48f7-a7bd-02e752b939b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Mar 08 04:23:45.924870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 311/609] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:46.274602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-99b0edfe-c69d-4ccb-a42a-968185105816 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:23:46.275149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-99b0edfe-c69d-4ccb-a42a-968185105816 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:46.281763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99b0edfe-c69d-4ccb-a42a-968185105816 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:46.282203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99b0edfe-c69d-4ccb-a42a-968185105816 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:46.282957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99b0edfe-c69d-4ccb-a42a-968185105816 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:46.283385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99b0edfe-c69d-4ccb-a42a-968185105816 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:46.305308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-99b0edfe-c69d-4ccb-a42a-968185105816 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lazy-loading 'flavor' on Instance uuid 4208bcea-e0a6-4c9d-956c-477a87d388ca {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:23:46.374398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-99b0edfe-c69d-4ccb-a42a-968185105816 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "POST /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca/action" status: 202 len: 0 microversion: 2.1 time: 0.103499 Mar 08 04:23:46.374980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 299/610] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:23:46 2022] POST /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:23:46.383640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ac0dc3d7-f361-4765-99c4-7a79f3b3d32c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:46.385315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ac0dc3d7-f361-4765-99c4-7a79f3b3d32c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:46.391438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac0dc3d7-f361-4765-99c4-7a79f3b3d32c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:46.391884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac0dc3d7-f361-4765-99c4-7a79f3b3d32c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:46.392648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac0dc3d7-f361-4765-99c4-7a79f3b3d32c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:46.393083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac0dc3d7-f361-4765-99c4-7a79f3b3d32c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:46.529024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ac0dc3d7-f361-4765-99c4-7a79f3b3d32c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:46.536602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ac0dc3d7-f361-4765-99c4-7a79f3b3d32c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156997 Mar 08 04:23:46.537164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 312/611] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:46 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:46.649574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6234e732-83a2-429e-8d7f-c69a67d02adf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:46.650646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6234e732-83a2-429e-8d7f-c69a67d02adf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:46.657755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6234e732-83a2-429e-8d7f-c69a67d02adf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:46.658194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6234e732-83a2-429e-8d7f-c69a67d02adf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:46.658963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6234e732-83a2-429e-8d7f-c69a67d02adf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:46.659398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6234e732-83a2-429e-8d7f-c69a67d02adf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:46.687026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6234e732-83a2-429e-8d7f-c69a67d02adf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042265 Mar 08 04:23:46.687575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 300/612] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:46.936550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c6c2304d-f81d-4a3c-a19f-a7f72c960a99 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:46.937521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c6c2304d-f81d-4a3c-a19f-a7f72c960a99 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:46.943776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6c2304d-f81d-4a3c-a19f-a7f72c960a99 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:46.944232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6c2304d-f81d-4a3c-a19f-a7f72c960a99 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:46.944985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6c2304d-f81d-4a3c-a19f-a7f72c960a99 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:46.945418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6c2304d-f81d-4a3c-a19f-a7f72c960a99 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:46.973644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c6c2304d-f81d-4a3c-a19f-a7f72c960a99 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041519 Mar 08 04:23:46.974282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 313/613] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:47.553768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5e73e4c1-3447-4896-95dc-0b4cee2068f6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:47.554383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5e73e4c1-3447-4896-95dc-0b4cee2068f6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:47.560894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e73e4c1-3447-4896-95dc-0b4cee2068f6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:47.561323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e73e4c1-3447-4896-95dc-0b4cee2068f6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:47.562115 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e73e4c1-3447-4896-95dc-0b4cee2068f6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:47.562554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e73e4c1-3447-4896-95dc-0b4cee2068f6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:47.698516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ed7b80fb-2fec-40ef-b84e-f85434683ea4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:47.700176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ed7b80fb-2fec-40ef-b84e-f85434683ea4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:47.706371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5e73e4c1-3447-4896-95dc-0b4cee2068f6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:47.706976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed7b80fb-2fec-40ef-b84e-f85434683ea4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:47.706976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed7b80fb-2fec-40ef-b84e-f85434683ea4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:47.707584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed7b80fb-2fec-40ef-b84e-f85434683ea4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:47.708021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed7b80fb-2fec-40ef-b84e-f85434683ea4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:47.713715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5e73e4c1-3447-4896-95dc-0b4cee2068f6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.163772 Mar 08 04:23:47.714536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 301/614] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:47 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:47.736607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ed7b80fb-2fec-40ef-b84e-f85434683ea4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042021 Mar 08 04:23:47.737167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 314/615] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:23:47.985057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3b109bb6-9c9d-4fe5-97ab-c7140b2a7afc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:47.986044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3b109bb6-9c9d-4fe5-97ab-c7140b2a7afc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:47.991932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b109bb6-9c9d-4fe5-97ab-c7140b2a7afc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:47.992380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b109bb6-9c9d-4fe5-97ab-c7140b2a7afc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:47.993145 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b109bb6-9c9d-4fe5-97ab-c7140b2a7afc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:47.993578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b109bb6-9c9d-4fe5-97ab-c7140b2a7afc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:48.021486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3b109bb6-9c9d-4fe5-97ab-c7140b2a7afc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 Mar 08 04:23:48.022057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 302/616] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:48.730038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-08b49dbd-854b-46a8-9bb7-e5e342f0d409 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:48.731426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-08b49dbd-854b-46a8-9bb7-e5e342f0d409 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:48.737738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08b49dbd-854b-46a8-9bb7-e5e342f0d409 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:48.738190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08b49dbd-854b-46a8-9bb7-e5e342f0d409 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:48.738985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08b49dbd-854b-46a8-9bb7-e5e342f0d409 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:48.739422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08b49dbd-854b-46a8-9bb7-e5e342f0d409 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:48.748498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-aad6dc67-1e42-42c0-abbd-985f46c6c6ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:48.749817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-aad6dc67-1e42-42c0-abbd-985f46c6c6ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:48.756521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aad6dc67-1e42-42c0-abbd-985f46c6c6ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:48.757108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aad6dc67-1e42-42c0-abbd-985f46c6c6ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:48.758028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aad6dc67-1e42-42c0-abbd-985f46c6c6ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:48.758537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aad6dc67-1e42-42c0-abbd-985f46c6c6ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:48.787646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-aad6dc67-1e42-42c0-abbd-985f46c6c6ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044062 Mar 08 04:23:48.788212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 303/617] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:23:48.872811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-08b49dbd-854b-46a8-9bb7-e5e342f0d409 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:48.880103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-08b49dbd-854b-46a8-9bb7-e5e342f0d409 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153873 Mar 08 04:23:48.880666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 315/618] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:48 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:49.032538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-df342c72-b1d3-4829-851a-77ebcf231f26 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:49.033442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-df342c72-b1d3-4829-851a-77ebcf231f26 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:49.039234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df342c72-b1d3-4829-851a-77ebcf231f26 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:49.039682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df342c72-b1d3-4829-851a-77ebcf231f26 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:49.040443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df342c72-b1d3-4829-851a-77ebcf231f26 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:49.040879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df342c72-b1d3-4829-851a-77ebcf231f26 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:49.069505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-df342c72-b1d3-4829-851a-77ebcf231f26 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041146 Mar 08 04:23:49.070083 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 304/619] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:49.798415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9f1e1d61-2bbf-43f3-962a-1d6fe10820b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:49.799317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9f1e1d61-2bbf-43f3-962a-1d6fe10820b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:49.805518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f1e1d61-2bbf-43f3-962a-1d6fe10820b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:49.805993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f1e1d61-2bbf-43f3-962a-1d6fe10820b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:49.806748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f1e1d61-2bbf-43f3-962a-1d6fe10820b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:49.807181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f1e1d61-2bbf-43f3-962a-1d6fe10820b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:49.835176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9f1e1d61-2bbf-43f3-962a-1d6fe10820b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040612 Mar 08 04:23:49.835721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 316/620] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:49.897169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d2a5705d-d797-4992-80ee-f2f7f69503ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:49.897820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d2a5705d-d797-4992-80ee-f2f7f69503ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:49.904434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2a5705d-d797-4992-80ee-f2f7f69503ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:49.905148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2a5705d-d797-4992-80ee-f2f7f69503ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:49.905944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2a5705d-d797-4992-80ee-f2f7f69503ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:49.906378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2a5705d-d797-4992-80ee-f2f7f69503ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:50.038467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d2a5705d-d797-4992-80ee-f2f7f69503ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:50.046703 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d2a5705d-d797-4992-80ee-f2f7f69503ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153416 Mar 08 04:23:50.047269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 305/621] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:49 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:50.081037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b7ed2c01-6fcb-4889-9b6b-e084547757dd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:50.081977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b7ed2c01-6fcb-4889-9b6b-e084547757dd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:50.087701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7ed2c01-6fcb-4889-9b6b-e084547757dd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:50.088124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7ed2c01-6fcb-4889-9b6b-e084547757dd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:50.088881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7ed2c01-6fcb-4889-9b6b-e084547757dd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:50.089310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7ed2c01-6fcb-4889-9b6b-e084547757dd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:50.116853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b7ed2c01-6fcb-4889-9b6b-e084547757dd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039755 Mar 08 04:23:50.117390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 317/622] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:50 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:50.846767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-89b42e61-4232-4df0-93dd-9d7860a81c7b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:50.847660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-89b42e61-4232-4df0-93dd-9d7860a81c7b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:50.853509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89b42e61-4232-4df0-93dd-9d7860a81c7b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:50.853994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89b42e61-4232-4df0-93dd-9d7860a81c7b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:50.854796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89b42e61-4232-4df0-93dd-9d7860a81c7b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:50.855832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89b42e61-4232-4df0-93dd-9d7860a81c7b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:50.883023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-89b42e61-4232-4df0-93dd-9d7860a81c7b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040248 Mar 08 04:23:50.883572 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 306/623] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:50 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:51.063791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ff42405c-779a-48d4-b987-a9d55e33ff9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:51.064371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ff42405c-779a-48d4-b987-a9d55e33ff9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:51.070676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff42405c-779a-48d4-b987-a9d55e33ff9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:51.071119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff42405c-779a-48d4-b987-a9d55e33ff9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:51.071868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff42405c-779a-48d4-b987-a9d55e33ff9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:51.072295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff42405c-779a-48d4-b987-a9d55e33ff9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:51.128562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-efa258a0-443c-4673-89b4-ff8045f836b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:51.129508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-efa258a0-443c-4673-89b4-ff8045f836b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:51.135803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efa258a0-443c-4673-89b4-ff8045f836b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:51.136251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efa258a0-443c-4673-89b4-ff8045f836b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:51.137616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efa258a0-443c-4673-89b4-ff8045f836b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:51.138073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efa258a0-443c-4673-89b4-ff8045f836b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:51.166689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-efa258a0-443c-4673-89b4-ff8045f836b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 Mar 08 04:23:51.167288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 307/624] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:23:51.208167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ff42405c-779a-48d4-b987-a9d55e33ff9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:51.216092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ff42405c-779a-48d4-b987-a9d55e33ff9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156145 Mar 08 04:23:51.216652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 318/625] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:51 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:51.894386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-054c3b92-d37a-479c-bebd-22595bbe578a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:51.895288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-054c3b92-d37a-479c-bebd-22595bbe578a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:51.901064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-054c3b92-d37a-479c-bebd-22595bbe578a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:51.901510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-054c3b92-d37a-479c-bebd-22595bbe578a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:51.902490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-054c3b92-d37a-479c-bebd-22595bbe578a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:51.902923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-054c3b92-d37a-479c-bebd-22595bbe578a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:51.931648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-054c3b92-d37a-479c-bebd-22595bbe578a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041127 Mar 08 04:23:51.932190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 308/626] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:52.178291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-be8b683e-01c5-4d71-8e6a-3f33f5cdacf7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:52.179212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-be8b683e-01c5-4d71-8e6a-3f33f5cdacf7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:52.185643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be8b683e-01c5-4d71-8e6a-3f33f5cdacf7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:52.186140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be8b683e-01c5-4d71-8e6a-3f33f5cdacf7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:52.186901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be8b683e-01c5-4d71-8e6a-3f33f5cdacf7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:52.187336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be8b683e-01c5-4d71-8e6a-3f33f5cdacf7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:52.216074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-be8b683e-01c5-4d71-8e6a-3f33f5cdacf7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041720 Mar 08 04:23:52.216627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 319/627] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:52.232768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-871e5948-6eea-4b3a-971f-9d2aabd9c27c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:52.233375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-871e5948-6eea-4b3a-971f-9d2aabd9c27c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:52.239597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-871e5948-6eea-4b3a-971f-9d2aabd9c27c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:52.240047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-871e5948-6eea-4b3a-971f-9d2aabd9c27c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:52.240812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-871e5948-6eea-4b3a-971f-9d2aabd9c27c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:52.241247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-871e5948-6eea-4b3a-971f-9d2aabd9c27c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:52.370100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-871e5948-6eea-4b3a-971f-9d2aabd9c27c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:52.377368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-871e5948-6eea-4b3a-971f-9d2aabd9c27c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149101 Mar 08 04:23:52.377966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 309/628] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:52 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:52.943616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d3e59e45-2767-413d-9444-d85246fa212b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:52.944527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d3e59e45-2767-413d-9444-d85246fa212b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:52.950971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3e59e45-2767-413d-9444-d85246fa212b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:52.951415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3e59e45-2767-413d-9444-d85246fa212b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:52.952173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3e59e45-2767-413d-9444-d85246fa212b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:52.952609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3e59e45-2767-413d-9444-d85246fa212b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:52.979784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d3e59e45-2767-413d-9444-d85246fa212b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040049 Mar 08 04:23:52.980353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 320/629] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:53.227740 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0b34775b-efe5-44d1-81b0-936d48079db0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:53.228644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0b34775b-efe5-44d1-81b0-936d48079db0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:53.234544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b34775b-efe5-44d1-81b0-936d48079db0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:53.235087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b34775b-efe5-44d1-81b0-936d48079db0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:53.235746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b34775b-efe5-44d1-81b0-936d48079db0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:53.236181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b34775b-efe5-44d1-81b0-936d48079db0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:53.264014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0b34775b-efe5-44d1-81b0-936d48079db0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040205 Mar 08 04:23:53.264558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 310/630] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:53.394488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7073c1eb-3db6-4488-bbe9-3e19d65267c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:53.395029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7073c1eb-3db6-4488-bbe9-3e19d65267c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:53.401247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7073c1eb-3db6-4488-bbe9-3e19d65267c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:53.401729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7073c1eb-3db6-4488-bbe9-3e19d65267c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:53.403265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7073c1eb-3db6-4488-bbe9-3e19d65267c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:53.403705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7073c1eb-3db6-4488-bbe9-3e19d65267c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:53.539265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7073c1eb-3db6-4488-bbe9-3e19d65267c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:53.546538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7073c1eb-3db6-4488-bbe9-3e19d65267c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156029 Mar 08 04:23:53.547092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 321/631] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:53 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:53.991057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6076123d-5e6b-4a96-9d22-1d4ea020f750 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:53.991999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6076123d-5e6b-4a96-9d22-1d4ea020f750 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:53.998766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6076123d-5e6b-4a96-9d22-1d4ea020f750 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:53.999221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6076123d-5e6b-4a96-9d22-1d4ea020f750 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:53.999987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6076123d-5e6b-4a96-9d22-1d4ea020f750 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:54.000452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6076123d-5e6b-4a96-9d22-1d4ea020f750 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:54.027807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6076123d-5e6b-4a96-9d22-1d4ea020f750 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040654 Mar 08 04:23:54.028349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 311/632] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:54.275522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-942118c7-7b64-4128-bbae-26893ec9acfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:54.276422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-942118c7-7b64-4128-bbae-26893ec9acfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:54.282627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-942118c7-7b64-4128-bbae-26893ec9acfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:54.283071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-942118c7-7b64-4128-bbae-26893ec9acfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:54.283834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-942118c7-7b64-4128-bbae-26893ec9acfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:54.284252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-942118c7-7b64-4128-bbae-26893ec9acfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:54.312529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-942118c7-7b64-4128-bbae-26893ec9acfc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041017 Mar 08 04:23:54.313061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 322/633] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:54.563589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9a246b1e-5c26-4dad-bdf1-3ab2a493b183 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:54.564122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9a246b1e-5c26-4dad-bdf1-3ab2a493b183 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:54.570375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a246b1e-5c26-4dad-bdf1-3ab2a493b183 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:54.570825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a246b1e-5c26-4dad-bdf1-3ab2a493b183 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:54.571589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a246b1e-5c26-4dad-bdf1-3ab2a493b183 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:54.572026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a246b1e-5c26-4dad-bdf1-3ab2a493b183 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:54.707459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9a246b1e-5c26-4dad-bdf1-3ab2a493b183 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:54.715708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9a246b1e-5c26-4dad-bdf1-3ab2a493b183 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155349 Mar 08 04:23:54.716268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 312/634] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:54 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:55.039113 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-64b62b06-1aba-4210-82b9-fe6567fb1a80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:55.040037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-64b62b06-1aba-4210-82b9-fe6567fb1a80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:55.046521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64b62b06-1aba-4210-82b9-fe6567fb1a80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:55.046975 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64b62b06-1aba-4210-82b9-fe6567fb1a80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:55.047745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64b62b06-1aba-4210-82b9-fe6567fb1a80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:55.048183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64b62b06-1aba-4210-82b9-fe6567fb1a80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:55.076047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-64b62b06-1aba-4210-82b9-fe6567fb1a80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040812 Mar 08 04:23:55.076588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 323/635] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:55.324733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8d8d2b2b-6ce3-4093-ab58-c9a31ebecbec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:55.325750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8d8d2b2b-6ce3-4093-ab58-c9a31ebecbec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:55.331617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b2b-6ce3-4093-ab58-c9a31ebecbec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:55.332067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b2b-6ce3-4093-ab58-c9a31ebecbec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:55.332830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b2b-6ce3-4093-ab58-c9a31ebecbec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:55.333265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b2b-6ce3-4093-ab58-c9a31ebecbec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:55.360306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8d8d2b2b-6ce3-4093-ab58-c9a31ebecbec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040345 Mar 08 04:23:55.360840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 313/636] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:55.732807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d1cf17f8-451d-4e1b-8dd0-83855f36ffe4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:55.733494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d1cf17f8-451d-4e1b-8dd0-83855f36ffe4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:55.740423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1cf17f8-451d-4e1b-8dd0-83855f36ffe4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:55.740864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1cf17f8-451d-4e1b-8dd0-83855f36ffe4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:55.741791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1cf17f8-451d-4e1b-8dd0-83855f36ffe4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:55.742480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1cf17f8-451d-4e1b-8dd0-83855f36ffe4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:56.054368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d1cf17f8-451d-4e1b-8dd0-83855f36ffe4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:56.062480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d1cf17f8-451d-4e1b-8dd0-83855f36ffe4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.334081 Mar 08 04:23:56.063033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 324/637] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:55 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:56.087441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f4936d01-b988-457e-82f0-82deaca43406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:56.088389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f4936d01-b988-457e-82f0-82deaca43406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:56.094876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4936d01-b988-457e-82f0-82deaca43406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:56.095331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4936d01-b988-457e-82f0-82deaca43406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:56.096101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4936d01-b988-457e-82f0-82deaca43406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:56.096543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4936d01-b988-457e-82f0-82deaca43406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:56.124504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f4936d01-b988-457e-82f0-82deaca43406 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040955 Mar 08 04:23:56.125069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 314/638] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:56.372537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-05825529-bf98-4239-a46a-69cd0767bed7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:56.373373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-05825529-bf98-4239-a46a-69cd0767bed7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:56.379295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05825529-bf98-4239-a46a-69cd0767bed7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:56.379742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05825529-bf98-4239-a46a-69cd0767bed7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:56.380507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05825529-bf98-4239-a46a-69cd0767bed7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:56.380940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05825529-bf98-4239-a46a-69cd0767bed7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:56.408360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-05825529-bf98-4239-a46a-69cd0767bed7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040549 Mar 08 04:23:56.408894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 325/639] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:57.079264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-440b3d92-a87b-4155-813c-e01b2fe22137 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:57.079886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-440b3d92-a87b-4155-813c-e01b2fe22137 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:57.085653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-440b3d92-a87b-4155-813c-e01b2fe22137 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:57.086143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-440b3d92-a87b-4155-813c-e01b2fe22137 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:57.086922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-440b3d92-a87b-4155-813c-e01b2fe22137 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:57.087366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-440b3d92-a87b-4155-813c-e01b2fe22137 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:57.136171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4916db4f-32d9-4ea0-a83c-2bb997acf9d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:57.137488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4916db4f-32d9-4ea0-a83c-2bb997acf9d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:57.144070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4916db4f-32d9-4ea0-a83c-2bb997acf9d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:57.144579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4916db4f-32d9-4ea0-a83c-2bb997acf9d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:57.145420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4916db4f-32d9-4ea0-a83c-2bb997acf9d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:57.145944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4916db4f-32d9-4ea0-a83c-2bb997acf9d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:57.175760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4916db4f-32d9-4ea0-a83c-2bb997acf9d5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Mar 08 04:23:57.176323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 326/640] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:23:57.275786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-440b3d92-a87b-4155-813c-e01b2fe22137 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:57.284089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-440b3d92-a87b-4155-813c-e01b2fe22137 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.208709 Mar 08 04:23:57.284661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 315/641] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:57 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:57.419660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-acb250ed-8fe7-4da8-ba83-08be0eaafec6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:57.420587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-acb250ed-8fe7-4da8-ba83-08be0eaafec6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:57.426446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-acb250ed-8fe7-4da8-ba83-08be0eaafec6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:57.426889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-acb250ed-8fe7-4da8-ba83-08be0eaafec6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:57.427641 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-acb250ed-8fe7-4da8-ba83-08be0eaafec6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:57.428071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-acb250ed-8fe7-4da8-ba83-08be0eaafec6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:57.456768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-acb250ed-8fe7-4da8-ba83-08be0eaafec6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041034 Mar 08 04:23:57.457302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 327/642] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:58.187472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dc49c480-3fac-4872-8feb-f3be868e9f00 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:58.188414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dc49c480-3fac-4872-8feb-f3be868e9f00 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:58.194687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dc49c480-3fac-4872-8feb-f3be868e9f00 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:58.195138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dc49c480-3fac-4872-8feb-f3be868e9f00 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:58.195907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dc49c480-3fac-4872-8feb-f3be868e9f00 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:58.196346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dc49c480-3fac-4872-8feb-f3be868e9f00 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:58.227006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dc49c480-3fac-4872-8feb-f3be868e9f00 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Mar 08 04:23:58.227624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 316/643] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:58.302471 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-18bd3926-9802-4fd7-a083-1af684bfcce8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:58.303077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-18bd3926-9802-4fd7-a083-1af684bfcce8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:58.309897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18bd3926-9802-4fd7-a083-1af684bfcce8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:58.310349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18bd3926-9802-4fd7-a083-1af684bfcce8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:58.311112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18bd3926-9802-4fd7-a083-1af684bfcce8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:58.311544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18bd3926-9802-4fd7-a083-1af684bfcce8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:58.442099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-18bd3926-9802-4fd7-a083-1af684bfcce8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:58.449965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-18bd3926-9802-4fd7-a083-1af684bfcce8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150680 Mar 08 04:23:58.450524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 328/644] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:58 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:58.468265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-47b6bdf1-aecd-48da-86a0-3df1781ecbae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:58.469200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-47b6bdf1-aecd-48da-86a0-3df1781ecbae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:58.474927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-47b6bdf1-aecd-48da-86a0-3df1781ecbae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:58.475379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-47b6bdf1-aecd-48da-86a0-3df1781ecbae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:58.476150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-47b6bdf1-aecd-48da-86a0-3df1781ecbae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:58.476587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-47b6bdf1-aecd-48da-86a0-3df1781ecbae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:58.506134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-47b6bdf1-aecd-48da-86a0-3df1781ecbae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041744 Mar 08 04:23:58.506686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 317/645] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:59.238420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0f5e63cb-5b52-406b-9d6a-62e4ba8a6626 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:59.239364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0f5e63cb-5b52-406b-9d6a-62e4ba8a6626 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:59.245343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f5e63cb-5b52-406b-9d6a-62e4ba8a6626 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:59.246605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f5e63cb-5b52-406b-9d6a-62e4ba8a6626 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:59.247458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f5e63cb-5b52-406b-9d6a-62e4ba8a6626 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:59.247895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f5e63cb-5b52-406b-9d6a-62e4ba8a6626 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:59.276346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0f5e63cb-5b52-406b-9d6a-62e4ba8a6626 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041837 Mar 08 04:23:59.276886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 329/646] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:23:59.466722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-73efe134-552e-406e-948b-4fdb8bb3414c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:59.467323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-73efe134-552e-406e-948b-4fdb8bb3414c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:59.473445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73efe134-552e-406e-948b-4fdb8bb3414c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:59.474059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73efe134-552e-406e-948b-4fdb8bb3414c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:59.474668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73efe134-552e-406e-948b-4fdb8bb3414c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:59.475101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73efe134-552e-406e-948b-4fdb8bb3414c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:59.518503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-077ec91c-ca9b-4872-b196-fa9c0fe8b2b7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:23:59.519454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-077ec91c-ca9b-4872-b196-fa9c0fe8b2b7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:23:59.525688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-077ec91c-ca9b-4872-b196-fa9c0fe8b2b7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:59.526253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-077ec91c-ca9b-4872-b196-fa9c0fe8b2b7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:59.527068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-077ec91c-ca9b-4872-b196-fa9c0fe8b2b7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:23:59.527548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-077ec91c-ca9b-4872-b196-fa9c0fe8b2b7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:23:59.556747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-077ec91c-ca9b-4872-b196-fa9c0fe8b2b7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042148 Mar 08 04:23:59.557311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 330/647] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:23:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:23:59.609856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-73efe134-552e-406e-948b-4fdb8bb3414c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:23:59.617095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-73efe134-552e-406e-948b-4fdb8bb3414c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154423 Mar 08 04:23:59.617665 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 318/648] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:23:59 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:23:59.913209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:23:59.913413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:23:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:24:00.287721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a33b3624-fdab-4615-a564-9e069445a594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:00.288625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a33b3624-fdab-4615-a564-9e069445a594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:00.294883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a33b3624-fdab-4615-a564-9e069445a594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:00.295333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a33b3624-fdab-4615-a564-9e069445a594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:00.296090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a33b3624-fdab-4615-a564-9e069445a594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:00.296522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a33b3624-fdab-4615-a564-9e069445a594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:00.324384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a33b3624-fdab-4615-a564-9e069445a594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040092 Mar 08 04:24:00.324972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 331/649] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:00.568573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1b89d5e8-e790-4d8a-966a-3bcdf9292ac5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:00.569592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1b89d5e8-e790-4d8a-966a-3bcdf9292ac5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:00.577082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b89d5e8-e790-4d8a-966a-3bcdf9292ac5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:00.577528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b89d5e8-e790-4d8a-966a-3bcdf9292ac5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:00.578313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b89d5e8-e790-4d8a-966a-3bcdf9292ac5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:00.578745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b89d5e8-e790-4d8a-966a-3bcdf9292ac5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:00.606129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1b89d5e8-e790-4d8a-966a-3bcdf9292ac5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041588 Mar 08 04:24:00.606668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 319/650] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:00.634100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2572facc-ee8b-443e-889e-e561d5ecbefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:00.634738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2572facc-ee8b-443e-889e-e561d5ecbefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:00.641676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2572facc-ee8b-443e-889e-e561d5ecbefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:00.642148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2572facc-ee8b-443e-889e-e561d5ecbefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:00.642907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2572facc-ee8b-443e-889e-e561d5ecbefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:00.643344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2572facc-ee8b-443e-889e-e561d5ecbefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:00.779678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2572facc-ee8b-443e-889e-e561d5ecbefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:00.787003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2572facc-ee8b-443e-889e-e561d5ecbefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156683 Mar 08 04:24:00.787557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 332/651] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:00 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:01.335762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-111b16ee-e4a1-4c91-9ce3-2e1b9730fc48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:01.336693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-111b16ee-e4a1-4c91-9ce3-2e1b9730fc48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:01.343110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-111b16ee-e4a1-4c91-9ce3-2e1b9730fc48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:01.343555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-111b16ee-e4a1-4c91-9ce3-2e1b9730fc48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:01.344315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-111b16ee-e4a1-4c91-9ce3-2e1b9730fc48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:01.344748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-111b16ee-e4a1-4c91-9ce3-2e1b9730fc48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:01.372017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-111b16ee-e4a1-4c91-9ce3-2e1b9730fc48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040213 Mar 08 04:24:01.372548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 320/652] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:01.617597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-37d2e6d4-913b-416f-92a9-f56be57237a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:01.618471 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-37d2e6d4-913b-416f-92a9-f56be57237a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:01.624570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37d2e6d4-913b-416f-92a9-f56be57237a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:01.625023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37d2e6d4-913b-416f-92a9-f56be57237a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:01.625818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37d2e6d4-913b-416f-92a9-f56be57237a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:01.626256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37d2e6d4-913b-416f-92a9-f56be57237a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:01.655158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-37d2e6d4-913b-416f-92a9-f56be57237a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041628 Mar 08 04:24:01.655778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 333/653] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:01 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:01.804758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-963cea2f-585e-4b87-838a-90e3c17cada6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:01.805399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-963cea2f-585e-4b87-838a-90e3c17cada6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:01.811690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-963cea2f-585e-4b87-838a-90e3c17cada6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:01.812143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-963cea2f-585e-4b87-838a-90e3c17cada6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:01.812920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-963cea2f-585e-4b87-838a-90e3c17cada6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:01.813362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-963cea2f-585e-4b87-838a-90e3c17cada6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:01.957465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-963cea2f-585e-4b87-838a-90e3c17cada6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:01.965136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-963cea2f-585e-4b87-838a-90e3c17cada6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.164408 Mar 08 04:24:01.965912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 321/654] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:01 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:01.990237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-9d1df352-1ccf-41cf-a903-5418f1d939f3 req-04ecebe4-d75d-439e-b5ea-8a9cff8c78cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4208bcea-e0a6-4c9d-956c-477a87d388ca", "name": "network-vif-unplugged", "status": "completed", "tag": "5ed21f05-392d-4365-8c94-f119e23a8232"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:24:01.999147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-9d1df352-1ccf-41cf-a903-5418f1d939f3 req-04ecebe4-d75d-439e-b5ea-8a9cff8c78cc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:01.999832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-9d1df352-1ccf-41cf-a903-5418f1d939f3 req-04ecebe4-d75d-439e-b5ea-8a9cff8c78cc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:02.012721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-9d1df352-1ccf-41cf-a903-5418f1d939f3 req-04ecebe4-d75d-439e-b5ea-8a9cff8c78cc service nova] Creating event network-vif-unplugged:5ed21f05-392d-4365-8c94-f119e23a8232 for instance 4208bcea-e0a6-4c9d-956c-477a87d388ca on hv-cinder-73306 Mar 08 04:24:02.017835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-9d1df352-1ccf-41cf-a903-5418f1d939f3 req-04ecebe4-d75d-439e-b5ea-8a9cff8c78cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031132 Mar 08 04:24:02.018419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 334/655] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:02.383380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0d9822bd-c3e7-433b-91d5-bee6d62da0ab tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:02.384287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0d9822bd-c3e7-433b-91d5-bee6d62da0ab tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:02.390144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d9822bd-c3e7-433b-91d5-bee6d62da0ab tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:02.390593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d9822bd-c3e7-433b-91d5-bee6d62da0ab tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:02.391358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d9822bd-c3e7-433b-91d5-bee6d62da0ab tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:02.391795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d9822bd-c3e7-433b-91d5-bee6d62da0ab tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:02.419698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0d9822bd-c3e7-433b-91d5-bee6d62da0ab tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040235 Mar 08 04:24:02.420249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 322/656] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:02.668380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d182e81f-1706-479e-a903-fa86d36473ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:02.669476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d182e81f-1706-479e-a903-fa86d36473ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:02.675517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d182e81f-1706-479e-a903-fa86d36473ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:02.675967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d182e81f-1706-479e-a903-fa86d36473ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:02.676723 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d182e81f-1706-479e-a903-fa86d36473ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:02.677151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d182e81f-1706-479e-a903-fa86d36473ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:02.704548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d182e81f-1706-479e-a903-fa86d36473ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041594 Mar 08 04:24:02.705097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 335/657] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:02.982259 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8741d2d3-1bb2-4f91-9e51-df3efb7e8c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:02.982808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8741d2d3-1bb2-4f91-9e51-df3efb7e8c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:02.989004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8741d2d3-1bb2-4f91-9e51-df3efb7e8c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:02.989459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8741d2d3-1bb2-4f91-9e51-df3efb7e8c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:02.990270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8741d2d3-1bb2-4f91-9e51-df3efb7e8c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:02.990713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8741d2d3-1bb2-4f91-9e51-df3efb7e8c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:03.120773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8741d2d3-1bb2-4f91-9e51-df3efb7e8c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:03.128086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8741d2d3-1bb2-4f91-9e51-df3efb7e8c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149835 Mar 08 04:24:03.128645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 323/658] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:02 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:03.431224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ebc8bf79-4c1e-4618-bdef-144eb07d4b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:03.432131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ebc8bf79-4c1e-4618-bdef-144eb07d4b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:03.438585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ebc8bf79-4c1e-4618-bdef-144eb07d4b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:03.439052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ebc8bf79-4c1e-4618-bdef-144eb07d4b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:03.439788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ebc8bf79-4c1e-4618-bdef-144eb07d4b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:03.440222 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ebc8bf79-4c1e-4618-bdef-144eb07d4b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:03.467968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ebc8bf79-4c1e-4618-bdef-144eb07d4b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040733 Mar 08 04:24:03.468508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 336/659] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:03.716574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4c097fb5-84a6-4c70-a955-4640077d3689 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:03.717396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4c097fb5-84a6-4c70-a955-4640077d3689 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:03.723247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c097fb5-84a6-4c70-a955-4640077d3689 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:03.723694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c097fb5-84a6-4c70-a955-4640077d3689 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:03.724604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c097fb5-84a6-4c70-a955-4640077d3689 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:03.725042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c097fb5-84a6-4c70-a955-4640077d3689 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:03.753897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4c097fb5-84a6-4c70-a955-4640077d3689 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041520 Mar 08 04:24:03.754447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 324/660] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:04.145547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-db4bc1d6-574b-4889-929f-5fef1cff7df8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:04.146409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-db4bc1d6-574b-4889-929f-5fef1cff7df8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:04.153524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db4bc1d6-574b-4889-929f-5fef1cff7df8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:04.154010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db4bc1d6-574b-4889-929f-5fef1cff7df8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:04.155039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db4bc1d6-574b-4889-929f-5fef1cff7df8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:04.155493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db4bc1d6-574b-4889-929f-5fef1cff7df8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:04.290467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-db4bc1d6-574b-4889-929f-5fef1cff7df8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:04.298268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-db4bc1d6-574b-4889-929f-5fef1cff7df8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156643 Mar 08 04:24:04.298824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 337/661] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:04 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:04.479444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0ee95791-42d9-49c1-aed4-bef2a6ebcf3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:04.480838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0ee95791-42d9-49c1-aed4-bef2a6ebcf3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:04.487092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ee95791-42d9-49c1-aed4-bef2a6ebcf3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:04.487540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ee95791-42d9-49c1-aed4-bef2a6ebcf3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:04.488303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ee95791-42d9-49c1-aed4-bef2a6ebcf3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:04.488739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ee95791-42d9-49c1-aed4-bef2a6ebcf3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:04.517795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0ee95791-42d9-49c1-aed4-bef2a6ebcf3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042257 Mar 08 04:24:04.518346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 325/662] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:04.765056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0f59d816-1913-40e5-b1c0-e784c5a17e41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:04.765914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0f59d816-1913-40e5-b1c0-e784c5a17e41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:04.771699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f59d816-1913-40e5-b1c0-e784c5a17e41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:04.772140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f59d816-1913-40e5-b1c0-e784c5a17e41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:04.772924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f59d816-1913-40e5-b1c0-e784c5a17e41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:04.773349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f59d816-1913-40e5-b1c0-e784c5a17e41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:04.801305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0f59d816-1913-40e5-b1c0-e784c5a17e41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040845 Mar 08 04:24:04.801866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 338/663] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:05.315534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fd49e136-2a80-4794-8c2d-2665f0ec1eaf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:05.316133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fd49e136-2a80-4794-8c2d-2665f0ec1eaf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:05.321927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd49e136-2a80-4794-8c2d-2665f0ec1eaf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:05.322371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd49e136-2a80-4794-8c2d-2665f0ec1eaf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:05.323125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd49e136-2a80-4794-8c2d-2665f0ec1eaf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:05.323555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd49e136-2a80-4794-8c2d-2665f0ec1eaf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:05.456610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fd49e136-2a80-4794-8c2d-2665f0ec1eaf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:05.463754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fd49e136-2a80-4794-8c2d-2665f0ec1eaf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152193 Mar 08 04:24:05.464398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 326/664] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:05.529826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0e6f53d1-f3b6-47e6-b121-39fc7dfd4192 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:05.530753 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0e6f53d1-f3b6-47e6-b121-39fc7dfd4192 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:05.536526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e6f53d1-f3b6-47e6-b121-39fc7dfd4192 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:05.536976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e6f53d1-f3b6-47e6-b121-39fc7dfd4192 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:05.537769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e6f53d1-f3b6-47e6-b121-39fc7dfd4192 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:05.538210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e6f53d1-f3b6-47e6-b121-39fc7dfd4192 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:05.567733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0e6f53d1-f3b6-47e6-b121-39fc7dfd4192 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 Mar 08 04:24:05.568208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 339/665] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:05.812492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b12bd9ff-1eba-4906-9346-9234d1f481e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:05.813394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b12bd9ff-1eba-4906-9346-9234d1f481e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:05.819808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b12bd9ff-1eba-4906-9346-9234d1f481e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:05.820189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b12bd9ff-1eba-4906-9346-9234d1f481e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:05.820943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b12bd9ff-1eba-4906-9346-9234d1f481e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:05.821372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b12bd9ff-1eba-4906-9346-9234d1f481e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:05.849595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b12bd9ff-1eba-4906-9346-9234d1f481e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 Mar 08 04:24:05.850168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 327/666] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:06.481409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d71f73d2-4eb6-4ff3-ad3b-43bf737244a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:06.482029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d71f73d2-4eb6-4ff3-ad3b-43bf737244a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:06.487834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d71f73d2-4eb6-4ff3-ad3b-43bf737244a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:06.488274 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d71f73d2-4eb6-4ff3-ad3b-43bf737244a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:06.489021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d71f73d2-4eb6-4ff3-ad3b-43bf737244a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:06.489448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d71f73d2-4eb6-4ff3-ad3b-43bf737244a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:06.579079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fc3f7d37-d8e9-4c12-86a9-dba5c5f605f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:06.579978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fc3f7d37-d8e9-4c12-86a9-dba5c5f605f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:06.585585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc3f7d37-d8e9-4c12-86a9-dba5c5f605f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:06.586068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc3f7d37-d8e9-4c12-86a9-dba5c5f605f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:06.586831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc3f7d37-d8e9-4c12-86a9-dba5c5f605f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:06.587260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc3f7d37-d8e9-4c12-86a9-dba5c5f605f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:06.617752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fc3f7d37-d8e9-4c12-86a9-dba5c5f605f0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042438 Mar 08 04:24:06.618508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 328/667] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:06.621123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d71f73d2-4eb6-4ff3-ad3b-43bf737244a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:06.628563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d71f73d2-4eb6-4ff3-ad3b-43bf737244a5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151543 Mar 08 04:24:06.629102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 340/668] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:06.860683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-99755df7-608a-4ac5-b1da-feaad734a851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:06.861603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-99755df7-608a-4ac5-b1da-feaad734a851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:06.867979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99755df7-608a-4ac5-b1da-feaad734a851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:06.868431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99755df7-608a-4ac5-b1da-feaad734a851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:06.869201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99755df7-608a-4ac5-b1da-feaad734a851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:06.869639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-99755df7-608a-4ac5-b1da-feaad734a851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:06.897710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-99755df7-608a-4ac5-b1da-feaad734a851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041031 Mar 08 04:24:06.898252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 329/669] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:07.629397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-74a50bb5-983d-4392-b0ba-bc8c86187827 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:07.630264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-74a50bb5-983d-4392-b0ba-bc8c86187827 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:07.636959 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74a50bb5-983d-4392-b0ba-bc8c86187827 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:07.637421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74a50bb5-983d-4392-b0ba-bc8c86187827 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:07.638223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74a50bb5-983d-4392-b0ba-bc8c86187827 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:07.638667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74a50bb5-983d-4392-b0ba-bc8c86187827 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:07.645516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7dd8476f-b145-4eb1-8ad8-980367adc9b0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:07.646150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7dd8476f-b145-4eb1-8ad8-980367adc9b0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:07.651871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7dd8476f-b145-4eb1-8ad8-980367adc9b0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:07.652323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7dd8476f-b145-4eb1-8ad8-980367adc9b0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:07.653083 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7dd8476f-b145-4eb1-8ad8-980367adc9b0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:07.653513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7dd8476f-b145-4eb1-8ad8-980367adc9b0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:07.667089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-74a50bb5-983d-4392-b0ba-bc8c86187827 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041746 Mar 08 04:24:07.668217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 341/670] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:07.787484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7dd8476f-b145-4eb1-8ad8-980367adc9b0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:07.795204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7dd8476f-b145-4eb1-8ad8-980367adc9b0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153490 Mar 08 04:24:07.795765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 330/671] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:24:07.909360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-366eb54b-d599-4427-a11e-9752a60f3a05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:07.910224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-366eb54b-d599-4427-a11e-9752a60f3a05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:07.915961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-366eb54b-d599-4427-a11e-9752a60f3a05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:07.916402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-366eb54b-d599-4427-a11e-9752a60f3a05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:07.917150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-366eb54b-d599-4427-a11e-9752a60f3a05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:07.918205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-366eb54b-d599-4427-a11e-9752a60f3a05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:07.945373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-366eb54b-d599-4427-a11e-9752a60f3a05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039974 Mar 08 04:24:07.945925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 342/672] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:08.679420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ad7c3196-98e4-4728-8337-58d9b7874645 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:08.680318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ad7c3196-98e4-4728-8337-58d9b7874645 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:08.687182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad7c3196-98e4-4728-8337-58d9b7874645 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:08.687628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad7c3196-98e4-4728-8337-58d9b7874645 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:08.688380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad7c3196-98e4-4728-8337-58d9b7874645 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:08.688812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad7c3196-98e4-4728-8337-58d9b7874645 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:08.716608 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ad7c3196-98e4-4728-8337-58d9b7874645 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041134 Mar 08 04:24:08.717148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 331/673] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:08.812564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3d886d10-fd4b-405d-a49e-a9c819832904 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:08.813164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3d886d10-fd4b-405d-a49e-a9c819832904 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:08.819669 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3d886d10-fd4b-405d-a49e-a9c819832904 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:08.820179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3d886d10-fd4b-405d-a49e-a9c819832904 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:08.820994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3d886d10-fd4b-405d-a49e-a9c819832904 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:08.821391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3d886d10-fd4b-405d-a49e-a9c819832904 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:08.953072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3d886d10-fd4b-405d-a49e-a9c819832904 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:08.957424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6237c9bf-a554-45a6-95c3-7d72820655af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:08.958352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6237c9bf-a554-45a6-95c3-7d72820655af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:08.960534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3d886d10-fd4b-405d-a49e-a9c819832904 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152554 Mar 08 04:24:08.961096 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 343/674] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:08 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:08.964003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6237c9bf-a554-45a6-95c3-7d72820655af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:08.964544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6237c9bf-a554-45a6-95c3-7d72820655af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:08.965304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6237c9bf-a554-45a6-95c3-7d72820655af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:08.965769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6237c9bf-a554-45a6-95c3-7d72820655af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:08.993072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6237c9bf-a554-45a6-95c3-7d72820655af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039543 Mar 08 04:24:08.993615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 332/675] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:09.729216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f5cf0c4d-7799-44af-8c1c-416cabf63bc8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:09.730361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f5cf0c4d-7799-44af-8c1c-416cabf63bc8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:09.736953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5cf0c4d-7799-44af-8c1c-416cabf63bc8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:09.737445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5cf0c4d-7799-44af-8c1c-416cabf63bc8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:09.738248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5cf0c4d-7799-44af-8c1c-416cabf63bc8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:09.738684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5cf0c4d-7799-44af-8c1c-416cabf63bc8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:09.771432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f5cf0c4d-7799-44af-8c1c-416cabf63bc8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047191 Mar 08 04:24:09.771982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 344/676] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:09 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:09.977846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a8f257ac-8ce9-4c6f-b517-b38c9eefcd32 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:09.978458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a8f257ac-8ce9-4c6f-b517-b38c9eefcd32 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:09.984717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f257ac-8ce9-4c6f-b517-b38c9eefcd32 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:09.985113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f257ac-8ce9-4c6f-b517-b38c9eefcd32 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:09.985911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f257ac-8ce9-4c6f-b517-b38c9eefcd32 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:09.986362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f257ac-8ce9-4c6f-b517-b38c9eefcd32 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:10.004295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cfaf9330-0d59-4b73-9172-384fa7f10e64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:10.005283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cfaf9330-0d59-4b73-9172-384fa7f10e64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:10.012232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfaf9330-0d59-4b73-9172-384fa7f10e64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:10.012686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfaf9330-0d59-4b73-9172-384fa7f10e64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:10.013468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfaf9330-0d59-4b73-9172-384fa7f10e64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:10.013941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfaf9330-0d59-4b73-9172-384fa7f10e64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:10.043098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cfaf9330-0d59-4b73-9172-384fa7f10e64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Mar 08 04:24:10.043654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 345/677] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:10.117734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a8f257ac-8ce9-4c6f-b517-b38c9eefcd32 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:10.125543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a8f257ac-8ce9-4c6f-b517-b38c9eefcd32 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151598 Mar 08 04:24:10.126136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 333/678] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:10.783542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7def672f-c7e3-4fe6-94f9-b6e725c08010 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:10.784446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7def672f-c7e3-4fe6-94f9-b6e725c08010 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:10.790258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7def672f-c7e3-4fe6-94f9-b6e725c08010 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:10.790701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7def672f-c7e3-4fe6-94f9-b6e725c08010 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:10.791479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7def672f-c7e3-4fe6-94f9-b6e725c08010 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:10.791909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7def672f-c7e3-4fe6-94f9-b6e725c08010 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:10.820138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7def672f-c7e3-4fe6-94f9-b6e725c08010 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040824 Mar 08 04:24:10.820704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 346/679] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:11.054690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ca2117f3-d7a9-47e0-96d0-96b0748d223c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:11.055518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ca2117f3-d7a9-47e0-96d0-96b0748d223c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:11.063396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca2117f3-d7a9-47e0-96d0-96b0748d223c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:11.064034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca2117f3-d7a9-47e0-96d0-96b0748d223c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:11.065081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca2117f3-d7a9-47e0-96d0-96b0748d223c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:11.065628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca2117f3-d7a9-47e0-96d0-96b0748d223c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:11.096959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ca2117f3-d7a9-47e0-96d0-96b0748d223c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046266 Mar 08 04:24:11.097759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 334/680] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:11.142994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1867370a-eaf8-46ce-88e4-83cbefec434a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:11.143640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1867370a-eaf8-46ce-88e4-83cbefec434a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:11.149815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1867370a-eaf8-46ce-88e4-83cbefec434a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:11.150267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1867370a-eaf8-46ce-88e4-83cbefec434a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:11.151027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1867370a-eaf8-46ce-88e4-83cbefec434a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:11.151534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1867370a-eaf8-46ce-88e4-83cbefec434a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:11.287827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1867370a-eaf8-46ce-88e4-83cbefec434a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:11.295717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1867370a-eaf8-46ce-88e4-83cbefec434a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156614 Mar 08 04:24:11.296280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 347/681] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:11 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:11.832502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-253379f3-6c48-4187-afc7-ebff7f90fe50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:11.833331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-253379f3-6c48-4187-afc7-ebff7f90fe50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:11.839803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-253379f3-6c48-4187-afc7-ebff7f90fe50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:11.840270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-253379f3-6c48-4187-afc7-ebff7f90fe50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:11.841044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-253379f3-6c48-4187-afc7-ebff7f90fe50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:11.841483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-253379f3-6c48-4187-afc7-ebff7f90fe50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:11.870183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-253379f3-6c48-4187-afc7-ebff7f90fe50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041669 Mar 08 04:24:11.870999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 335/682] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:12.108890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-babb5ec8-b507-41d8-a90b-3e031748a33a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:12.109760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-babb5ec8-b507-41d8-a90b-3e031748a33a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:12.115737 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-babb5ec8-b507-41d8-a90b-3e031748a33a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:12.116186 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-babb5ec8-b507-41d8-a90b-3e031748a33a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:12.116943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-babb5ec8-b507-41d8-a90b-3e031748a33a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:12.117374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-babb5ec8-b507-41d8-a90b-3e031748a33a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:12.145389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-babb5ec8-b507-41d8-a90b-3e031748a33a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040849 Mar 08 04:24:12.146043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 348/683] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:12.312477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-46a2e4d2-52a8-4153-b9ac-eaf33c3d18c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:12.313315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-46a2e4d2-52a8-4153-b9ac-eaf33c3d18c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:12.319445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46a2e4d2-52a8-4153-b9ac-eaf33c3d18c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:12.319887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46a2e4d2-52a8-4153-b9ac-eaf33c3d18c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:12.320645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46a2e4d2-52a8-4153-b9ac-eaf33c3d18c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:12.321079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46a2e4d2-52a8-4153-b9ac-eaf33c3d18c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:12.452599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-46a2e4d2-52a8-4153-b9ac-eaf33c3d18c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:12.460083 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-46a2e4d2-52a8-4153-b9ac-eaf33c3d18c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151478 Mar 08 04:24:12.460650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 336/684] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:12 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:12.978341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-391c24f4-a773-4cb4-a4c5-a05686afb64e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:12.979247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-391c24f4-a773-4cb4-a4c5-a05686afb64e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:12.985612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-391c24f4-a773-4cb4-a4c5-a05686afb64e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:12.986089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-391c24f4-a773-4cb4-a4c5-a05686afb64e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:12.986846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-391c24f4-a773-4cb4-a4c5-a05686afb64e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:12.987285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-391c24f4-a773-4cb4-a4c5-a05686afb64e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:13.016038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-391c24f4-a773-4cb4-a4c5-a05686afb64e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137986 Mar 08 04:24:13.016587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 349/685] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:13.157529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-752443f1-84c5-43bc-8e43-dde7d2025123 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:13.158450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-752443f1-84c5-43bc-8e43-dde7d2025123 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:13.164358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-752443f1-84c5-43bc-8e43-dde7d2025123 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:13.164835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-752443f1-84c5-43bc-8e43-dde7d2025123 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:13.165609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-752443f1-84c5-43bc-8e43-dde7d2025123 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:13.166099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-752443f1-84c5-43bc-8e43-dde7d2025123 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:13.196455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-752443f1-84c5-43bc-8e43-dde7d2025123 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043292 Mar 08 04:24:13.197198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 337/686] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:13.481983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-419d2eb5-0dd5-42d7-8362-5182441b3e99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:13.482596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-419d2eb5-0dd5-42d7-8362-5182441b3e99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:13.488457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-419d2eb5-0dd5-42d7-8362-5182441b3e99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:13.488897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-419d2eb5-0dd5-42d7-8362-5182441b3e99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:13.489707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-419d2eb5-0dd5-42d7-8362-5182441b3e99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:13.490144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-419d2eb5-0dd5-42d7-8362-5182441b3e99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:13.628154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-419d2eb5-0dd5-42d7-8362-5182441b3e99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:13.635481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-419d2eb5-0dd5-42d7-8362-5182441b3e99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157962 Mar 08 04:24:13.636160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 350/687] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:13 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:14.028221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f6e29d46-ec43-44b7-be9d-1301dd438873 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:14.029127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f6e29d46-ec43-44b7-be9d-1301dd438873 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:14.035700 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6e29d46-ec43-44b7-be9d-1301dd438873 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:14.036155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6e29d46-ec43-44b7-be9d-1301dd438873 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:14.036921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6e29d46-ec43-44b7-be9d-1301dd438873 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:14.037359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f6e29d46-ec43-44b7-be9d-1301dd438873 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:14.064937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f6e29d46-ec43-44b7-be9d-1301dd438873 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041311 Mar 08 04:24:14.065484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 338/688] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:14.208278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3cecd21a-d607-4326-bb14-bc1f93c0a057 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:14.209284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3cecd21a-d607-4326-bb14-bc1f93c0a057 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:14.217147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3cecd21a-d607-4326-bb14-bc1f93c0a057 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:14.217594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3cecd21a-d607-4326-bb14-bc1f93c0a057 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:14.218389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3cecd21a-d607-4326-bb14-bc1f93c0a057 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:14.218829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3cecd21a-d607-4326-bb14-bc1f93c0a057 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:14.248900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3cecd21a-d607-4326-bb14-bc1f93c0a057 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Mar 08 04:24:14.249463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 351/689] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:14.653297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6e515b6c-199b-44d6-910c-b2dbecc4f8d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:14.653851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6e515b6c-199b-44d6-910c-b2dbecc4f8d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:14.659932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e515b6c-199b-44d6-910c-b2dbecc4f8d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:14.660382 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e515b6c-199b-44d6-910c-b2dbecc4f8d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:14.661157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e515b6c-199b-44d6-910c-b2dbecc4f8d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:14.661594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e515b6c-199b-44d6-910c-b2dbecc4f8d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:14.793553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6e515b6c-199b-44d6-910c-b2dbecc4f8d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:14.800781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6e515b6c-199b-44d6-910c-b2dbecc4f8d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151597 Mar 08 04:24:14.801333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 339/690] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:14 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:15.077088 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9401edb2-6d6c-4534-bd21-23d205734a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:15.078053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9401edb2-6d6c-4534-bd21-23d205734a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:15.083931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9401edb2-6d6c-4534-bd21-23d205734a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:15.084376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9401edb2-6d6c-4534-bd21-23d205734a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:15.085134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9401edb2-6d6c-4534-bd21-23d205734a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:15.085572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9401edb2-6d6c-4534-bd21-23d205734a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:15.113902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9401edb2-6d6c-4534-bd21-23d205734a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Mar 08 04:24:15.114445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 352/691] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:15.261528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-58b8b5fa-aec8-4a53-8bfa-db2f46a030fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:15.262467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-58b8b5fa-aec8-4a53-8bfa-db2f46a030fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:15.268622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-58b8b5fa-aec8-4a53-8bfa-db2f46a030fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:15.269064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-58b8b5fa-aec8-4a53-8bfa-db2f46a030fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:15.269853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-58b8b5fa-aec8-4a53-8bfa-db2f46a030fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:15.270287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-58b8b5fa-aec8-4a53-8bfa-db2f46a030fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:15.297239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-58b8b5fa-aec8-4a53-8bfa-db2f46a030fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040431 Mar 08 04:24:15.297786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 340/692] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:15.819786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5de3ece8-48f6-44dc-ae80-3c3ad7dc93a2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:15.820384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5de3ece8-48f6-44dc-ae80-3c3ad7dc93a2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:15.826768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5de3ece8-48f6-44dc-ae80-3c3ad7dc93a2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:15.827213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5de3ece8-48f6-44dc-ae80-3c3ad7dc93a2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:15.827971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5de3ece8-48f6-44dc-ae80-3c3ad7dc93a2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:15.828404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5de3ece8-48f6-44dc-ae80-3c3ad7dc93a2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:15.962447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5de3ece8-48f6-44dc-ae80-3c3ad7dc93a2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:15.969917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5de3ece8-48f6-44dc-ae80-3c3ad7dc93a2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153998 Mar 08 04:24:15.970483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 353/693] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:15 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:16.130687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-731fa00f-2db2-44a2-b617-4ad28c4f4a6f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:16.131523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-731fa00f-2db2-44a2-b617-4ad28c4f4a6f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:16.139773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-731fa00f-2db2-44a2-b617-4ad28c4f4a6f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:16.140596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-731fa00f-2db2-44a2-b617-4ad28c4f4a6f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:16.142020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-731fa00f-2db2-44a2-b617-4ad28c4f4a6f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:16.142525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-731fa00f-2db2-44a2-b617-4ad28c4f4a6f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:16.170699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-731fa00f-2db2-44a2-b617-4ad28c4f4a6f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048760 Mar 08 04:24:16.171241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 341/694] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:16 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:16.402337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c9c8daa6-01d2-449b-a068-2e93920bf8dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:16.403269 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c9c8daa6-01d2-449b-a068-2e93920bf8dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:16.409208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9c8daa6-01d2-449b-a068-2e93920bf8dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:16.409652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9c8daa6-01d2-449b-a068-2e93920bf8dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:16.410438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9c8daa6-01d2-449b-a068-2e93920bf8dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:16.410869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9c8daa6-01d2-449b-a068-2e93920bf8dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:16.438341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c9c8daa6-01d2-449b-a068-2e93920bf8dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133513 Mar 08 04:24:16.438876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 354/695] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:16.986730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-04ed4b10-75b7-425f-bebf-ab2165a08171 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:16.987332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-04ed4b10-75b7-425f-bebf-ab2165a08171 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:16.993471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04ed4b10-75b7-425f-bebf-ab2165a08171 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:16.993943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04ed4b10-75b7-425f-bebf-ab2165a08171 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:16.994699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04ed4b10-75b7-425f-bebf-ab2165a08171 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:16.995771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04ed4b10-75b7-425f-bebf-ab2165a08171 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:17.126015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-04ed4b10-75b7-425f-bebf-ab2165a08171 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:17.133238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-04ed4b10-75b7-425f-bebf-ab2165a08171 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150323 Mar 08 04:24:17.133832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 342/696] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:17.182206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e5ed0ba9-04dc-4113-b444-1ae74722166f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:17.183795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e5ed0ba9-04dc-4113-b444-1ae74722166f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:17.190018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5ed0ba9-04dc-4113-b444-1ae74722166f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:17.190474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5ed0ba9-04dc-4113-b444-1ae74722166f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:17.191238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5ed0ba9-04dc-4113-b444-1ae74722166f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:17.191711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5ed0ba9-04dc-4113-b444-1ae74722166f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:17.219650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e5ed0ba9-04dc-4113-b444-1ae74722166f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041403 Mar 08 04:24:17.220190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 355/697] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:17.450257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-304c519e-3672-4301-9f52-0784be49cb8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:17.451165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-304c519e-3672-4301-9f52-0784be49cb8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:17.456986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-304c519e-3672-4301-9f52-0784be49cb8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:17.457431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-304c519e-3672-4301-9f52-0784be49cb8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:17.458212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-304c519e-3672-4301-9f52-0784be49cb8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:17.458646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-304c519e-3672-4301-9f52-0784be49cb8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:17.486584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-304c519e-3672-4301-9f52-0784be49cb8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040506 Mar 08 04:24:17.487119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 343/698] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:18.150339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-46cdf929-d012-4e07-a30b-4820f2a522bb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:18.150943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-46cdf929-d012-4e07-a30b-4820f2a522bb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:18.157141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46cdf929-d012-4e07-a30b-4820f2a522bb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:18.157585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46cdf929-d012-4e07-a30b-4820f2a522bb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:18.158371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46cdf929-d012-4e07-a30b-4820f2a522bb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:18.158810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46cdf929-d012-4e07-a30b-4820f2a522bb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:18.231298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1d4d9bc3-13e9-4dce-a4a1-cee1d3470118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:18.232222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1d4d9bc3-13e9-4dce-a4a1-cee1d3470118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:18.237951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d4d9bc3-13e9-4dce-a4a1-cee1d3470118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:18.238410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d4d9bc3-13e9-4dce-a4a1-cee1d3470118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:18.239188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d4d9bc3-13e9-4dce-a4a1-cee1d3470118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:18.239629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d4d9bc3-13e9-4dce-a4a1-cee1d3470118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:18.269002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1d4d9bc3-13e9-4dce-a4a1-cee1d3470118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041718 Mar 08 04:24:18.269567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 344/699] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:18.291227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-46cdf929-d012-4e07-a30b-4820f2a522bb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:18.299368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-46cdf929-d012-4e07-a30b-4820f2a522bb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152940 Mar 08 04:24:18.299919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 356/700] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:18 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:18.497833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1bff2dba-52b8-4c55-92e5-24e54b16b615 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:18.498794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1bff2dba-52b8-4c55-92e5-24e54b16b615 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:18.504642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1bff2dba-52b8-4c55-92e5-24e54b16b615 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:18.505094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1bff2dba-52b8-4c55-92e5-24e54b16b615 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:18.505896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1bff2dba-52b8-4c55-92e5-24e54b16b615 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:18.506337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1bff2dba-52b8-4c55-92e5-24e54b16b615 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:18.535012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1bff2dba-52b8-4c55-92e5-24e54b16b615 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041280 Mar 08 04:24:18.535569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 345/701] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:18.667684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:24:18.667881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:24:19.281186 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-87288799-de3a-471c-a029-5c5c5ce56511 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:19.282125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-87288799-de3a-471c-a029-5c5c5ce56511 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:19.288465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87288799-de3a-471c-a029-5c5c5ce56511 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:19.288913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87288799-de3a-471c-a029-5c5c5ce56511 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:19.289687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87288799-de3a-471c-a029-5c5c5ce56511 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:19.290131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87288799-de3a-471c-a029-5c5c5ce56511 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:19.316047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5763992f-746b-4b1b-99ab-3a9f49b8853f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:19.316674 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5763992f-746b-4b1b-99ab-3a9f49b8853f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:19.319295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-87288799-de3a-471c-a029-5c5c5ce56511 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042281 Mar 08 04:24:19.319843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 357/702] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:19.322555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5763992f-746b-4b1b-99ab-3a9f49b8853f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:19.323059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5763992f-746b-4b1b-99ab-3a9f49b8853f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:19.323998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5763992f-746b-4b1b-99ab-3a9f49b8853f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:19.324430 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5763992f-746b-4b1b-99ab-3a9f49b8853f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:19.461737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5763992f-746b-4b1b-99ab-3a9f49b8853f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:19.469475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5763992f-746b-4b1b-99ab-3a9f49b8853f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157150 Mar 08 04:24:19.470068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 346/703] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:19.547152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8d412c76-227e-41a6-b789-3030c31de919 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:19.548058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8d412c76-227e-41a6-b789-3030c31de919 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:19.553947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d412c76-227e-41a6-b789-3030c31de919 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:19.554394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d412c76-227e-41a6-b789-3030c31de919 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:19.555151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d412c76-227e-41a6-b789-3030c31de919 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:19.555579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d412c76-227e-41a6-b789-3030c31de919 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:19.582445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8d412c76-227e-41a6-b789-3030c31de919 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039278 Mar 08 04:24:19.582978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 358/704] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:20.330859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3a3228fd-daf9-4aab-91e7-6b59367f1bc7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:20.331762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3a3228fd-daf9-4aab-91e7-6b59367f1bc7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:20.337968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a3228fd-daf9-4aab-91e7-6b59367f1bc7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:20.338411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a3228fd-daf9-4aab-91e7-6b59367f1bc7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:20.339282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a3228fd-daf9-4aab-91e7-6b59367f1bc7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:20.339713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a3228fd-daf9-4aab-91e7-6b59367f1bc7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:20.366905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3a3228fd-daf9-4aab-91e7-6b59367f1bc7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039999 Mar 08 04:24:20.367454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 347/705] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:20 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:20.486363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f0293733-2280-412a-af1b-14a829bfd186 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:20.486964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f0293733-2280-412a-af1b-14a829bfd186 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:20.493060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0293733-2280-412a-af1b-14a829bfd186 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:20.493505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0293733-2280-412a-af1b-14a829bfd186 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:20.494293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0293733-2280-412a-af1b-14a829bfd186 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:20.494728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0293733-2280-412a-af1b-14a829bfd186 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:20.593838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-79fa9db1-a885-4ff9-8680-b599d87675b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:20.594774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-79fa9db1-a885-4ff9-8680-b599d87675b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:20.600524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79fa9db1-a885-4ff9-8680-b599d87675b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:20.600974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79fa9db1-a885-4ff9-8680-b599d87675b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:20.601770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79fa9db1-a885-4ff9-8680-b599d87675b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:20.602210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79fa9db1-a885-4ff9-8680-b599d87675b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:20.631439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f0293733-2280-412a-af1b-14a829bfd186 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:20.631661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-79fa9db1-a885-4ff9-8680-b599d87675b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041701 Mar 08 04:24:20.632221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 348/706] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:20.638774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f0293733-2280-412a-af1b-14a829bfd186 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156191 Mar 08 04:24:20.639322 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 359/707] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:20 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:21.379032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e49ad4b5-6ecb-428b-a9a2-ae2ec76744ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:21.379946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e49ad4b5-6ecb-428b-a9a2-ae2ec76744ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:21.386656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e49ad4b5-6ecb-428b-a9a2-ae2ec76744ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:21.387105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e49ad4b5-6ecb-428b-a9a2-ae2ec76744ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:21.387900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e49ad4b5-6ecb-428b-a9a2-ae2ec76744ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:21.388339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e49ad4b5-6ecb-428b-a9a2-ae2ec76744ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:21.416531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e49ad4b5-6ecb-428b-a9a2-ae2ec76744ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 Mar 08 04:24:21.417220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 349/708] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:21 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:21.643630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f5a9cad4-2be8-46a4-bd77-25ddbe3fd172 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:21.644448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f5a9cad4-2be8-46a4-bd77-25ddbe3fd172 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:21.650657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5a9cad4-2be8-46a4-bd77-25ddbe3fd172 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:21.651352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5a9cad4-2be8-46a4-bd77-25ddbe3fd172 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:21.652795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5a9cad4-2be8-46a4-bd77-25ddbe3fd172 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:21.653224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5a9cad4-2be8-46a4-bd77-25ddbe3fd172 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:21.655884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-de729550-aef4-4d6a-8849-0847f2437c2d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:21.656522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-de729550-aef4-4d6a-8849-0847f2437c2d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:21.662238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de729550-aef4-4d6a-8849-0847f2437c2d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:21.662685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de729550-aef4-4d6a-8849-0847f2437c2d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:21.663446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de729550-aef4-4d6a-8849-0847f2437c2d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:21.663879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de729550-aef4-4d6a-8849-0847f2437c2d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:21.682682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f5a9cad4-2be8-46a4-bd77-25ddbe3fd172 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Mar 08 04:24:21.683233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 360/709] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:21.798177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-de729550-aef4-4d6a-8849-0847f2437c2d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:21.805348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-de729550-aef4-4d6a-8849-0847f2437c2d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154114 Mar 08 04:24:21.805933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 350/710] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:21 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:24:22.428275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1111885d-c934-4e00-9899-4c803d7d9df8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:22.429178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1111885d-c934-4e00-9899-4c803d7d9df8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:22.435129 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1111885d-c934-4e00-9899-4c803d7d9df8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:22.435575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1111885d-c934-4e00-9899-4c803d7d9df8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:22.436337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1111885d-c934-4e00-9899-4c803d7d9df8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:22.436771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1111885d-c934-4e00-9899-4c803d7d9df8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:22.464740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1111885d-c934-4e00-9899-4c803d7d9df8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040486 Mar 08 04:24:22.465266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 361/711] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:22.694191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-df8e523b-33f6-482e-9e7f-b8e3f4761ae2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:22.695020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-df8e523b-33f6-482e-9e7f-b8e3f4761ae2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:22.701843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df8e523b-33f6-482e-9e7f-b8e3f4761ae2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:22.702287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df8e523b-33f6-482e-9e7f-b8e3f4761ae2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:22.703042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df8e523b-33f6-482e-9e7f-b8e3f4761ae2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:22.703473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-df8e523b-33f6-482e-9e7f-b8e3f4761ae2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:22.730633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-df8e523b-33f6-482e-9e7f-b8e3f4761ae2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040544 Mar 08 04:24:22.731175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 351/712] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:22.822691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4efa151d-8984-4e12-a2f4-f5f5b992f9f9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:22.823760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4efa151d-8984-4e12-a2f4-f5f5b992f9f9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:22.829770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4efa151d-8984-4e12-a2f4-f5f5b992f9f9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:22.830217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4efa151d-8984-4e12-a2f4-f5f5b992f9f9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:22.831083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4efa151d-8984-4e12-a2f4-f5f5b992f9f9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:22.831550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4efa151d-8984-4e12-a2f4-f5f5b992f9f9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:22.965990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4efa151d-8984-4e12-a2f4-f5f5b992f9f9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:22.973082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4efa151d-8984-4e12-a2f4-f5f5b992f9f9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154586 Mar 08 04:24:22.973633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 362/713] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:22 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:23.476288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0dda47d1-df26-49b4-b715-60a5c846dfed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:23.477186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0dda47d1-df26-49b4-b715-60a5c846dfed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:23.483118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0dda47d1-df26-49b4-b715-60a5c846dfed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:23.483568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0dda47d1-df26-49b4-b715-60a5c846dfed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:23.484329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0dda47d1-df26-49b4-b715-60a5c846dfed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:23.484762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0dda47d1-df26-49b4-b715-60a5c846dfed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:23.513315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0dda47d1-df26-49b4-b715-60a5c846dfed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040953 Mar 08 04:24:23.513888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 352/714] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:23.742304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7918d44c-e193-46b3-8b6a-d24eb93c9009 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:23.743110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7918d44c-e193-46b3-8b6a-d24eb93c9009 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:23.749650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7918d44c-e193-46b3-8b6a-d24eb93c9009 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:23.750122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7918d44c-e193-46b3-8b6a-d24eb93c9009 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:23.750879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7918d44c-e193-46b3-8b6a-d24eb93c9009 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:23.751311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7918d44c-e193-46b3-8b6a-d24eb93c9009 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:23.779362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7918d44c-e193-46b3-8b6a-d24eb93c9009 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040885 Mar 08 04:24:23.779896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 363/715] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:23.989989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2656f0ff-14d0-4681-a184-b6c440ba7e0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:23.990596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2656f0ff-14d0-4681-a184-b6c440ba7e0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:23.997461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2656f0ff-14d0-4681-a184-b6c440ba7e0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:23.997892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2656f0ff-14d0-4681-a184-b6c440ba7e0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:23.998658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2656f0ff-14d0-4681-a184-b6c440ba7e0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:23.999095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2656f0ff-14d0-4681-a184-b6c440ba7e0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:24.130808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2656f0ff-14d0-4681-a184-b6c440ba7e0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:24.138770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2656f0ff-14d0-4681-a184-b6c440ba7e0d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152609 Mar 08 04:24:24.139338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 353/716] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:24.524705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5348c079-dcb4-4655-86a6-98c00a636a76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:24.525626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5348c079-dcb4-4655-86a6-98c00a636a76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:24.532220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5348c079-dcb4-4655-86a6-98c00a636a76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:24.532670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5348c079-dcb4-4655-86a6-98c00a636a76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:24.533434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5348c079-dcb4-4655-86a6-98c00a636a76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:24.533903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5348c079-dcb4-4655-86a6-98c00a636a76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:24.561964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5348c079-dcb4-4655-86a6-98c00a636a76 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041165 Mar 08 04:24:24.562503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 364/717] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:24 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:24.790837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-16d734b1-a3e9-43bf-9c12-923ebfce233c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:24.792288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-16d734b1-a3e9-43bf-9c12-923ebfce233c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:24.798186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d734b1-a3e9-43bf-9c12-923ebfce233c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:24.798633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d734b1-a3e9-43bf-9c12-923ebfce233c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:24.799400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d734b1-a3e9-43bf-9c12-923ebfce233c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:24.799837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d734b1-a3e9-43bf-9c12-923ebfce233c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:24.827941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-16d734b1-a3e9-43bf-9c12-923ebfce233c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041018 Mar 08 04:24:24.828514 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 354/718] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:25.156689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-86d89e6d-b9be-406d-8613-7ec224c4a8c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:25.157237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-86d89e6d-b9be-406d-8613-7ec224c4a8c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:25.163030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-86d89e6d-b9be-406d-8613-7ec224c4a8c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:25.163472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-86d89e6d-b9be-406d-8613-7ec224c4a8c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:25.164225 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-86d89e6d-b9be-406d-8613-7ec224c4a8c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:25.164653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-86d89e6d-b9be-406d-8613-7ec224c4a8c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:25.298224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-86d89e6d-b9be-406d-8613-7ec224c4a8c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:25.305397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-86d89e6d-b9be-406d-8613-7ec224c4a8c0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152902 Mar 08 04:24:25.305985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 365/719] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:25.572490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7099a548-b1bd-4c22-b118-143512e59b0a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:25.574128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7099a548-b1bd-4c22-b118-143512e59b0a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:25.580258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7099a548-b1bd-4c22-b118-143512e59b0a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:25.580704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7099a548-b1bd-4c22-b118-143512e59b0a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:25.581462 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7099a548-b1bd-4c22-b118-143512e59b0a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:25.581916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7099a548-b1bd-4c22-b118-143512e59b0a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:25.609084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7099a548-b1bd-4c22-b118-143512e59b0a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040589 Mar 08 04:24:25.609622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 355/720] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:25 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:25.839464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c20faa3e-99a7-45bf-8c03-931ac07e4a8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:25.840289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c20faa3e-99a7-45bf-8c03-931ac07e4a8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:25.846456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c20faa3e-99a7-45bf-8c03-931ac07e4a8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:25.846901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c20faa3e-99a7-45bf-8c03-931ac07e4a8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:25.847656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c20faa3e-99a7-45bf-8c03-931ac07e4a8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:25.848091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c20faa3e-99a7-45bf-8c03-931ac07e4a8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:25.878960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c20faa3e-99a7-45bf-8c03-931ac07e4a8d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Mar 08 04:24:25.879502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 366/721] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:26.322432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ef13e4ed-bb25-4c36-876f-af24e6da8979 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:26.323260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ef13e4ed-bb25-4c36-876f-af24e6da8979 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:26.329260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ef13e4ed-bb25-4c36-876f-af24e6da8979 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:26.329724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ef13e4ed-bb25-4c36-876f-af24e6da8979 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:26.330484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ef13e4ed-bb25-4c36-876f-af24e6da8979 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:26.330918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ef13e4ed-bb25-4c36-876f-af24e6da8979 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:26.461818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ef13e4ed-bb25-4c36-876f-af24e6da8979 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:26.469429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ef13e4ed-bb25-4c36-876f-af24e6da8979 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150849 Mar 08 04:24:26.470016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 356/722] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:26 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:26.621174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4172c93a-dcf8-4c4a-87fb-6f9cd7982aac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:26.622013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4172c93a-dcf8-4c4a-87fb-6f9cd7982aac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:26.628033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4172c93a-dcf8-4c4a-87fb-6f9cd7982aac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:26.628535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4172c93a-dcf8-4c4a-87fb-6f9cd7982aac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:26.629339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4172c93a-dcf8-4c4a-87fb-6f9cd7982aac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:26.629814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4172c93a-dcf8-4c4a-87fb-6f9cd7982aac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:26.657575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4172c93a-dcf8-4c4a-87fb-6f9cd7982aac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 Mar 08 04:24:26.658143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 367/723] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:26.890193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-584ebc02-6f40-427a-83b8-c16794cd5d2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:26.891033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-584ebc02-6f40-427a-83b8-c16794cd5d2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:26.897170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-584ebc02-6f40-427a-83b8-c16794cd5d2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:26.897609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-584ebc02-6f40-427a-83b8-c16794cd5d2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:26.898399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-584ebc02-6f40-427a-83b8-c16794cd5d2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:26.898826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-584ebc02-6f40-427a-83b8-c16794cd5d2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:26.927406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-584ebc02-6f40-427a-83b8-c16794cd5d2c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040857 Mar 08 04:24:26.927659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 357/724] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:27.486382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e07fc728-8f83-4e39-9ffa-51f5e6677c2a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:27.486972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e07fc728-8f83-4e39-9ffa-51f5e6677c2a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:27.493042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e07fc728-8f83-4e39-9ffa-51f5e6677c2a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:27.493486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e07fc728-8f83-4e39-9ffa-51f5e6677c2a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:27.494281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e07fc728-8f83-4e39-9ffa-51f5e6677c2a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:27.494808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e07fc728-8f83-4e39-9ffa-51f5e6677c2a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:27.668741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1603f50b-1987-410b-960c-f2d4a81b8d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:27.669798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1603f50b-1987-410b-960c-f2d4a81b8d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:27.675900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1603f50b-1987-410b-960c-f2d4a81b8d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:27.676362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1603f50b-1987-410b-960c-f2d4a81b8d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:27.677137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1603f50b-1987-410b-960c-f2d4a81b8d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:27.677571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1603f50b-1987-410b-960c-f2d4a81b8d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:27.708246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1603f50b-1987-410b-960c-f2d4a81b8d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 Mar 08 04:24:27.708831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 358/725] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:27 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:27.839321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e07fc728-8f83-4e39-9ffa-51f5e6677c2a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:27.846663 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e07fc728-8f83-4e39-9ffa-51f5e6677c2a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.364121 Mar 08 04:24:27.847222 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 368/726] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:27 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:27.938962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-06e62fd4-1e0b-41d5-a3d7-452375da74fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:27.939871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-06e62fd4-1e0b-41d5-a3d7-452375da74fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:27.946063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06e62fd4-1e0b-41d5-a3d7-452375da74fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:27.946519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06e62fd4-1e0b-41d5-a3d7-452375da74fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:27.947280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06e62fd4-1e0b-41d5-a3d7-452375da74fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:27.948408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06e62fd4-1e0b-41d5-a3d7-452375da74fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:27.976015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-06e62fd4-1e0b-41d5-a3d7-452375da74fb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040958 Mar 08 04:24:27.976559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 359/727] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:28.720407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c6868630-0082-4531-af0b-75ef9200790f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:28.721305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c6868630-0082-4531-af0b-75ef9200790f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:28.727484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6868630-0082-4531-af0b-75ef9200790f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:28.727933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6868630-0082-4531-af0b-75ef9200790f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:28.728691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6868630-0082-4531-af0b-75ef9200790f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:28.729730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6868630-0082-4531-af0b-75ef9200790f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:28.757406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c6868630-0082-4531-af0b-75ef9200790f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040995 Mar 08 04:24:28.757984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 369/728] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:28.863402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-498aba32-b431-4562-9125-ecd5a3fd7db0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:28.864007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-498aba32-b431-4562-9125-ecd5a3fd7db0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:28.869802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-498aba32-b431-4562-9125-ecd5a3fd7db0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:28.871172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-498aba32-b431-4562-9125-ecd5a3fd7db0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:28.871172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-498aba32-b431-4562-9125-ecd5a3fd7db0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:28.871529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-498aba32-b431-4562-9125-ecd5a3fd7db0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:28.987960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7610a86f-2b82-4366-8ed8-d19134b7341f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:28.988775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7610a86f-2b82-4366-8ed8-d19134b7341f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:28.994548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7610a86f-2b82-4366-8ed8-d19134b7341f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:28.995150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7610a86f-2b82-4366-8ed8-d19134b7341f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:28.995892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7610a86f-2b82-4366-8ed8-d19134b7341f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:28.996320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7610a86f-2b82-4366-8ed8-d19134b7341f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:28.999642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-498aba32-b431-4562-9125-ecd5a3fd7db0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:29.006865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-498aba32-b431-4562-9125-ecd5a3fd7db0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.147249 Mar 08 04:24:29.007525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 360/729] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:28 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:29.024746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7610a86f-2b82-4366-8ed8-d19134b7341f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040744 Mar 08 04:24:29.025275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 370/730] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:29.770335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cc2ee3e5-7995-4b1c-a785-3784cf65a389 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:29.771318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cc2ee3e5-7995-4b1c-a785-3784cf65a389 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:29.777446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc2ee3e5-7995-4b1c-a785-3784cf65a389 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:29.777925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc2ee3e5-7995-4b1c-a785-3784cf65a389 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:29.778693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc2ee3e5-7995-4b1c-a785-3784cf65a389 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:29.779388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc2ee3e5-7995-4b1c-a785-3784cf65a389 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:29.809370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cc2ee3e5-7995-4b1c-a785-3784cf65a389 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042934 Mar 08 04:24:29.810007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 361/731] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:29 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:30.026150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-12679d08-6c14-4425-8975-a531a8103045 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:30.027053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-12679d08-6c14-4425-8975-a531a8103045 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:30.035027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12679d08-6c14-4425-8975-a531a8103045 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:30.035472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12679d08-6c14-4425-8975-a531a8103045 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:30.036269 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12679d08-6c14-4425-8975-a531a8103045 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:30.036778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12679d08-6c14-4425-8975-a531a8103045 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:30.040734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-45e5add7-5ea3-48ff-a0c6-a4f8df6e64f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:30.042484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-45e5add7-5ea3-48ff-a0c6-a4f8df6e64f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:30.048791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45e5add7-5ea3-48ff-a0c6-a4f8df6e64f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:30.049373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45e5add7-5ea3-48ff-a0c6-a4f8df6e64f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:30.050228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45e5add7-5ea3-48ff-a0c6-a4f8df6e64f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:30.050683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45e5add7-5ea3-48ff-a0c6-a4f8df6e64f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:30.088904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-45e5add7-5ea3-48ff-a0c6-a4f8df6e64f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054444 Mar 08 04:24:30.089868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 362/732] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:30.172704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-12679d08-6c14-4425-8975-a531a8103045 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:30.179948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-12679d08-6c14-4425-8975-a531a8103045 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.159070 Mar 08 04:24:30.180507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 371/733] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:30 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:30.820454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-73873c3c-70eb-4d84-9d33-601af7943698 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:30.821358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-73873c3c-70eb-4d84-9d33-601af7943698 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:30.827875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73873c3c-70eb-4d84-9d33-601af7943698 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:30.828460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73873c3c-70eb-4d84-9d33-601af7943698 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:30.829110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73873c3c-70eb-4d84-9d33-601af7943698 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:30.829547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73873c3c-70eb-4d84-9d33-601af7943698 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:30.858008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-73873c3c-70eb-4d84-9d33-601af7943698 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Mar 08 04:24:30.858590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 363/734] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:30 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:31.101011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-775f4cbc-7ed4-40f0-a75c-488c63e8c237 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:31.101899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-775f4cbc-7ed4-40f0-a75c-488c63e8c237 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:31.108641 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-775f4cbc-7ed4-40f0-a75c-488c63e8c237 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:31.109082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-775f4cbc-7ed4-40f0-a75c-488c63e8c237 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:31.109870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-775f4cbc-7ed4-40f0-a75c-488c63e8c237 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:31.110300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-775f4cbc-7ed4-40f0-a75c-488c63e8c237 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:31.140470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-775f4cbc-7ed4-40f0-a75c-488c63e8c237 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Mar 08 04:24:31.141040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 372/735] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:31.196268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-54ee08bc-1175-46a3-9a92-fe6efa5d8a3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:31.196877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-54ee08bc-1175-46a3-9a92-fe6efa5d8a3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:31.203425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-54ee08bc-1175-46a3-9a92-fe6efa5d8a3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:31.203879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-54ee08bc-1175-46a3-9a92-fe6efa5d8a3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:31.204653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-54ee08bc-1175-46a3-9a92-fe6efa5d8a3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:31.205100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-54ee08bc-1175-46a3-9a92-fe6efa5d8a3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:31.340869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-54ee08bc-1175-46a3-9a92-fe6efa5d8a3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:31.348785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-54ee08bc-1175-46a3-9a92-fe6efa5d8a3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156321 Mar 08 04:24:31.349355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 364/736] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:31 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:31.869498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9d971b1d-e95a-4e35-b879-4f4166c5bf3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:31.870625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9d971b1d-e95a-4e35-b879-4f4166c5bf3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:31.876404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d971b1d-e95a-4e35-b879-4f4166c5bf3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:31.876846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d971b1d-e95a-4e35-b879-4f4166c5bf3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:31.877595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d971b1d-e95a-4e35-b879-4f4166c5bf3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:31.878060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d971b1d-e95a-4e35-b879-4f4166c5bf3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:31.907389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9d971b1d-e95a-4e35-b879-4f4166c5bf3c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041856 Mar 08 04:24:31.907931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 373/737] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:32.152942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a8aea143-29d6-402c-9ee8-8188a95a6944 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:32.153800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a8aea143-29d6-402c-9ee8-8188a95a6944 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:32.159903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8aea143-29d6-402c-9ee8-8188a95a6944 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:32.160353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8aea143-29d6-402c-9ee8-8188a95a6944 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:32.161143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8aea143-29d6-402c-9ee8-8188a95a6944 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:32.161583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8aea143-29d6-402c-9ee8-8188a95a6944 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:32.188269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a8aea143-29d6-402c-9ee8-8188a95a6944 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040230 Mar 08 04:24:32.188820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 365/738] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:32.366610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-804e3b55-b97f-4dd5-abe3-c90530101d05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:32.367212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-804e3b55-b97f-4dd5-abe3-c90530101d05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:32.374573 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-804e3b55-b97f-4dd5-abe3-c90530101d05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:32.375013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-804e3b55-b97f-4dd5-abe3-c90530101d05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:32.375777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-804e3b55-b97f-4dd5-abe3-c90530101d05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:32.376199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-804e3b55-b97f-4dd5-abe3-c90530101d05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:32.506736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-804e3b55-b97f-4dd5-abe3-c90530101d05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:32.514653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-804e3b55-b97f-4dd5-abe3-c90530101d05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151880 Mar 08 04:24:32.515220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 374/739] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:32 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:32.919535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f682a0d5-993f-42c0-9098-87d3f53de3ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:32.920443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f682a0d5-993f-42c0-9098-87d3f53de3ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:32.926686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f682a0d5-993f-42c0-9098-87d3f53de3ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:32.927138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f682a0d5-993f-42c0-9098-87d3f53de3ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:32.927898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f682a0d5-993f-42c0-9098-87d3f53de3ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:32.928333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f682a0d5-993f-42c0-9098-87d3f53de3ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:32.955970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f682a0d5-993f-42c0-9098-87d3f53de3ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041034 Mar 08 04:24:32.956510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 366/740] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:33.199742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b11a9d34-9c1a-4a6b-afaa-41aad4320955 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:33.200657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b11a9d34-9c1a-4a6b-afaa-41aad4320955 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:33.206480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b11a9d34-9c1a-4a6b-afaa-41aad4320955 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:33.206919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b11a9d34-9c1a-4a6b-afaa-41aad4320955 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:33.207670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b11a9d34-9c1a-4a6b-afaa-41aad4320955 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:33.208100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b11a9d34-9c1a-4a6b-afaa-41aad4320955 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:33.236004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b11a9d34-9c1a-4a6b-afaa-41aad4320955 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040368 Mar 08 04:24:33.236530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 375/741] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:33.532325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ea270fa1-4e83-47bf-9c82-88327ccd8bc5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:33.532861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ea270fa1-4e83-47bf-9c82-88327ccd8bc5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:33.538693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea270fa1-4e83-47bf-9c82-88327ccd8bc5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:33.539136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea270fa1-4e83-47bf-9c82-88327ccd8bc5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:33.539891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea270fa1-4e83-47bf-9c82-88327ccd8bc5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:33.540317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea270fa1-4e83-47bf-9c82-88327ccd8bc5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:33.673171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ea270fa1-4e83-47bf-9c82-88327ccd8bc5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:33.680341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ea270fa1-4e83-47bf-9c82-88327ccd8bc5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152220 Mar 08 04:24:33.680894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 367/742] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:33 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:33.967637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fca52601-0d1c-449d-97ca-31b58d94651b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:33.968546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fca52601-0d1c-449d-97ca-31b58d94651b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:33.975014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fca52601-0d1c-449d-97ca-31b58d94651b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:33.975454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fca52601-0d1c-449d-97ca-31b58d94651b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:33.976208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fca52601-0d1c-449d-97ca-31b58d94651b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:33.976638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fca52601-0d1c-449d-97ca-31b58d94651b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:34.003652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fca52601-0d1c-449d-97ca-31b58d94651b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039964 Mar 08 04:24:34.004179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 376/743] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:34.248152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c252761e-0406-4843-a745-45362b9d029f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:34.249054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c252761e-0406-4843-a745-45362b9d029f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:34.255354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c252761e-0406-4843-a745-45362b9d029f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:34.255798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c252761e-0406-4843-a745-45362b9d029f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:34.256563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c252761e-0406-4843-a745-45362b9d029f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:34.256994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c252761e-0406-4843-a745-45362b9d029f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:34.286271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c252761e-0406-4843-a745-45362b9d029f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042678 Mar 08 04:24:34.286847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 368/744] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:34.697143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-13b8d27b-c5ff-44a8-a488-041a6a3bfdd0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:34.697852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-13b8d27b-c5ff-44a8-a488-041a6a3bfdd0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:34.703732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13b8d27b-c5ff-44a8-a488-041a6a3bfdd0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:34.704188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13b8d27b-c5ff-44a8-a488-041a6a3bfdd0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:34.704956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13b8d27b-c5ff-44a8-a488-041a6a3bfdd0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:34.705396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13b8d27b-c5ff-44a8-a488-041a6a3bfdd0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:34.838122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-13b8d27b-c5ff-44a8-a488-041a6a3bfdd0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:34.845324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-13b8d27b-c5ff-44a8-a488-041a6a3bfdd0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152026 Mar 08 04:24:34.845953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 377/745] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:34 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:35.014775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6e9a2836-37cb-4fb7-86b2-000392ae660c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:35.015618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6e9a2836-37cb-4fb7-86b2-000392ae660c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:35.021434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e9a2836-37cb-4fb7-86b2-000392ae660c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:35.021926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e9a2836-37cb-4fb7-86b2-000392ae660c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:35.022692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e9a2836-37cb-4fb7-86b2-000392ae660c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:35.023128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e9a2836-37cb-4fb7-86b2-000392ae660c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:35.052667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6e9a2836-37cb-4fb7-86b2-000392ae660c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041873 Mar 08 04:24:35.053534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 369/746] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:35.297509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2ea241e2-a5a1-4acd-9595-0b1309b3bf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:35.298375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2ea241e2-a5a1-4acd-9595-0b1309b3bf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:35.304586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ea241e2-a5a1-4acd-9595-0b1309b3bf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:35.305032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ea241e2-a5a1-4acd-9595-0b1309b3bf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:35.305813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ea241e2-a5a1-4acd-9595-0b1309b3bf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:35.306245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ea241e2-a5a1-4acd-9595-0b1309b3bf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:35.334098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2ea241e2-a5a1-4acd-9595-0b1309b3bf18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040618 Mar 08 04:24:35.334628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 378/747] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:35.862719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8f0ce044-36a0-4e22-b23a-b1f0250d48c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:35.863327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8f0ce044-36a0-4e22-b23a-b1f0250d48c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:35.870252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8f0ce044-36a0-4e22-b23a-b1f0250d48c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:35.870702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8f0ce044-36a0-4e22-b23a-b1f0250d48c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:35.871470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8f0ce044-36a0-4e22-b23a-b1f0250d48c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:35.871904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8f0ce044-36a0-4e22-b23a-b1f0250d48c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:36.003593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8f0ce044-36a0-4e22-b23a-b1f0250d48c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:36.011575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8f0ce044-36a0-4e22-b23a-b1f0250d48c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152705 Mar 08 04:24:36.012136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 370/748] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:35 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:36.064267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6158e776-a28d-4011-a3f7-94c58a1c5d26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:36.065175 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6158e776-a28d-4011-a3f7-94c58a1c5d26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:36.071081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6158e776-a28d-4011-a3f7-94c58a1c5d26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:36.071522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6158e776-a28d-4011-a3f7-94c58a1c5d26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:36.072903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6158e776-a28d-4011-a3f7-94c58a1c5d26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:36.073480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6158e776-a28d-4011-a3f7-94c58a1c5d26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:36.101579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6158e776-a28d-4011-a3f7-94c58a1c5d26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 Mar 08 04:24:36.102146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 379/749] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:36.345563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f2e77e14-c434-4942-a937-c6e3af82b48b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:36.346489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f2e77e14-c434-4942-a937-c6e3af82b48b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:36.352340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2e77e14-c434-4942-a937-c6e3af82b48b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:36.352783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2e77e14-c434-4942-a937-c6e3af82b48b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:36.354082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2e77e14-c434-4942-a937-c6e3af82b48b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:36.354517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2e77e14-c434-4942-a937-c6e3af82b48b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:36.381604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f2e77e14-c434-4942-a937-c6e3af82b48b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040071 Mar 08 04:24:36.382160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 371/750] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:37.028494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e58202ee-daab-46f4-9fe4-2c4cce52054b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:37.029381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e58202ee-daab-46f4-9fe4-2c4cce52054b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:37.035478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e58202ee-daab-46f4-9fe4-2c4cce52054b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:37.035925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e58202ee-daab-46f4-9fe4-2c4cce52054b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:37.036679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e58202ee-daab-46f4-9fe4-2c4cce52054b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:37.037108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e58202ee-daab-46f4-9fe4-2c4cce52054b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:37.113707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c08b2ac4-8113-43dc-8c33-257ce9bcd946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:37.114519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c08b2ac4-8113-43dc-8c33-257ce9bcd946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:37.121181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c08b2ac4-8113-43dc-8c33-257ce9bcd946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:37.121640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c08b2ac4-8113-43dc-8c33-257ce9bcd946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:37.122436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c08b2ac4-8113-43dc-8c33-257ce9bcd946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:37.122873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c08b2ac4-8113-43dc-8c33-257ce9bcd946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:37.152178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c08b2ac4-8113-43dc-8c33-257ce9bcd946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 Mar 08 04:24:37.153524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 372/751] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:37.167691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e58202ee-daab-46f4-9fe4-2c4cce52054b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:37.174919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e58202ee-daab-46f4-9fe4-2c4cce52054b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150845 Mar 08 04:24:37.175463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 380/752] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:37 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:37.393151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-925a02c9-cffb-4d70-bbb0-86a88434cf63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:37.394028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-925a02c9-cffb-4d70-bbb0-86a88434cf63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:37.399769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-925a02c9-cffb-4d70-bbb0-86a88434cf63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:37.400353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-925a02c9-cffb-4d70-bbb0-86a88434cf63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:37.400967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-925a02c9-cffb-4d70-bbb0-86a88434cf63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:37.401397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-925a02c9-cffb-4d70-bbb0-86a88434cf63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:37.428239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-925a02c9-cffb-4d70-bbb0-86a88434cf63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039063 Mar 08 04:24:37.428773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 373/753] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:38.164505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c8169636-2d74-4ede-a0eb-2c0a6226c3ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:38.165488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c8169636-2d74-4ede-a0eb-2c0a6226c3ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:38.172409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8169636-2d74-4ede-a0eb-2c0a6226c3ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:38.172864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8169636-2d74-4ede-a0eb-2c0a6226c3ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:38.173630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8169636-2d74-4ede-a0eb-2c0a6226c3ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:38.174211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8169636-2d74-4ede-a0eb-2c0a6226c3ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:38.192034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d05f7fea-fdc8-40e0-a0cf-a85182c7e52e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:38.192646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d05f7fea-fdc8-40e0-a0cf-a85182c7e52e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:38.199013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d05f7fea-fdc8-40e0-a0cf-a85182c7e52e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:38.199470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d05f7fea-fdc8-40e0-a0cf-a85182c7e52e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:38.200245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d05f7fea-fdc8-40e0-a0cf-a85182c7e52e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:38.200689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d05f7fea-fdc8-40e0-a0cf-a85182c7e52e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:38.207259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c8169636-2d74-4ede-a0eb-2c0a6226c3ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Mar 08 04:24:38.208088 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 381/754] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:38 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:38.334061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d05f7fea-fdc8-40e0-a0cf-a85182c7e52e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:38.342167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d05f7fea-fdc8-40e0-a0cf-a85182c7e52e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153881 Mar 08 04:24:38.342738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 374/755] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:38 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:24:38.440217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-94d50a24-dc3a-4fc0-88bb-2dc28dfeafc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:38.441051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-94d50a24-dc3a-4fc0-88bb-2dc28dfeafc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:38.446842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94d50a24-dc3a-4fc0-88bb-2dc28dfeafc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:38.447811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94d50a24-dc3a-4fc0-88bb-2dc28dfeafc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:38.448618 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94d50a24-dc3a-4fc0-88bb-2dc28dfeafc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:38.449053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94d50a24-dc3a-4fc0-88bb-2dc28dfeafc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:38.476750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-94d50a24-dc3a-4fc0-88bb-2dc28dfeafc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040572 Mar 08 04:24:38.477290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 382/756] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:39.219558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d8cba86a-f176-4a47-bfdb-fd9f3215107b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:39.220485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d8cba86a-f176-4a47-bfdb-fd9f3215107b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:39.226693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8cba86a-f176-4a47-bfdb-fd9f3215107b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:39.227130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8cba86a-f176-4a47-bfdb-fd9f3215107b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:39.227884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8cba86a-f176-4a47-bfdb-fd9f3215107b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:39.228819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8cba86a-f176-4a47-bfdb-fd9f3215107b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:39.256655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d8cba86a-f176-4a47-bfdb-fd9f3215107b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Mar 08 04:24:39.257203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 375/757] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:39.359564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ff3c600b-8f99-4875-961e-cce9ac463f60 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:39.360173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ff3c600b-8f99-4875-961e-cce9ac463f60 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:39.366362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff3c600b-8f99-4875-961e-cce9ac463f60 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:39.366810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff3c600b-8f99-4875-961e-cce9ac463f60 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:39.367574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff3c600b-8f99-4875-961e-cce9ac463f60 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:39.368006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff3c600b-8f99-4875-961e-cce9ac463f60 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:39.488409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-87eb42a9-88e2-4f84-8e83-ad79b44f822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:39.489270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-87eb42a9-88e2-4f84-8e83-ad79b44f822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:39.494976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87eb42a9-88e2-4f84-8e83-ad79b44f822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:39.495426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87eb42a9-88e2-4f84-8e83-ad79b44f822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:39.496192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87eb42a9-88e2-4f84-8e83-ad79b44f822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:39.496626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87eb42a9-88e2-4f84-8e83-ad79b44f822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:39.500564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ff3c600b-8f99-4875-961e-cce9ac463f60 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:39.507776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ff3c600b-8f99-4875-961e-cce9ac463f60 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152120 Mar 08 04:24:39.508331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 383/758] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:39 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:39.524626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-87eb42a9-88e2-4f84-8e83-ad79b44f822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040248 Mar 08 04:24:39.525832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 376/759] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:40.267417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-811052d1-8a02-4ae0-bbde-67f5702d7a65 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:40.268333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-811052d1-8a02-4ae0-bbde-67f5702d7a65 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:40.274165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811052d1-8a02-4ae0-bbde-67f5702d7a65 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:40.274623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811052d1-8a02-4ae0-bbde-67f5702d7a65 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:40.275388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811052d1-8a02-4ae0-bbde-67f5702d7a65 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:40.275825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811052d1-8a02-4ae0-bbde-67f5702d7a65 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:40.303324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-811052d1-8a02-4ae0-bbde-67f5702d7a65 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039914 Mar 08 04:24:40.303862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 384/760] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:40.524185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d195d543-653d-4018-89f1-b1a016eb12c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:40.524700 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d195d543-653d-4018-89f1-b1a016eb12c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:40.531226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d195d543-653d-4018-89f1-b1a016eb12c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:40.531676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d195d543-653d-4018-89f1-b1a016eb12c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:40.532540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d195d543-653d-4018-89f1-b1a016eb12c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:40.532905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d195d543-653d-4018-89f1-b1a016eb12c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:40.536277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c254b023-d8e4-48ac-b9cf-06deaae1ac74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:40.537198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c254b023-d8e4-48ac-b9cf-06deaae1ac74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:40.543344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c254b023-d8e4-48ac-b9cf-06deaae1ac74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:40.543795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c254b023-d8e4-48ac-b9cf-06deaae1ac74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:40.544554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c254b023-d8e4-48ac-b9cf-06deaae1ac74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:40.545016 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c254b023-d8e4-48ac-b9cf-06deaae1ac74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:40.574184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c254b023-d8e4-48ac-b9cf-06deaae1ac74 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041730 Mar 08 04:24:40.574756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 385/761] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:40.663537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d195d543-653d-4018-89f1-b1a016eb12c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:40.671400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d195d543-653d-4018-89f1-b1a016eb12c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151119 Mar 08 04:24:40.671955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 377/762] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:40 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:41.314896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ba7ed23d-8442-45a2-882a-e6487640aa57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:41.315811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ba7ed23d-8442-45a2-882a-e6487640aa57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:41.321685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba7ed23d-8442-45a2-882a-e6487640aa57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:41.322864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba7ed23d-8442-45a2-882a-e6487640aa57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:41.323628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba7ed23d-8442-45a2-882a-e6487640aa57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:41.324064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba7ed23d-8442-45a2-882a-e6487640aa57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:41.351742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ba7ed23d-8442-45a2-882a-e6487640aa57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040810 Mar 08 04:24:41.352280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 386/763] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:41.585714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7fea6c6e-989e-4741-a52b-71a800394897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:41.586593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7fea6c6e-989e-4741-a52b-71a800394897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:41.593372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7fea6c6e-989e-4741-a52b-71a800394897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:41.593863 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7fea6c6e-989e-4741-a52b-71a800394897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:41.594634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7fea6c6e-989e-4741-a52b-71a800394897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:41.595072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7fea6c6e-989e-4741-a52b-71a800394897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:41.622832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7fea6c6e-989e-4741-a52b-71a800394897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041175 Mar 08 04:24:41.623370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 378/764] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:41.688299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0d7b6034-f159-4ad2-90e4-a827832d3389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:41.688901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0d7b6034-f159-4ad2-90e4-a827832d3389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:41.695031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d7b6034-f159-4ad2-90e4-a827832d3389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:41.695476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d7b6034-f159-4ad2-90e4-a827832d3389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:41.696230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d7b6034-f159-4ad2-90e4-a827832d3389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:41.696663 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d7b6034-f159-4ad2-90e4-a827832d3389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:41.830885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0d7b6034-f159-4ad2-90e4-a827832d3389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:41.838178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0d7b6034-f159-4ad2-90e4-a827832d3389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153603 Mar 08 04:24:41.838672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 387/765] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:41 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:42.363453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1fdddaef-0102-4b3b-be58-671888e4b866 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:42.364358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1fdddaef-0102-4b3b-be58-671888e4b866 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:42.371025 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1fdddaef-0102-4b3b-be58-671888e4b866 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:42.371471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1fdddaef-0102-4b3b-be58-671888e4b866 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:42.372239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1fdddaef-0102-4b3b-be58-671888e4b866 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:42.372672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1fdddaef-0102-4b3b-be58-671888e4b866 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:42.402450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1fdddaef-0102-4b3b-be58-671888e4b866 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 Mar 08 04:24:42.403213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 379/766] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:42 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:42.634331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-17823df5-24d0-4b5b-a18c-4a52ac59c966 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:42.635242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-17823df5-24d0-4b5b-a18c-4a52ac59c966 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:42.640986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-17823df5-24d0-4b5b-a18c-4a52ac59c966 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:42.641432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-17823df5-24d0-4b5b-a18c-4a52ac59c966 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:42.642223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-17823df5-24d0-4b5b-a18c-4a52ac59c966 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:42.642660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-17823df5-24d0-4b5b-a18c-4a52ac59c966 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:42.670752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-17823df5-24d0-4b5b-a18c-4a52ac59c966 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040494 Mar 08 04:24:42.671296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 388/767] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:42.855881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2b654543-c263-4dd1-acd9-dfb268a290d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:42.856484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2b654543-c263-4dd1-acd9-dfb268a290d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:42.862679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2b654543-c263-4dd1-acd9-dfb268a290d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:42.863122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2b654543-c263-4dd1-acd9-dfb268a290d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:42.863875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2b654543-c263-4dd1-acd9-dfb268a290d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:42.864305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2b654543-c263-4dd1-acd9-dfb268a290d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:42.993742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2b654543-c263-4dd1-acd9-dfb268a290d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:43.001750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2b654543-c263-4dd1-acd9-dfb268a290d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150429 Mar 08 04:24:43.002303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 380/768] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:42 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:43.414666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-41c6d8ba-ec76-4924-9e9c-8c51aa059449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:43.415576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-41c6d8ba-ec76-4924-9e9c-8c51aa059449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:43.422526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41c6d8ba-ec76-4924-9e9c-8c51aa059449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:43.422982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41c6d8ba-ec76-4924-9e9c-8c51aa059449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:43.423754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41c6d8ba-ec76-4924-9e9c-8c51aa059449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:43.424190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41c6d8ba-ec76-4924-9e9c-8c51aa059449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:43.453751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-41c6d8ba-ec76-4924-9e9c-8c51aa059449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043181 Mar 08 04:24:43.454306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 389/769] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:43.687763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9be80ffa-623a-45cf-ad69-a0222fcbd795 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:43.688571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9be80ffa-623a-45cf-ad69-a0222fcbd795 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:43.694373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9be80ffa-623a-45cf-ad69-a0222fcbd795 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:43.694821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9be80ffa-623a-45cf-ad69-a0222fcbd795 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:43.695580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9be80ffa-623a-45cf-ad69-a0222fcbd795 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:43.696016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9be80ffa-623a-45cf-ad69-a0222fcbd795 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:43.723317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9be80ffa-623a-45cf-ad69-a0222fcbd795 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039620 Mar 08 04:24:43.723851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 381/770] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:44.018565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9c881ecd-496d-4e42-9c82-f2086d13eed1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:44.019094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9c881ecd-496d-4e42-9c82-f2086d13eed1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:44.024823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c881ecd-496d-4e42-9c82-f2086d13eed1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:44.025273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c881ecd-496d-4e42-9c82-f2086d13eed1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:44.026759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c881ecd-496d-4e42-9c82-f2086d13eed1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:44.027187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c881ecd-496d-4e42-9c82-f2086d13eed1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:44.160198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9c881ecd-496d-4e42-9c82-f2086d13eed1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:44.167454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9c881ecd-496d-4e42-9c82-f2086d13eed1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152766 Mar 08 04:24:44.168009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 390/771] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:44 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:44.465100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-799661ca-2bfb-4632-99d7-d00a5c5a4695 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:44.466044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-799661ca-2bfb-4632-99d7-d00a5c5a4695 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:44.472270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-799661ca-2bfb-4632-99d7-d00a5c5a4695 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:44.472723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-799661ca-2bfb-4632-99d7-d00a5c5a4695 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:44.473489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-799661ca-2bfb-4632-99d7-d00a5c5a4695 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:44.473954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-799661ca-2bfb-4632-99d7-d00a5c5a4695 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:44.506273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-799661ca-2bfb-4632-99d7-d00a5c5a4695 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Mar 08 04:24:44.506825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 382/772] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:44.734904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ed833757-70ef-4ba5-8e7a-4217279a3c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:44.736105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ed833757-70ef-4ba5-8e7a-4217279a3c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:44.742342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed833757-70ef-4ba5-8e7a-4217279a3c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:44.742786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed833757-70ef-4ba5-8e7a-4217279a3c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:44.743543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed833757-70ef-4ba5-8e7a-4217279a3c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:44.743973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed833757-70ef-4ba5-8e7a-4217279a3c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:44.772958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ed833757-70ef-4ba5-8e7a-4217279a3c58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042128 Mar 08 04:24:44.773497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 391/773] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:45.184824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fe54b45d-0a5a-4836-aebb-7bdc88b9b875 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:45.185437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fe54b45d-0a5a-4836-aebb-7bdc88b9b875 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:45.191336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe54b45d-0a5a-4836-aebb-7bdc88b9b875 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:45.191787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe54b45d-0a5a-4836-aebb-7bdc88b9b875 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:45.192555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe54b45d-0a5a-4836-aebb-7bdc88b9b875 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:45.192993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe54b45d-0a5a-4836-aebb-7bdc88b9b875 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:45.324238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fe54b45d-0a5a-4836-aebb-7bdc88b9b875 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:45.331532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fe54b45d-0a5a-4836-aebb-7bdc88b9b875 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151112 Mar 08 04:24:45.332096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 383/774] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:45 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:45.517421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5641583a-3b91-4802-a5bc-c66d078faa9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:45.518298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5641583a-3b91-4802-a5bc-c66d078faa9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:45.524290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5641583a-3b91-4802-a5bc-c66d078faa9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:45.524732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5641583a-3b91-4802-a5bc-c66d078faa9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:45.525505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5641583a-3b91-4802-a5bc-c66d078faa9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:45.526048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5641583a-3b91-4802-a5bc-c66d078faa9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:45.555830 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5641583a-3b91-4802-a5bc-c66d078faa9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042363 Mar 08 04:24:45.556374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 392/775] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:45.784758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-97efe094-c105-417c-8c7c-3ea1a80fd4d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:45.785590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-97efe094-c105-417c-8c7c-3ea1a80fd4d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:45.792379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97efe094-c105-417c-8c7c-3ea1a80fd4d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:45.792817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97efe094-c105-417c-8c7c-3ea1a80fd4d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:45.793586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97efe094-c105-417c-8c7c-3ea1a80fd4d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:45.794048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97efe094-c105-417c-8c7c-3ea1a80fd4d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:45.822378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-97efe094-c105-417c-8c7c-3ea1a80fd4d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 Mar 08 04:24:45.822941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 384/776] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:46.348496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a3f282bf-f3c1-4591-92e2-48d342f3fd16 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:46.349112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a3f282bf-f3c1-4591-92e2-48d342f3fd16 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:46.355962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3f282bf-f3c1-4591-92e2-48d342f3fd16 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:46.356410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3f282bf-f3c1-4591-92e2-48d342f3fd16 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:46.357171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3f282bf-f3c1-4591-92e2-48d342f3fd16 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:46.357607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3f282bf-f3c1-4591-92e2-48d342f3fd16 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:46.495782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a3f282bf-f3c1-4591-92e2-48d342f3fd16 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:46.503067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a3f282bf-f3c1-4591-92e2-48d342f3fd16 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158394 Mar 08 04:24:46.503626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 393/777] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:46 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:46.567806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2ce64dc1-05dd-4833-b7bc-6bb72322e33f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:46.568712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2ce64dc1-05dd-4833-b7bc-6bb72322e33f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:46.574582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ce64dc1-05dd-4833-b7bc-6bb72322e33f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:46.575033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ce64dc1-05dd-4833-b7bc-6bb72322e33f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:46.575800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ce64dc1-05dd-4833-b7bc-6bb72322e33f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:46.576234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ce64dc1-05dd-4833-b7bc-6bb72322e33f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:46.605866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2ce64dc1-05dd-4833-b7bc-6bb72322e33f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041802 Mar 08 04:24:46.606350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 385/778] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:46.834006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-be242092-40bc-42e8-98aa-4ae8485d90a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:46.834807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-be242092-40bc-42e8-98aa-4ae8485d90a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:46.841296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be242092-40bc-42e8-98aa-4ae8485d90a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:46.841771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be242092-40bc-42e8-98aa-4ae8485d90a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:46.842536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be242092-40bc-42e8-98aa-4ae8485d90a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:46.842972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be242092-40bc-42e8-98aa-4ae8485d90a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:46.871045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-be242092-40bc-42e8-98aa-4ae8485d90a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041071 Mar 08 04:24:46.871542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 394/779] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:47.519589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-38abe909-62e7-4f32-b499-158f10009382 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:47.520190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-38abe909-62e7-4f32-b499-158f10009382 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:47.526519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38abe909-62e7-4f32-b499-158f10009382 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:47.526993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38abe909-62e7-4f32-b499-158f10009382 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:47.527754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38abe909-62e7-4f32-b499-158f10009382 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:47.528185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38abe909-62e7-4f32-b499-158f10009382 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:47.617369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f6807b61-ac23-4432-9cc7-022103ee5a5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:47.618334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f6807b61-ac23-4432-9cc7-022103ee5a5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:47.625906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f6807b61-ac23-4432-9cc7-022103ee5a5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:47.626356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f6807b61-ac23-4432-9cc7-022103ee5a5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:47.627134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f6807b61-ac23-4432-9cc7-022103ee5a5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:47.627569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f6807b61-ac23-4432-9cc7-022103ee5a5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:47.656313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f6807b61-ac23-4432-9cc7-022103ee5a5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042858 Mar 08 04:24:47.657058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 395/780] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:47.663369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-38abe909-62e7-4f32-b499-158f10009382 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:47.670827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-38abe909-62e7-4f32-b499-158f10009382 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155043 Mar 08 04:24:47.671385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 386/781] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:47 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:47.882584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8fb6fb14-72aa-41ca-a711-2961c788e6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:47.883489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8fb6fb14-72aa-41ca-a711-2961c788e6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:47.889452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8fb6fb14-72aa-41ca-a711-2961c788e6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:47.889941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8fb6fb14-72aa-41ca-a711-2961c788e6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:47.890705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8fb6fb14-72aa-41ca-a711-2961c788e6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:47.891135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8fb6fb14-72aa-41ca-a711-2961c788e6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:47.918924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8fb6fb14-72aa-41ca-a711-2961c788e6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040277 Mar 08 04:24:47.919462 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 396/782] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:48.668229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-624cb5d4-a043-4a5a-ba59-b1f4d559a6cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:48.669141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-624cb5d4-a043-4a5a-ba59-b1f4d559a6cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:48.675392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-624cb5d4-a043-4a5a-ba59-b1f4d559a6cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:48.675845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-624cb5d4-a043-4a5a-ba59-b1f4d559a6cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:48.676612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-624cb5d4-a043-4a5a-ba59-b1f4d559a6cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:48.677046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-624cb5d4-a043-4a5a-ba59-b1f4d559a6cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:48.687558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3ce55730-abf8-4892-b2c4-fbe87d814ea7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:48.688174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3ce55730-abf8-4892-b2c4-fbe87d814ea7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:48.694302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ce55730-abf8-4892-b2c4-fbe87d814ea7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:48.694757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ce55730-abf8-4892-b2c4-fbe87d814ea7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:48.695523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ce55730-abf8-4892-b2c4-fbe87d814ea7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:48.695968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ce55730-abf8-4892-b2c4-fbe87d814ea7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:48.706592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-624cb5d4-a043-4a5a-ba59-b1f4d559a6cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042614 Mar 08 04:24:48.707158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 387/783] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:48.830131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3ce55730-abf8-4892-b2c4-fbe87d814ea7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:48.837499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3ce55730-abf8-4892-b2c4-fbe87d814ea7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153786 Mar 08 04:24:48.838679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 397/784] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:48 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:24:48.930503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-40a102ad-3d17-4c27-9be8-5ae8680db170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:48.931368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-40a102ad-3d17-4c27-9be8-5ae8680db170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:48.937213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40a102ad-3d17-4c27-9be8-5ae8680db170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:48.937677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40a102ad-3d17-4c27-9be8-5ae8680db170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:48.938469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40a102ad-3d17-4c27-9be8-5ae8680db170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:48.938902 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40a102ad-3d17-4c27-9be8-5ae8680db170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:48.966635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-40a102ad-3d17-4c27-9be8-5ae8680db170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040095 Mar 08 04:24:48.967163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 388/785] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:49.718434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-476f3608-8a3a-4d2e-8793-a26f6770d068 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:49.719420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-476f3608-8a3a-4d2e-8793-a26f6770d068 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:49.725630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-476f3608-8a3a-4d2e-8793-a26f6770d068 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:49.726219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-476f3608-8a3a-4d2e-8793-a26f6770d068 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:49.726983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-476f3608-8a3a-4d2e-8793-a26f6770d068 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:49.727420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-476f3608-8a3a-4d2e-8793-a26f6770d068 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:49.756244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-476f3608-8a3a-4d2e-8793-a26f6770d068 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041795 Mar 08 04:24:49.756799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 398/786] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:49.855869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fbf36269-d28a-4b7c-a550-3500ea58e570 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:49.856480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fbf36269-d28a-4b7c-a550-3500ea58e570 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:49.862826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbf36269-d28a-4b7c-a550-3500ea58e570 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:49.863275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbf36269-d28a-4b7c-a550-3500ea58e570 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:49.864035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbf36269-d28a-4b7c-a550-3500ea58e570 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:49.864469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbf36269-d28a-4b7c-a550-3500ea58e570 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:49.978070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-74678cad-7c93-436d-a478-e61093d44f1b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:49.979813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-74678cad-7c93-436d-a478-e61093d44f1b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:49.985647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74678cad-7c93-436d-a478-e61093d44f1b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:49.986128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74678cad-7c93-436d-a478-e61093d44f1b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:49.986892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74678cad-7c93-436d-a478-e61093d44f1b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:49.987329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74678cad-7c93-436d-a478-e61093d44f1b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:49.999372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fbf36269-d28a-4b7c-a550-3500ea58e570 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:50.007383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fbf36269-d28a-4b7c-a550-3500ea58e570 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155707 Mar 08 04:24:50.007949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 389/787] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:49 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:50.017159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-74678cad-7c93-436d-a478-e61093d44f1b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043078 Mar 08 04:24:50.017720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 399/788] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:50.769310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e654df12-baf0-47e0-9fe9-6322cd096d6b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:50.770812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e654df12-baf0-47e0-9fe9-6322cd096d6b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:50.778406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e654df12-baf0-47e0-9fe9-6322cd096d6b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:50.779121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e654df12-baf0-47e0-9fe9-6322cd096d6b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:50.779895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e654df12-baf0-47e0-9fe9-6322cd096d6b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:50.780329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e654df12-baf0-47e0-9fe9-6322cd096d6b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:50.809318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e654df12-baf0-47e0-9fe9-6322cd096d6b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Mar 08 04:24:50.809885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 390/789] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:50 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:51.024277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8d366afc-fcfa-46b5-b201-987b1701e4d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:51.024888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8d366afc-fcfa-46b5-b201-987b1701e4d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:51.028489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b474b331-4542-44f0-9632-41b8d7c2b121 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:51.029695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b474b331-4542-44f0-9632-41b8d7c2b121 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:51.031949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d366afc-fcfa-46b5-b201-987b1701e4d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:51.032404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d366afc-fcfa-46b5-b201-987b1701e4d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:51.033162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d366afc-fcfa-46b5-b201-987b1701e4d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:51.033593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d366afc-fcfa-46b5-b201-987b1701e4d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:51.035935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b474b331-4542-44f0-9632-41b8d7c2b121 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:51.036386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b474b331-4542-44f0-9632-41b8d7c2b121 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:51.037152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b474b331-4542-44f0-9632-41b8d7c2b121 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:51.037589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b474b331-4542-44f0-9632-41b8d7c2b121 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:51.066535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b474b331-4542-44f0-9632-41b8d7c2b121 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042509 Mar 08 04:24:51.067099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 391/790] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:51.186358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8d366afc-fcfa-46b5-b201-987b1701e4d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:51.195103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8d366afc-fcfa-46b5-b201-987b1701e4d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.174709 Mar 08 04:24:51.195675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 400/791] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:51 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:51.820651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-093ceeef-4dda-461b-9106-ee23f875bbc4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:51.821601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-093ceeef-4dda-461b-9106-ee23f875bbc4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:51.827484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-093ceeef-4dda-461b-9106-ee23f875bbc4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:51.827926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-093ceeef-4dda-461b-9106-ee23f875bbc4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:51.828684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-093ceeef-4dda-461b-9106-ee23f875bbc4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:51.829116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-093ceeef-4dda-461b-9106-ee23f875bbc4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:51.857890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-093ceeef-4dda-461b-9106-ee23f875bbc4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Mar 08 04:24:51.858503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 392/792] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:52.078691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-94ba80f7-09b8-4700-8af2-486f376fdc9e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:52.079558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-94ba80f7-09b8-4700-8af2-486f376fdc9e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:52.085806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94ba80f7-09b8-4700-8af2-486f376fdc9e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:52.086263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94ba80f7-09b8-4700-8af2-486f376fdc9e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:52.087029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94ba80f7-09b8-4700-8af2-486f376fdc9e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:52.087469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94ba80f7-09b8-4700-8af2-486f376fdc9e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:52.114684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-94ba80f7-09b8-4700-8af2-486f376fdc9e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040020 Mar 08 04:24:52.115229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 401/793] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:52.212177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c99b131c-26b0-4f61-bd62-d212e83ee6c1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:52.212807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c99b131c-26b0-4f61-bd62-d212e83ee6c1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:52.218957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c99b131c-26b0-4f61-bd62-d212e83ee6c1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:52.219422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c99b131c-26b0-4f61-bd62-d212e83ee6c1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:52.220158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c99b131c-26b0-4f61-bd62-d212e83ee6c1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:52.220591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c99b131c-26b0-4f61-bd62-d212e83ee6c1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:52.352288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c99b131c-26b0-4f61-bd62-d212e83ee6c1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:52.360053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c99b131c-26b0-4f61-bd62-d212e83ee6c1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151741 Mar 08 04:24:52.360626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 393/794] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:52 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:52.868795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e709c52c-7556-4cec-84d7-ea57bb986646 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:52.869728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e709c52c-7556-4cec-84d7-ea57bb986646 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:52.875519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e709c52c-7556-4cec-84d7-ea57bb986646 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:52.875962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e709c52c-7556-4cec-84d7-ea57bb986646 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:52.876712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e709c52c-7556-4cec-84d7-ea57bb986646 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:52.877141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e709c52c-7556-4cec-84d7-ea57bb986646 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:52.904784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e709c52c-7556-4cec-84d7-ea57bb986646 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039916 Mar 08 04:24:52.905315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 402/795] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:53.126334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a37fca59-672a-4b27-aded-98e5004aa16a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:53.127252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a37fca59-672a-4b27-aded-98e5004aa16a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:53.133056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a37fca59-672a-4b27-aded-98e5004aa16a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:53.133511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a37fca59-672a-4b27-aded-98e5004aa16a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:53.134313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a37fca59-672a-4b27-aded-98e5004aa16a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:53.134791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a37fca59-672a-4b27-aded-98e5004aa16a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:53.162468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a37fca59-672a-4b27-aded-98e5004aa16a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040086 Mar 08 04:24:53.163012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 394/796] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:53.377590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-99359b73-8cab-4b5f-9c87-2088d13b04ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:53.378145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-99359b73-8cab-4b5f-9c87-2088d13b04ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:53.384304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99359b73-8cab-4b5f-9c87-2088d13b04ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:53.385358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99359b73-8cab-4b5f-9c87-2088d13b04ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:53.386138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99359b73-8cab-4b5f-9c87-2088d13b04ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:53.386571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99359b73-8cab-4b5f-9c87-2088d13b04ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:53.517964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-99359b73-8cab-4b5f-9c87-2088d13b04ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:53.525325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-99359b73-8cab-4b5f-9c87-2088d13b04ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151680 Mar 08 04:24:53.525930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 403/797] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:53 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:53.916893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ba0c603f-1842-4b44-a8d8-3df83f8f0224 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:53.917861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ba0c603f-1842-4b44-a8d8-3df83f8f0224 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:53.924336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba0c603f-1842-4b44-a8d8-3df83f8f0224 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:53.924801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba0c603f-1842-4b44-a8d8-3df83f8f0224 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:53.925573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba0c603f-1842-4b44-a8d8-3df83f8f0224 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:53.926039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba0c603f-1842-4b44-a8d8-3df83f8f0224 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:53.954187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ba0c603f-1842-4b44-a8d8-3df83f8f0224 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 Mar 08 04:24:53.954742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 395/798] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:54.173914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4606ff42-2ee6-454b-bc08-358406387460 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:54.174873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4606ff42-2ee6-454b-bc08-358406387460 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:54.180683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4606ff42-2ee6-454b-bc08-358406387460 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:54.181130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4606ff42-2ee6-454b-bc08-358406387460 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:54.182554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4606ff42-2ee6-454b-bc08-358406387460 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:54.182982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4606ff42-2ee6-454b-bc08-358406387460 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:54.210597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4606ff42-2ee6-454b-bc08-358406387460 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040716 Mar 08 04:24:54.211137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 404/799] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:54.542924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7e8ca548-1229-4508-a4d9-833d72c10388 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:54.543451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7e8ca548-1229-4508-a4d9-833d72c10388 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:54.549264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8ca548-1229-4508-a4d9-833d72c10388 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:54.549742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8ca548-1229-4508-a4d9-833d72c10388 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:54.550504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8ca548-1229-4508-a4d9-833d72c10388 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:54.550939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8ca548-1229-4508-a4d9-833d72c10388 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:54.682687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7e8ca548-1229-4508-a4d9-833d72c10388 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:54.690097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7e8ca548-1229-4508-a4d9-833d72c10388 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151616 Mar 08 04:24:54.690662 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 396/800] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:54 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:54.966193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-93ed2f5c-88e4-4eba-b5a3-21c90b964fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:54.967099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-93ed2f5c-88e4-4eba-b5a3-21c90b964fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:54.973274 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-93ed2f5c-88e4-4eba-b5a3-21c90b964fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:54.973737 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-93ed2f5c-88e4-4eba-b5a3-21c90b964fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:54.974494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-93ed2f5c-88e4-4eba-b5a3-21c90b964fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:54.974919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-93ed2f5c-88e4-4eba-b5a3-21c90b964fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:55.003098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-93ed2f5c-88e4-4eba-b5a3-21c90b964fc0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Mar 08 04:24:55.003633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 405/801] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:54 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:55.222071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2e4436bc-94c3-4220-a972-f7508bcb7061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:55.222978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2e4436bc-94c3-4220-a972-f7508bcb7061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:55.230026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e4436bc-94c3-4220-a972-f7508bcb7061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:55.230473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e4436bc-94c3-4220-a972-f7508bcb7061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:55.231237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e4436bc-94c3-4220-a972-f7508bcb7061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:55.231672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e4436bc-94c3-4220-a972-f7508bcb7061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:55.260443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2e4436bc-94c3-4220-a972-f7508bcb7061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042390 Mar 08 04:24:55.260980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 397/802] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:55.706248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d1fcd9eb-3ed8-4c60-850f-e96daed2b231 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:55.706848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d1fcd9eb-3ed8-4c60-850f-e96daed2b231 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:55.714911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1fcd9eb-3ed8-4c60-850f-e96daed2b231 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:55.715379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1fcd9eb-3ed8-4c60-850f-e96daed2b231 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:55.716145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1fcd9eb-3ed8-4c60-850f-e96daed2b231 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:55.716575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1fcd9eb-3ed8-4c60-850f-e96daed2b231 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:55.850651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d1fcd9eb-3ed8-4c60-850f-e96daed2b231 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:55.858676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d1fcd9eb-3ed8-4c60-850f-e96daed2b231 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156214 Mar 08 04:24:55.859251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 406/803] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:55 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:56.015090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-06b07d08-8bc8-4859-a421-c3ecbfb984fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:56.015916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-06b07d08-8bc8-4859-a421-c3ecbfb984fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:56.021702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06b07d08-8bc8-4859-a421-c3ecbfb984fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:56.022148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06b07d08-8bc8-4859-a421-c3ecbfb984fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:56.022902 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06b07d08-8bc8-4859-a421-c3ecbfb984fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:56.023332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06b07d08-8bc8-4859-a421-c3ecbfb984fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:56.053101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-06b07d08-8bc8-4859-a421-c3ecbfb984fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Mar 08 04:24:56.053865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 398/804] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:56.272061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-19780b83-7b72-4f15-a44c-63bfebbf0ca3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:56.272914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-19780b83-7b72-4f15-a44c-63bfebbf0ca3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:56.280101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-19780b83-7b72-4f15-a44c-63bfebbf0ca3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:56.280545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-19780b83-7b72-4f15-a44c-63bfebbf0ca3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:56.281294 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-19780b83-7b72-4f15-a44c-63bfebbf0ca3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:56.281752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-19780b83-7b72-4f15-a44c-63bfebbf0ca3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:56.309135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-19780b83-7b72-4f15-a44c-63bfebbf0ca3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041089 Mar 08 04:24:56.309667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 407/805] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:56.875963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-17784313-162b-496e-9992-db9adf6b5e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:56.876629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-17784313-162b-496e-9992-db9adf6b5e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:56.882927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-17784313-162b-496e-9992-db9adf6b5e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:56.883385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-17784313-162b-496e-9992-db9adf6b5e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:56.884155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-17784313-162b-496e-9992-db9adf6b5e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:56.884618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-17784313-162b-496e-9992-db9adf6b5e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:57.014747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-17784313-162b-496e-9992-db9adf6b5e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:57.021901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-17784313-162b-496e-9992-db9adf6b5e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149848 Mar 08 04:24:57.022459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 399/806] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:56 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:57.064345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-61257348-c7b3-4ea9-ae5b-f943c7322382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:57.065260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-61257348-c7b3-4ea9-ae5b-f943c7322382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:57.071098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61257348-c7b3-4ea9-ae5b-f943c7322382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:57.071557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61257348-c7b3-4ea9-ae5b-f943c7322382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:57.072471 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61257348-c7b3-4ea9-ae5b-f943c7322382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:57.072913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61257348-c7b3-4ea9-ae5b-f943c7322382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:57.102015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-61257348-c7b3-4ea9-ae5b-f943c7322382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Mar 08 04:24:57.102796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 408/807] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:57.319785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-06562e0e-4a68-405e-a5ca-ba633f008b64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:57.320697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-06562e0e-4a68-405e-a5ca-ba633f008b64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:57.326593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06562e0e-4a68-405e-a5ca-ba633f008b64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:57.327042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06562e0e-4a68-405e-a5ca-ba633f008b64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:57.327805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06562e0e-4a68-405e-a5ca-ba633f008b64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:57.328240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06562e0e-4a68-405e-a5ca-ba633f008b64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:57.356966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-06562e0e-4a68-405e-a5ca-ba633f008b64 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 Mar 08 04:24:57.357440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 400/808] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:58.038988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f0b4d319-e5ea-487c-8430-88009d8fd1bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:58.039606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f0b4d319-e5ea-487c-8430-88009d8fd1bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:58.045802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0b4d319-e5ea-487c-8430-88009d8fd1bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:58.046244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0b4d319-e5ea-487c-8430-88009d8fd1bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:58.046997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0b4d319-e5ea-487c-8430-88009d8fd1bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:58.047427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0b4d319-e5ea-487c-8430-88009d8fd1bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:58.115689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f63bd6a3-0603-47d6-bea4-32904d6fac2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:58.116630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f63bd6a3-0603-47d6-bea4-32904d6fac2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:58.123509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f63bd6a3-0603-47d6-bea4-32904d6fac2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:58.123951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f63bd6a3-0603-47d6-bea4-32904d6fac2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:58.124709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f63bd6a3-0603-47d6-bea4-32904d6fac2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:58.125139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f63bd6a3-0603-47d6-bea4-32904d6fac2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:58.155101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f63bd6a3-0603-47d6-bea4-32904d6fac2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 Mar 08 04:24:58.155665 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 401/809] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:24:58.184869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f0b4d319-e5ea-487c-8430-88009d8fd1bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:58.192183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f0b4d319-e5ea-487c-8430-88009d8fd1bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157038 Mar 08 04:24:58.192740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 409/810] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:58 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:24:58.367954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c6b3beea-a7d3-4613-bf1b-d76a5f1f5462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:58.368822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c6b3beea-a7d3-4613-bf1b-d76a5f1f5462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:58.374672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6b3beea-a7d3-4613-bf1b-d76a5f1f5462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:58.375126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6b3beea-a7d3-4613-bf1b-d76a5f1f5462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:58.375893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6b3beea-a7d3-4613-bf1b-d76a5f1f5462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:58.376330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6b3beea-a7d3-4613-bf1b-d76a5f1f5462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:58.405012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c6b3beea-a7d3-4613-bf1b-d76a5f1f5462 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041059 Mar 08 04:24:58.405556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 402/811] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:59.166781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d2dd4cc4-b545-4553-8cf2-909721d71d75 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:59.167720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d2dd4cc4-b545-4553-8cf2-909721d71d75 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:59.173955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2dd4cc4-b545-4553-8cf2-909721d71d75 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:59.174423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2dd4cc4-b545-4553-8cf2-909721d71d75 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:59.175163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2dd4cc4-b545-4553-8cf2-909721d71d75 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:59.175598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2dd4cc4-b545-4553-8cf2-909721d71d75 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:59.203942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d2dd4cc4-b545-4553-8cf2-909721d71d75 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041658 Mar 08 04:24:59.204480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 410/812] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:24:59.210123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c5bf6501-85aa-4907-87d0-6fe2f785665d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:59.210728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c5bf6501-85aa-4907-87d0-6fe2f785665d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:59.216950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5bf6501-85aa-4907-87d0-6fe2f785665d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:59.217390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5bf6501-85aa-4907-87d0-6fe2f785665d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:59.218171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5bf6501-85aa-4907-87d0-6fe2f785665d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:59.218606 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5bf6501-85aa-4907-87d0-6fe2f785665d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:59.359299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c5bf6501-85aa-4907-87d0-6fe2f785665d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:24:59.366586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c5bf6501-85aa-4907-87d0-6fe2f785665d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.160193 Mar 08 04:24:59.367151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 403/813] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:24:59 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:24:59.417169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-88b68b5a-425b-44b2-b4f3-0d7dba631a9f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:24:59.418036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-88b68b5a-425b-44b2-b4f3-0d7dba631a9f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:24:59.423890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88b68b5a-425b-44b2-b4f3-0d7dba631a9f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:59.424347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88b68b5a-425b-44b2-b4f3-0d7dba631a9f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:59.425116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88b68b5a-425b-44b2-b4f3-0d7dba631a9f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:24:59.425553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88b68b5a-425b-44b2-b4f3-0d7dba631a9f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:24:59.453642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-88b68b5a-425b-44b2-b4f3-0d7dba631a9f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041210 Mar 08 04:24:59.454232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 411/814] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:24:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:00.214850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-605bffd5-be24-4ff3-8956-1c63ff715856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:00.215781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-605bffd5-be24-4ff3-8956-1c63ff715856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:00.221960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-605bffd5-be24-4ff3-8956-1c63ff715856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:00.222403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-605bffd5-be24-4ff3-8956-1c63ff715856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:00.223157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-605bffd5-be24-4ff3-8956-1c63ff715856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:00.223587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-605bffd5-be24-4ff3-8956-1c63ff715856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:00.250742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-605bffd5-be24-4ff3-8956-1c63ff715856 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039859 Mar 08 04:25:00.251281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 404/815] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:00.382711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-73a1b434-7201-4dd8-9c6f-4d2d17555b87 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:00.383315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-73a1b434-7201-4dd8-9c6f-4d2d17555b87 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:00.390101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-73a1b434-7201-4dd8-9c6f-4d2d17555b87 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:00.390544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-73a1b434-7201-4dd8-9c6f-4d2d17555b87 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:00.391298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-73a1b434-7201-4dd8-9c6f-4d2d17555b87 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:00.391728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-73a1b434-7201-4dd8-9c6f-4d2d17555b87 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:00.465581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e2788170-c198-423a-a046-d781ece6b271 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:00.466486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e2788170-c198-423a-a046-d781ece6b271 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:00.472194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2788170-c198-423a-a046-d781ece6b271 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:00.472642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2788170-c198-423a-a046-d781ece6b271 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:00.473408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2788170-c198-423a-a046-d781ece6b271 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:00.473877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2788170-c198-423a-a046-d781ece6b271 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:00.503867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e2788170-c198-423a-a046-d781ece6b271 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042504 Mar 08 04:25:00.504440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 405/816] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:00.524336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-73a1b434-7201-4dd8-9c6f-4d2d17555b87 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:00.532161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-73a1b434-7201-4dd8-9c6f-4d2d17555b87 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153322 Mar 08 04:25:00.532722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 412/817] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:00 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:01.262825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f5c2f563-6c2a-431b-9a60-cd83853f6889 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:01.263991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f5c2f563-6c2a-431b-9a60-cd83853f6889 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:01.270199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c2f563-6c2a-431b-9a60-cd83853f6889 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:01.270734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c2f563-6c2a-431b-9a60-cd83853f6889 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:01.271686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c2f563-6c2a-431b-9a60-cd83853f6889 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:01.272119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c2f563-6c2a-431b-9a60-cd83853f6889 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:01.301819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f5c2f563-6c2a-431b-9a60-cd83853f6889 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Mar 08 04:25:01.302389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 406/818] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:01.515904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c2888575-4960-4852-af8c-873d6a3dfe68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:01.516814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c2888575-4960-4852-af8c-873d6a3dfe68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:01.523164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2888575-4960-4852-af8c-873d6a3dfe68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:01.523722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2888575-4960-4852-af8c-873d6a3dfe68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:01.524375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2888575-4960-4852-af8c-873d6a3dfe68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:01.525598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2888575-4960-4852-af8c-873d6a3dfe68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:01.549929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-88c97823-565f-40c3-952a-2cfa1c8e4dd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:01.550561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-88c97823-565f-40c3-952a-2cfa1c8e4dd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:01.554895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c2888575-4960-4852-af8c-873d6a3dfe68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042865 Mar 08 04:25:01.559363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 413/819] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:01 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:01.559525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88c97823-565f-40c3-952a-2cfa1c8e4dd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:01.559525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88c97823-565f-40c3-952a-2cfa1c8e4dd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:01.559525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88c97823-565f-40c3-952a-2cfa1c8e4dd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:01.559525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88c97823-565f-40c3-952a-2cfa1c8e4dd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:01.713317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-88c97823-565f-40c3-952a-2cfa1c8e4dd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:01.721416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-88c97823-565f-40c3-952a-2cfa1c8e4dd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.175413 Mar 08 04:25:01.722197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 407/820] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:01 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:25:02.313275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8bdc77ed-6429-4cc2-903f-e1a2a1164d87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:02.314156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8bdc77ed-6429-4cc2-903f-e1a2a1164d87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:02.320253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8bdc77ed-6429-4cc2-903f-e1a2a1164d87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:02.320797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8bdc77ed-6429-4cc2-903f-e1a2a1164d87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:02.321563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8bdc77ed-6429-4cc2-903f-e1a2a1164d87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:02.322037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8bdc77ed-6429-4cc2-903f-e1a2a1164d87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:02.351326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8bdc77ed-6429-4cc2-903f-e1a2a1164d87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042043 Mar 08 04:25:02.351889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 414/821] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:02.567529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-eceef7c8-1581-42a6-ba5f-91d2a72f10d0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:02.569003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-eceef7c8-1581-42a6-ba5f-91d2a72f10d0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:02.575703 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eceef7c8-1581-42a6-ba5f-91d2a72f10d0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:02.576143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eceef7c8-1581-42a6-ba5f-91d2a72f10d0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:02.576914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eceef7c8-1581-42a6-ba5f-91d2a72f10d0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:02.577353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eceef7c8-1581-42a6-ba5f-91d2a72f10d0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:02.605957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-eceef7c8-1581-42a6-ba5f-91d2a72f10d0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 Mar 08 04:25:02.606507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 408/822] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:02.738498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7a59929d-1ff8-46ee-9058-ea433b69449b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:02.739111 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7a59929d-1ff8-46ee-9058-ea433b69449b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:02.745773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a59929d-1ff8-46ee-9058-ea433b69449b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:02.746229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a59929d-1ff8-46ee-9058-ea433b69449b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:02.747003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a59929d-1ff8-46ee-9058-ea433b69449b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:02.747442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a59929d-1ff8-46ee-9058-ea433b69449b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:02.882672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7a59929d-1ff8-46ee-9058-ea433b69449b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:02.890633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7a59929d-1ff8-46ee-9058-ea433b69449b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155975 Mar 08 04:25:02.891186 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 415/823] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:02 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:03.364954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-122dd518-915d-40ce-ab03-5fa5fa496499 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:03.365899 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-122dd518-915d-40ce-ab03-5fa5fa496499 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:03.372307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-122dd518-915d-40ce-ab03-5fa5fa496499 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:03.372763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-122dd518-915d-40ce-ab03-5fa5fa496499 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:03.373530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-122dd518-915d-40ce-ab03-5fa5fa496499 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:03.373988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-122dd518-915d-40ce-ab03-5fa5fa496499 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:03.401765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-122dd518-915d-40ce-ab03-5fa5fa496499 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040898 Mar 08 04:25:03.402300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 409/824] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:03.617399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-191e0841-36bc-4732-9567-9dd8c7bd543e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:03.618257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-191e0841-36bc-4732-9567-9dd8c7bd543e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:03.625183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-191e0841-36bc-4732-9567-9dd8c7bd543e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:03.625639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-191e0841-36bc-4732-9567-9dd8c7bd543e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:03.626434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-191e0841-36bc-4732-9567-9dd8c7bd543e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:03.626874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-191e0841-36bc-4732-9567-9dd8c7bd543e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:03.655032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-191e0841-36bc-4732-9567-9dd8c7bd543e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041705 Mar 08 04:25:03.655577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 416/825] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:03.907882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e5bd5e9e-1e12-4e7b-b146-291caca32be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:03.908412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e5bd5e9e-1e12-4e7b-b146-291caca32be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:03.914640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e5bd5e9e-1e12-4e7b-b146-291caca32be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:03.915086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e5bd5e9e-1e12-4e7b-b146-291caca32be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:03.915845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e5bd5e9e-1e12-4e7b-b146-291caca32be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:03.916980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e5bd5e9e-1e12-4e7b-b146-291caca32be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:04.057296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e5bd5e9e-1e12-4e7b-b146-291caca32be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:04.064493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e5bd5e9e-1e12-4e7b-b146-291caca32be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.160781 Mar 08 04:25:04.065082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 410/826] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:03 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:04.412656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9e4b4e2b-14a3-4361-a51b-e30281b6c042 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:04.413562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9e4b4e2b-14a3-4361-a51b-e30281b6c042 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:04.420202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e4b4e2b-14a3-4361-a51b-e30281b6c042 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:04.420655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e4b4e2b-14a3-4361-a51b-e30281b6c042 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:04.421426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e4b4e2b-14a3-4361-a51b-e30281b6c042 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:04.421895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e4b4e2b-14a3-4361-a51b-e30281b6c042 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:04.450107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9e4b4e2b-14a3-4361-a51b-e30281b6c042 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 Mar 08 04:25:04.450660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 417/827] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:04.666871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f1626089-3d05-4801-a4bd-fdfa0344cb05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:04.667698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f1626089-3d05-4801-a4bd-fdfa0344cb05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:04.673535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1626089-3d05-4801-a4bd-fdfa0344cb05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:04.674022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1626089-3d05-4801-a4bd-fdfa0344cb05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:04.674781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1626089-3d05-4801-a4bd-fdfa0344cb05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:04.675214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1626089-3d05-4801-a4bd-fdfa0344cb05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:04.703513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f1626089-3d05-4801-a4bd-fdfa0344cb05 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040719 Mar 08 04:25:04.704049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 411/828] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:05.081690 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4270cddb-c15e-4828-8923-d88d6bac40ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:05.082242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4270cddb-c15e-4828-8923-d88d6bac40ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:05.088017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4270cddb-c15e-4828-8923-d88d6bac40ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:05.088464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4270cddb-c15e-4828-8923-d88d6bac40ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:05.089217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4270cddb-c15e-4828-8923-d88d6bac40ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:05.089645 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4270cddb-c15e-4828-8923-d88d6bac40ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:05.235315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4270cddb-c15e-4828-8923-d88d6bac40ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:05.242502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4270cddb-c15e-4828-8923-d88d6bac40ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.164728 Mar 08 04:25:05.243057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 418/829] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:05.461490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8125b876-2dc9-46c3-bdb1-9bd5b573659d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:05.462453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8125b876-2dc9-46c3-bdb1-9bd5b573659d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:05.469263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8125b876-2dc9-46c3-bdb1-9bd5b573659d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:05.469745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8125b876-2dc9-46c3-bdb1-9bd5b573659d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:05.470511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8125b876-2dc9-46c3-bdb1-9bd5b573659d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:05.470946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8125b876-2dc9-46c3-bdb1-9bd5b573659d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:05.498720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8125b876-2dc9-46c3-bdb1-9bd5b573659d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041250 Mar 08 04:25:05.499260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 412/830] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:05.716332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-db0e7739-8f41-44c5-b171-8fe4c5e1fc00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:05.717182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-db0e7739-8f41-44c5-b171-8fe4c5e1fc00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:05.723092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db0e7739-8f41-44c5-b171-8fe4c5e1fc00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:05.723543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db0e7739-8f41-44c5-b171-8fe4c5e1fc00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:05.724315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db0e7739-8f41-44c5-b171-8fe4c5e1fc00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:05.724754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db0e7739-8f41-44c5-b171-8fe4c5e1fc00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:05.754253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-db0e7739-8f41-44c5-b171-8fe4c5e1fc00 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Mar 08 04:25:05.755217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 419/831] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:06.260674 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0aabc2fa-06f8-47ff-b7f5-e3225f4be878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:06.261306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0aabc2fa-06f8-47ff-b7f5-e3225f4be878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:06.267147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aabc2fa-06f8-47ff-b7f5-e3225f4be878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:06.267595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aabc2fa-06f8-47ff-b7f5-e3225f4be878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:06.268354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aabc2fa-06f8-47ff-b7f5-e3225f4be878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:06.268788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aabc2fa-06f8-47ff-b7f5-e3225f4be878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:06.404450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0aabc2fa-06f8-47ff-b7f5-e3225f4be878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:06.411628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0aabc2fa-06f8-47ff-b7f5-e3225f4be878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155503 Mar 08 04:25:06.412191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 413/832] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:06.510420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-27e8168f-38d7-401b-88b3-75079954644e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:06.511478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-27e8168f-38d7-401b-88b3-75079954644e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:06.517357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27e8168f-38d7-401b-88b3-75079954644e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:06.517847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27e8168f-38d7-401b-88b3-75079954644e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:06.518625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27e8168f-38d7-401b-88b3-75079954644e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:06.519068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27e8168f-38d7-401b-88b3-75079954644e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:06.547417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-27e8168f-38d7-401b-88b3-75079954644e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041208 Mar 08 04:25:06.547969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 420/833] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:06.766378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6739d569-d797-481d-91f7-561427d42ab9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:06.767177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6739d569-d797-481d-91f7-561427d42ab9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:06.773414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6739d569-d797-481d-91f7-561427d42ab9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:06.773914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6739d569-d797-481d-91f7-561427d42ab9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:06.774684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6739d569-d797-481d-91f7-561427d42ab9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:06.775128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6739d569-d797-481d-91f7-561427d42ab9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:06.803251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6739d569-d797-481d-91f7-561427d42ab9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040927 Mar 08 04:25:06.803797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 414/834] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:07.429494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e62a9e18-e858-4321-b860-65b84eea1556 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:07.430120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e62a9e18-e858-4321-b860-65b84eea1556 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:07.436976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e62a9e18-e858-4321-b860-65b84eea1556 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:07.437421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e62a9e18-e858-4321-b860-65b84eea1556 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:07.438198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e62a9e18-e858-4321-b860-65b84eea1556 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:07.438636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e62a9e18-e858-4321-b860-65b84eea1556 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:07.559580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a3ffd80e-0b37-4e83-8e67-ee388dec76aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:07.560491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a3ffd80e-0b37-4e83-8e67-ee388dec76aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:07.566242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3ffd80e-0b37-4e83-8e67-ee388dec76aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:07.566680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3ffd80e-0b37-4e83-8e67-ee388dec76aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:07.567584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3ffd80e-0b37-4e83-8e67-ee388dec76aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:07.567890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3ffd80e-0b37-4e83-8e67-ee388dec76aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:07.570330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e62a9e18-e858-4321-b860-65b84eea1556 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:07.577732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e62a9e18-e858-4321-b860-65b84eea1556 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152016 Mar 08 04:25:07.578600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 421/835] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:25:07.596447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a3ffd80e-0b37-4e83-8e67-ee388dec76aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041534 Mar 08 04:25:07.596997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 415/836] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:07.815843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-417550ba-fa6b-43d1-bd49-5347bc4c9ee5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:07.816794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-417550ba-fa6b-43d1-bd49-5347bc4c9ee5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:07.822813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-417550ba-fa6b-43d1-bd49-5347bc4c9ee5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:07.823252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-417550ba-fa6b-43d1-bd49-5347bc4c9ee5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:07.824021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-417550ba-fa6b-43d1-bd49-5347bc4c9ee5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:07.824448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-417550ba-fa6b-43d1-bd49-5347bc4c9ee5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:07.852157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-417550ba-fa6b-43d1-bd49-5347bc4c9ee5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040433 Mar 08 04:25:07.852724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 422/837] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:08.595473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-24d57f4a-3140-420a-8aa7-346f138eb0ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:08.596230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-24d57f4a-3140-420a-8aa7-346f138eb0ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:08.603745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24d57f4a-3140-420a-8aa7-346f138eb0ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:08.604297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24d57f4a-3140-420a-8aa7-346f138eb0ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:08.605064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24d57f4a-3140-420a-8aa7-346f138eb0ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:08.605609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24d57f4a-3140-420a-8aa7-346f138eb0ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:08.608111 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0ca78045-7c90-41f9-b51f-7ad9f60516b1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:08.609017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0ca78045-7c90-41f9-b51f-7ad9f60516b1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:08.615139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ca78045-7c90-41f9-b51f-7ad9f60516b1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:08.615586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ca78045-7c90-41f9-b51f-7ad9f60516b1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:08.616344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ca78045-7c90-41f9-b51f-7ad9f60516b1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:08.616781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ca78045-7c90-41f9-b51f-7ad9f60516b1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:08.645679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0ca78045-7c90-41f9-b51f-7ad9f60516b1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 Mar 08 04:25:08.646256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 423/838] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:08.738844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-24d57f4a-3140-420a-8aa7-346f138eb0ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:08.747004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-24d57f4a-3140-420a-8aa7-346f138eb0ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156427 Mar 08 04:25:08.747569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 416/839] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:08 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:08.864491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-576f41b1-4057-464f-adc4-c7c9c3510f1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:08.865407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-576f41b1-4057-464f-adc4-c7c9c3510f1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:08.872117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-576f41b1-4057-464f-adc4-c7c9c3510f1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:08.872760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-576f41b1-4057-464f-adc4-c7c9c3510f1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:08.873532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-576f41b1-4057-464f-adc4-c7c9c3510f1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:08.874004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-576f41b1-4057-464f-adc4-c7c9c3510f1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:08.901547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-576f41b1-4057-464f-adc4-c7c9c3510f1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041045 Mar 08 04:25:08.902120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 424/840] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:09.657876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-eb47f27e-8551-4232-b967-74c0acc5159d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:09.658790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-eb47f27e-8551-4232-b967-74c0acc5159d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:09.664999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb47f27e-8551-4232-b967-74c0acc5159d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:09.665444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb47f27e-8551-4232-b967-74c0acc5159d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:09.666231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb47f27e-8551-4232-b967-74c0acc5159d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:09.666737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb47f27e-8551-4232-b967-74c0acc5159d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:09.694778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-eb47f27e-8551-4232-b967-74c0acc5159d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 Mar 08 04:25:09.695317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 417/841] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:09 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:09.763958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c1de22cd-ab73-41be-9e4f-4ccb21ab2b31 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:09.764563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c1de22cd-ab73-41be-9e4f-4ccb21ab2b31 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:09.770779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1de22cd-ab73-41be-9e4f-4ccb21ab2b31 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:09.771232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1de22cd-ab73-41be-9e4f-4ccb21ab2b31 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:09.772002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1de22cd-ab73-41be-9e4f-4ccb21ab2b31 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:09.772442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1de22cd-ab73-41be-9e4f-4ccb21ab2b31 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:09.907861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c1de22cd-ab73-41be-9e4f-4ccb21ab2b31 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:09.912458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-318abb8d-c289-4531-978a-c0043e9dd208 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:09.913398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-318abb8d-c289-4531-978a-c0043e9dd208 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:09.915157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c1de22cd-ab73-41be-9e4f-4ccb21ab2b31 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155818 Mar 08 04:25:09.915829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 425/842] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:09.919681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-318abb8d-c289-4531-978a-c0043e9dd208 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:09.920129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-318abb8d-c289-4531-978a-c0043e9dd208 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:09.920936 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-318abb8d-c289-4531-978a-c0043e9dd208 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:09.921372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-318abb8d-c289-4531-978a-c0043e9dd208 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:09.950356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-318abb8d-c289-4531-978a-c0043e9dd208 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041795 Mar 08 04:25:09.950906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 418/843] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:10.706627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-278668fd-64cb-4be0-a4b8-5dbd9cf0f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:10.707533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-278668fd-64cb-4be0-a4b8-5dbd9cf0f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:10.713576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-278668fd-64cb-4be0-a4b8-5dbd9cf0f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:10.714063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-278668fd-64cb-4be0-a4b8-5dbd9cf0f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:10.714986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-278668fd-64cb-4be0-a4b8-5dbd9cf0f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:10.715431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-278668fd-64cb-4be0-a4b8-5dbd9cf0f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:10.742842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-278668fd-64cb-4be0-a4b8-5dbd9cf0f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040159 Mar 08 04:25:10.743385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 426/844] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:10.931914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6560054e-000f-4419-845b-1eb7c9bcb7bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:10.933254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6560054e-000f-4419-845b-1eb7c9bcb7bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:10.939313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6560054e-000f-4419-845b-1eb7c9bcb7bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:10.939762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6560054e-000f-4419-845b-1eb7c9bcb7bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:10.940522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6560054e-000f-4419-845b-1eb7c9bcb7bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:10.940959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6560054e-000f-4419-845b-1eb7c9bcb7bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:10.962094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-44ff7b8e-ce4a-4d0a-befb-66f747a21ae3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:10.962913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-44ff7b8e-ce4a-4d0a-befb-66f747a21ae3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:10.969136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-44ff7b8e-ce4a-4d0a-befb-66f747a21ae3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:10.969581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-44ff7b8e-ce4a-4d0a-befb-66f747a21ae3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:10.970369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-44ff7b8e-ce4a-4d0a-befb-66f747a21ae3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:10.970937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-44ff7b8e-ce4a-4d0a-befb-66f747a21ae3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:11.007521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-44ff7b8e-ce4a-4d0a-befb-66f747a21ae3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049449 Mar 08 04:25:11.008326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 427/845] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:11.072934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6560054e-000f-4419-845b-1eb7c9bcb7bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:11.080236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6560054e-000f-4419-845b-1eb7c9bcb7bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152191 Mar 08 04:25:11.080826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 419/846] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:10 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:11.755059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b45c8492-636e-48e3-b54f-64cdaff1e19d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:11.756161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b45c8492-636e-48e3-b54f-64cdaff1e19d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:11.763196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b45c8492-636e-48e3-b54f-64cdaff1e19d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:11.763648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b45c8492-636e-48e3-b54f-64cdaff1e19d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:11.764417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b45c8492-636e-48e3-b54f-64cdaff1e19d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:11.764853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b45c8492-636e-48e3-b54f-64cdaff1e19d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:11.792902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b45c8492-636e-48e3-b54f-64cdaff1e19d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041821 Mar 08 04:25:11.793446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 428/847] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:12.020737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9ddb9eab-3b23-4793-b1da-ad3f50ccf433 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:12.021642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9ddb9eab-3b23-4793-b1da-ad3f50ccf433 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:12.028832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9ddb9eab-3b23-4793-b1da-ad3f50ccf433 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:12.029281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9ddb9eab-3b23-4793-b1da-ad3f50ccf433 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:12.030070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9ddb9eab-3b23-4793-b1da-ad3f50ccf433 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:12.030507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9ddb9eab-3b23-4793-b1da-ad3f50ccf433 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:12.058202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9ddb9eab-3b23-4793-b1da-ad3f50ccf433 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041376 Mar 08 04:25:12.058777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 420/848] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:12.097197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ade8e34c-656f-4d10-b98e-8b5ecb96b3ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:12.097858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ade8e34c-656f-4d10-b98e-8b5ecb96b3ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:12.104153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ade8e34c-656f-4d10-b98e-8b5ecb96b3ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:12.104535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ade8e34c-656f-4d10-b98e-8b5ecb96b3ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:12.105283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ade8e34c-656f-4d10-b98e-8b5ecb96b3ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:12.105743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ade8e34c-656f-4d10-b98e-8b5ecb96b3ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:12.239000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ade8e34c-656f-4d10-b98e-8b5ecb96b3ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:12.246942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ade8e34c-656f-4d10-b98e-8b5ecb96b3ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153518 Mar 08 04:25:12.247504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 429/849] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:12 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:12.804050 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0772e2a4-e895-4548-afce-5dbe0666ae7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:12.804951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0772e2a4-e895-4548-afce-5dbe0666ae7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:12.810996 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0772e2a4-e895-4548-afce-5dbe0666ae7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:12.811446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0772e2a4-e895-4548-afce-5dbe0666ae7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:12.812210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0772e2a4-e895-4548-afce-5dbe0666ae7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:12.812649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0772e2a4-e895-4548-afce-5dbe0666ae7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:12.841397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0772e2a4-e895-4548-afce-5dbe0666ae7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 Mar 08 04:25:12.842059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 421/850] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:13.068931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9e013704-7d6f-4cca-b52a-a2862b40c5cb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:13.069785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9e013704-7d6f-4cca-b52a-a2862b40c5cb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:13.075840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e013704-7d6f-4cca-b52a-a2862b40c5cb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:13.076280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e013704-7d6f-4cca-b52a-a2862b40c5cb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:13.077039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e013704-7d6f-4cca-b52a-a2862b40c5cb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:13.077468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e013704-7d6f-4cca-b52a-a2862b40c5cb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:13.105941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9e013704-7d6f-4cca-b52a-a2862b40c5cb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041017 Mar 08 04:25:13.106544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 430/851] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:13.264731 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e9866557-c2d1-4abb-9387-255062c8c28d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:13.265331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e9866557-c2d1-4abb-9387-255062c8c28d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:13.272010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9866557-c2d1-4abb-9387-255062c8c28d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:13.272451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9866557-c2d1-4abb-9387-255062c8c28d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:13.273206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9866557-c2d1-4abb-9387-255062c8c28d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:13.273637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9866557-c2d1-4abb-9387-255062c8c28d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:13.403995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e9866557-c2d1-4abb-9387-255062c8c28d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:13.411197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e9866557-c2d1-4abb-9387-255062c8c28d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151344 Mar 08 04:25:13.411756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 422/852] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:13 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:13.852976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b2fad192-ca65-4a2f-862f-444fab48f6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:13.854209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b2fad192-ca65-4a2f-862f-444fab48f6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:13.859893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2fad192-ca65-4a2f-862f-444fab48f6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:13.860339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2fad192-ca65-4a2f-862f-444fab48f6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:13.861120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2fad192-ca65-4a2f-862f-444fab48f6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:13.861546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2fad192-ca65-4a2f-862f-444fab48f6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:13.890014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b2fad192-ca65-4a2f-862f-444fab48f6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040983 Mar 08 04:25:13.890559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 431/853] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:14.117626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-52969cc7-7c2f-44f9-b3e9-6b999dc7340e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:14.118479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-52969cc7-7c2f-44f9-b3e9-6b999dc7340e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:14.124919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52969cc7-7c2f-44f9-b3e9-6b999dc7340e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:14.125389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52969cc7-7c2f-44f9-b3e9-6b999dc7340e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:14.126171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52969cc7-7c2f-44f9-b3e9-6b999dc7340e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:14.126610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52969cc7-7c2f-44f9-b3e9-6b999dc7340e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:14.153598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-52969cc7-7c2f-44f9-b3e9-6b999dc7340e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039685 Mar 08 04:25:14.154159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 423/854] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:14.428228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d451abd2-bcd7-408c-885d-e032c18b16cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:14.428831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d451abd2-bcd7-408c-885d-e032c18b16cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:14.435125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d451abd2-bcd7-408c-885d-e032c18b16cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:14.435574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d451abd2-bcd7-408c-885d-e032c18b16cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:14.436333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d451abd2-bcd7-408c-885d-e032c18b16cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:14.436763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d451abd2-bcd7-408c-885d-e032c18b16cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:14.575371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d451abd2-bcd7-408c-885d-e032c18b16cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:14.582616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d451abd2-bcd7-408c-885d-e032c18b16cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158252 Mar 08 04:25:14.583173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 432/855] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:14 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:14.902135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6bc70eba-a625-4f1c-bd5b-d5e46f5c80ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:14.903045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6bc70eba-a625-4f1c-bd5b-d5e46f5c80ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:14.909506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bc70eba-a625-4f1c-bd5b-d5e46f5c80ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:14.910062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bc70eba-a625-4f1c-bd5b-d5e46f5c80ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:14.910830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bc70eba-a625-4f1c-bd5b-d5e46f5c80ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:14.911265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bc70eba-a625-4f1c-bd5b-d5e46f5c80ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:14.938311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6bc70eba-a625-4f1c-bd5b-d5e46f5c80ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040889 Mar 08 04:25:14.938851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 424/856] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:15.165084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c61de169-2bb8-4f11-81b1-ae85b44f61a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:15.166099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c61de169-2bb8-4f11-81b1-ae85b44f61a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:15.172026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c61de169-2bb8-4f11-81b1-ae85b44f61a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:15.172473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c61de169-2bb8-4f11-81b1-ae85b44f61a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:15.173233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c61de169-2bb8-4f11-81b1-ae85b44f61a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:15.173685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c61de169-2bb8-4f11-81b1-ae85b44f61a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:15.202082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c61de169-2bb8-4f11-81b1-ae85b44f61a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040801 Mar 08 04:25:15.202626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 433/857] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:15.600417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-14caad48-615a-4001-a9eb-df427b42ef9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:15.600934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-14caad48-615a-4001-a9eb-df427b42ef9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:15.606945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14caad48-615a-4001-a9eb-df427b42ef9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:15.607391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14caad48-615a-4001-a9eb-df427b42ef9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:15.608158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14caad48-615a-4001-a9eb-df427b42ef9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:15.608593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14caad48-615a-4001-a9eb-df427b42ef9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:15.744364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-14caad48-615a-4001-a9eb-df427b42ef9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:15.752372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-14caad48-615a-4001-a9eb-df427b42ef9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155894 Mar 08 04:25:15.752933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 425/858] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:15 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:25:15.949614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-249a0289-8641-4ad2-a575-f20e46197f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:15.950551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-249a0289-8641-4ad2-a575-f20e46197f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:15.956817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-249a0289-8641-4ad2-a575-f20e46197f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:15.957257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-249a0289-8641-4ad2-a575-f20e46197f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:15.958044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-249a0289-8641-4ad2-a575-f20e46197f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:15.958472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-249a0289-8641-4ad2-a575-f20e46197f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:15.985379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-249a0289-8641-4ad2-a575-f20e46197f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040487 Mar 08 04:25:15.985933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 434/859] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:16.213520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-29998685-5ac6-4220-8984-9701b92b27e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:16.214527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-29998685-5ac6-4220-8984-9701b92b27e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:16.220877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29998685-5ac6-4220-8984-9701b92b27e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:16.221330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29998685-5ac6-4220-8984-9701b92b27e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:16.222129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29998685-5ac6-4220-8984-9701b92b27e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:16.222571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29998685-5ac6-4220-8984-9701b92b27e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:16.250952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-29998685-5ac6-4220-8984-9701b92b27e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041425 Mar 08 04:25:16.251493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 426/860] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:16.771174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-512adf1b-2aa0-42b4-9a73-a747ebf237ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:16.771778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-512adf1b-2aa0-42b4-9a73-a747ebf237ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:16.778749 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-512adf1b-2aa0-42b4-9a73-a747ebf237ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:16.779187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-512adf1b-2aa0-42b4-9a73-a747ebf237ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:16.779944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-512adf1b-2aa0-42b4-9a73-a747ebf237ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:16.780373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-512adf1b-2aa0-42b4-9a73-a747ebf237ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:16.912535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-512adf1b-2aa0-42b4-9a73-a747ebf237ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:16.920394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-512adf1b-2aa0-42b4-9a73-a747ebf237ea tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153130 Mar 08 04:25:16.920953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 435/861] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:16.997197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a124b3eb-6b42-4e9d-b581-d577e75e8083 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:16.998122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a124b3eb-6b42-4e9d-b581-d577e75e8083 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:17.004122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a124b3eb-6b42-4e9d-b581-d577e75e8083 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:17.004565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a124b3eb-6b42-4e9d-b581-d577e75e8083 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:17.005325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a124b3eb-6b42-4e9d-b581-d577e75e8083 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:17.006026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a124b3eb-6b42-4e9d-b581-d577e75e8083 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:17.037924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a124b3eb-6b42-4e9d-b581-d577e75e8083 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045025 Mar 08 04:25:17.038406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 427/862] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:16 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:17.262649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-57754972-4b39-41e7-bab5-97beced4adcd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:17.263553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-57754972-4b39-41e7-bab5-97beced4adcd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:17.269830 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-57754972-4b39-41e7-bab5-97beced4adcd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:17.270273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-57754972-4b39-41e7-bab5-97beced4adcd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:17.271034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-57754972-4b39-41e7-bab5-97beced4adcd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:17.271456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-57754972-4b39-41e7-bab5-97beced4adcd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:17.300421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-57754972-4b39-41e7-bab5-97beced4adcd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041874 Mar 08 04:25:17.300880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 436/863] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:17.936534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-737b0c68-9203-493f-86a3-9656835478cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:17.937136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-737b0c68-9203-493f-86a3-9656835478cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:17.943014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-737b0c68-9203-493f-86a3-9656835478cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:17.943451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-737b0c68-9203-493f-86a3-9656835478cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:17.944208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-737b0c68-9203-493f-86a3-9656835478cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:17.944635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-737b0c68-9203-493f-86a3-9656835478cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:18.048438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f1b5f508-b8b1-4b65-8e6a-19f8795b53db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:18.049447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f1b5f508-b8b1-4b65-8e6a-19f8795b53db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:18.055120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1b5f508-b8b1-4b65-8e6a-19f8795b53db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:18.055562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1b5f508-b8b1-4b65-8e6a-19f8795b53db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:18.056320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1b5f508-b8b1-4b65-8e6a-19f8795b53db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:18.056752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1b5f508-b8b1-4b65-8e6a-19f8795b53db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:18.080904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-737b0c68-9203-493f-86a3-9656835478cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:18.087573 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f1b5f508-b8b1-4b65-8e6a-19f8795b53db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043012 Mar 08 04:25:18.088122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 437/864] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:18.088245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-737b0c68-9203-493f-86a3-9656835478cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155580 Mar 08 04:25:18.088703 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 428/865] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:17 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:18.312188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-08349180-e4b1-41ec-9978-cde6fc93bb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:18.313094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-08349180-e4b1-41ec-9978-cde6fc93bb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:18.319344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08349180-e4b1-41ec-9978-cde6fc93bb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:18.319786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08349180-e4b1-41ec-9978-cde6fc93bb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:18.320551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08349180-e4b1-41ec-9978-cde6fc93bb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:18.320981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08349180-e4b1-41ec-9978-cde6fc93bb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:18.355677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-08349180-e4b1-41ec-9978-cde6fc93bb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047529 Mar 08 04:25:18.356235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 438/866] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:19.099165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1a7783c3-c7c3-4727-ad34-30518b56ec8a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:19.100099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1a7783c3-c7c3-4727-ad34-30518b56ec8a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:19.104338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-08c0802c-1fe3-442c-b0d7-d1dadd9a8a24 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:19.105048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-08c0802c-1fe3-442c-b0d7-d1dadd9a8a24 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:19.106441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a7783c3-c7c3-4727-ad34-30518b56ec8a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:19.106963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a7783c3-c7c3-4727-ad34-30518b56ec8a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:19.107736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a7783c3-c7c3-4727-ad34-30518b56ec8a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:19.108175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a7783c3-c7c3-4727-ad34-30518b56ec8a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:19.111323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08c0802c-1fe3-442c-b0d7-d1dadd9a8a24 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:19.111897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08c0802c-1fe3-442c-b0d7-d1dadd9a8a24 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:19.112670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08c0802c-1fe3-442c-b0d7-d1dadd9a8a24 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:19.113102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08c0802c-1fe3-442c-b0d7-d1dadd9a8a24 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:19.135899 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1a7783c3-c7c3-4727-ad34-30518b56ec8a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040716 Mar 08 04:25:19.136451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 429/867] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:19.245331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-08c0802c-1fe3-442c-b0d7-d1dadd9a8a24 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:19.252644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-08c0802c-1fe3-442c-b0d7-d1dadd9a8a24 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152421 Mar 08 04:25:19.253193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 439/868] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:25:19.368936 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fbf96e1a-be55-4dbe-a7ae-56557f9f79af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:19.369804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fbf96e1a-be55-4dbe-a7ae-56557f9f79af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:19.376246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbf96e1a-be55-4dbe-a7ae-56557f9f79af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:19.376702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbf96e1a-be55-4dbe-a7ae-56557f9f79af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:19.377456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbf96e1a-be55-4dbe-a7ae-56557f9f79af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:19.377927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbf96e1a-be55-4dbe-a7ae-56557f9f79af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:19.405528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fbf96e1a-be55-4dbe-a7ae-56557f9f79af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040622 Mar 08 04:25:19.406103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 430/869] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:20.147375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-313342f9-8f67-440b-804d-cf6d869ac27a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:20.148203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-313342f9-8f67-440b-804d-cf6d869ac27a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:20.155407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-313342f9-8f67-440b-804d-cf6d869ac27a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:20.155854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-313342f9-8f67-440b-804d-cf6d869ac27a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:20.156617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-313342f9-8f67-440b-804d-cf6d869ac27a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:20.157048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-313342f9-8f67-440b-804d-cf6d869ac27a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:20.184966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-313342f9-8f67-440b-804d-cf6d869ac27a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041897 Mar 08 04:25:20.185510 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 440/870] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:20 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:20.374327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0fde9bce-d797-4eac-be33-0ee003e46974 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:20.374956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0fde9bce-d797-4eac-be33-0ee003e46974 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:20.380593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0fde9bce-d797-4eac-be33-0ee003e46974 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:20.381029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0fde9bce-d797-4eac-be33-0ee003e46974 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:20.381816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0fde9bce-d797-4eac-be33-0ee003e46974 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:20.382248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0fde9bce-d797-4eac-be33-0ee003e46974 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:20.416345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e67472aa-dd02-49d3-8cc8-a5b80f8d311a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:20.417253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e67472aa-dd02-49d3-8cc8-a5b80f8d311a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:20.423338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e67472aa-dd02-49d3-8cc8-a5b80f8d311a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:20.423786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e67472aa-dd02-49d3-8cc8-a5b80f8d311a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:20.424556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e67472aa-dd02-49d3-8cc8-a5b80f8d311a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:20.424989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e67472aa-dd02-49d3-8cc8-a5b80f8d311a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:20.453862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e67472aa-dd02-49d3-8cc8-a5b80f8d311a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Mar 08 04:25:20.454420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 441/871] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:20.517675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0fde9bce-d797-4eac-be33-0ee003e46974 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:20.524855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0fde9bce-d797-4eac-be33-0ee003e46974 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.258960 Mar 08 04:25:20.525406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 431/872] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:20 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:21.196514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-75d1fbef-526b-46ee-ab68-f63dfa026c15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:21.197423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-75d1fbef-526b-46ee-ab68-f63dfa026c15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:21.203718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75d1fbef-526b-46ee-ab68-f63dfa026c15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:21.204166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75d1fbef-526b-46ee-ab68-f63dfa026c15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:21.204931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75d1fbef-526b-46ee-ab68-f63dfa026c15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:21.205365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75d1fbef-526b-46ee-ab68-f63dfa026c15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:21.233554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-75d1fbef-526b-46ee-ab68-f63dfa026c15 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041071 Mar 08 04:25:21.234122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 442/873] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:21 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:21.465344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4b572a13-a721-4f28-ab3e-ca55321bb38d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:21.466948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4b572a13-a721-4f28-ab3e-ca55321bb38d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:21.477686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4b572a13-a721-4f28-ab3e-ca55321bb38d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:21.478146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4b572a13-a721-4f28-ab3e-ca55321bb38d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:21.478916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4b572a13-a721-4f28-ab3e-ca55321bb38d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:21.479351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4b572a13-a721-4f28-ab3e-ca55321bb38d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:21.506620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4b572a13-a721-4f28-ab3e-ca55321bb38d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Mar 08 04:25:21.507165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 432/874] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:21.542090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1e04731f-4ad6-4ca3-ad24-b2704701cafc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:21.542697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1e04731f-4ad6-4ca3-ad24-b2704701cafc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:21.548482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e04731f-4ad6-4ca3-ad24-b2704701cafc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:21.548930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e04731f-4ad6-4ca3-ad24-b2704701cafc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:21.549707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e04731f-4ad6-4ca3-ad24-b2704701cafc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:21.550147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e04731f-4ad6-4ca3-ad24-b2704701cafc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:21.685844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1e04731f-4ad6-4ca3-ad24-b2704701cafc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:21.693289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1e04731f-4ad6-4ca3-ad24-b2704701cafc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154970 Mar 08 04:25:21.693880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 443/875] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:21 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:22.244972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7e63c1b3-7bcb-4ca5-9d7c-38ea16af7264 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:22.245895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7e63c1b3-7bcb-4ca5-9d7c-38ea16af7264 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:22.252387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e63c1b3-7bcb-4ca5-9d7c-38ea16af7264 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:22.252840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e63c1b3-7bcb-4ca5-9d7c-38ea16af7264 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:22.253587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e63c1b3-7bcb-4ca5-9d7c-38ea16af7264 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:22.254041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e63c1b3-7bcb-4ca5-9d7c-38ea16af7264 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:22.281298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7e63c1b3-7bcb-4ca5-9d7c-38ea16af7264 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040280 Mar 08 04:25:22.281857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 433/876] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:22.518202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-302d4ce9-df3e-48d5-80d4-dae338f552fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:22.519030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-302d4ce9-df3e-48d5-80d4-dae338f552fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:22.525185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-302d4ce9-df3e-48d5-80d4-dae338f552fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:22.525752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-302d4ce9-df3e-48d5-80d4-dae338f552fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:22.526443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-302d4ce9-df3e-48d5-80d4-dae338f552fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:22.526874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-302d4ce9-df3e-48d5-80d4-dae338f552fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:22.555766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-302d4ce9-df3e-48d5-80d4-dae338f552fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041596 Mar 08 04:25:22.556302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 444/877] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:22.711090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5d5e446f-415c-46e1-869e-69497703a6ed tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:22.711762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5d5e446f-415c-46e1-869e-69497703a6ed tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:22.718802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d5e446f-415c-46e1-869e-69497703a6ed tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:22.719256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d5e446f-415c-46e1-869e-69497703a6ed tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:22.720019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d5e446f-415c-46e1-869e-69497703a6ed tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:22.720453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d5e446f-415c-46e1-869e-69497703a6ed tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:22.857096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5d5e446f-415c-46e1-869e-69497703a6ed tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:22.864649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5d5e446f-415c-46e1-869e-69497703a6ed tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157459 Mar 08 04:25:22.865212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 434/878] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:22 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:23.292627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-921be748-1940-4286-bd1d-952880488623 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:23.293537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-921be748-1940-4286-bd1d-952880488623 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:23.299418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-921be748-1940-4286-bd1d-952880488623 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:23.299865 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-921be748-1940-4286-bd1d-952880488623 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:23.300622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-921be748-1940-4286-bd1d-952880488623 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:23.301057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-921be748-1940-4286-bd1d-952880488623 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:23.329304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-921be748-1940-4286-bd1d-952880488623 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040617 Mar 08 04:25:23.329880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 445/879] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:23.567532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ce3e05d0-ce4f-496d-a59f-267c60a00f1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:23.568453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ce3e05d0-ce4f-496d-a59f-267c60a00f1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:23.574314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce3e05d0-ce4f-496d-a59f-267c60a00f1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:23.574768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce3e05d0-ce4f-496d-a59f-267c60a00f1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:23.575537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce3e05d0-ce4f-496d-a59f-267c60a00f1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:23.576669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce3e05d0-ce4f-496d-a59f-267c60a00f1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:23.604005 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ce3e05d0-ce4f-496d-a59f-267c60a00f1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040552 Mar 08 04:25:23.604548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 435/880] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:23.881717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a660ce37-f2f8-4966-afee-5cd1df86ff43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:23.882328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a660ce37-f2f8-4966-afee-5cd1df86ff43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:23.888921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a660ce37-f2f8-4966-afee-5cd1df86ff43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:23.889370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a660ce37-f2f8-4966-afee-5cd1df86ff43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:23.890165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a660ce37-f2f8-4966-afee-5cd1df86ff43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:23.890602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a660ce37-f2f8-4966-afee-5cd1df86ff43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:24.028634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a660ce37-f2f8-4966-afee-5cd1df86ff43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:24.036409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a660ce37-f2f8-4966-afee-5cd1df86ff43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158502 Mar 08 04:25:24.036957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 446/881] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:24.340687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d4fd7e48-222b-461e-b05d-ed67ad8a8250 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:24.342411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d4fd7e48-222b-461e-b05d-ed67ad8a8250 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:24.348587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d4fd7e48-222b-461e-b05d-ed67ad8a8250 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:24.349033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d4fd7e48-222b-461e-b05d-ed67ad8a8250 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:24.349828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d4fd7e48-222b-461e-b05d-ed67ad8a8250 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:24.350264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d4fd7e48-222b-461e-b05d-ed67ad8a8250 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:24.377354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d4fd7e48-222b-461e-b05d-ed67ad8a8250 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040601 Mar 08 04:25:24.377944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 436/882] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:24 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:24.616223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-260a34b5-e9bf-4002-a887-38112430ffd8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:24.617045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-260a34b5-e9bf-4002-a887-38112430ffd8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:24.623434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-260a34b5-e9bf-4002-a887-38112430ffd8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:24.623815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-260a34b5-e9bf-4002-a887-38112430ffd8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:24.624576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-260a34b5-e9bf-4002-a887-38112430ffd8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:24.625005 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-260a34b5-e9bf-4002-a887-38112430ffd8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:24.652537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-260a34b5-e9bf-4002-a887-38112430ffd8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040318 Mar 08 04:25:24.653326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 447/883] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:25.054558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c91a94d8-2882-4114-a41b-d36be074728d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:25.055163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c91a94d8-2882-4114-a41b-d36be074728d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:25.060938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c91a94d8-2882-4114-a41b-d36be074728d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:25.061500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c91a94d8-2882-4114-a41b-d36be074728d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:25.062285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c91a94d8-2882-4114-a41b-d36be074728d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:25.062717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c91a94d8-2882-4114-a41b-d36be074728d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:25.196362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c91a94d8-2882-4114-a41b-d36be074728d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:25.204057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c91a94d8-2882-4114-a41b-d36be074728d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153356 Mar 08 04:25:25.204598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 437/884] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:25.388301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dd3a476c-9b74-41e5-9d52-6a919f007a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:25.389726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dd3a476c-9b74-41e5-9d52-6a919f007a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:25.396261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd3a476c-9b74-41e5-9d52-6a919f007a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:25.396713 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd3a476c-9b74-41e5-9d52-6a919f007a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:25.397475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd3a476c-9b74-41e5-9d52-6a919f007a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:25.397942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd3a476c-9b74-41e5-9d52-6a919f007a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:25.429924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dd3a476c-9b74-41e5-9d52-6a919f007a9b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Mar 08 04:25:25.430480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 448/885] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:25 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:25.664566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d2765a1b-e021-4aa8-ba0b-21ee613663f0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:25.665483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d2765a1b-e021-4aa8-ba0b-21ee613663f0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:25.671960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2765a1b-e021-4aa8-ba0b-21ee613663f0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:25.672399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2765a1b-e021-4aa8-ba0b-21ee613663f0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:25.673162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2765a1b-e021-4aa8-ba0b-21ee613663f0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:25.673600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2765a1b-e021-4aa8-ba0b-21ee613663f0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:25.704061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d2765a1b-e021-4aa8-ba0b-21ee613663f0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043480 Mar 08 04:25:25.704616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 438/886] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:26.221238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-36e2e19e-d07d-4d96-9adf-cc3579d51a6b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:26.222035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-36e2e19e-d07d-4d96-9adf-cc3579d51a6b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:26.228733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36e2e19e-d07d-4d96-9adf-cc3579d51a6b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:26.229194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36e2e19e-d07d-4d96-9adf-cc3579d51a6b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:26.230094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36e2e19e-d07d-4d96-9adf-cc3579d51a6b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:26.230527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36e2e19e-d07d-4d96-9adf-cc3579d51a6b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:26.367922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-36e2e19e-d07d-4d96-9adf-cc3579d51a6b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:26.375233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-36e2e19e-d07d-4d96-9adf-cc3579d51a6b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158520 Mar 08 04:25:26.375791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 449/887] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:26 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:26.440287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fb8d84eb-122b-4990-b893-e830a69655bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:26.441219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fb8d84eb-122b-4990-b893-e830a69655bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:26.446973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb8d84eb-122b-4990-b893-e830a69655bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:26.447421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb8d84eb-122b-4990-b893-e830a69655bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:26.448182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb8d84eb-122b-4990-b893-e830a69655bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:26.448620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb8d84eb-122b-4990-b893-e830a69655bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:26.476495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fb8d84eb-122b-4990-b893-e830a69655bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040009 Mar 08 04:25:26.476974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 439/888] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:26.715563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b1db441a-8d18-43e8-b976-dc3604569e22 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:26.716501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b1db441a-8d18-43e8-b976-dc3604569e22 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:26.722995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1db441a-8d18-43e8-b976-dc3604569e22 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:26.723441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1db441a-8d18-43e8-b976-dc3604569e22 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:26.724205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1db441a-8d18-43e8-b976-dc3604569e22 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:26.724637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1db441a-8d18-43e8-b976-dc3604569e22 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:26.753137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b1db441a-8d18-43e8-b976-dc3604569e22 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041517 Mar 08 04:25:26.753607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 450/889] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:27.392080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8c0251e0-e1e5-427b-a869-385e1a1eafa2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:27.392710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8c0251e0-e1e5-427b-a869-385e1a1eafa2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:27.398922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c0251e0-e1e5-427b-a869-385e1a1eafa2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:27.399364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c0251e0-e1e5-427b-a869-385e1a1eafa2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:27.400119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c0251e0-e1e5-427b-a869-385e1a1eafa2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:27.400551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c0251e0-e1e5-427b-a869-385e1a1eafa2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:27.488454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b3fe3ba6-0be6-448f-96ed-318cff9d6c31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:27.489355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b3fe3ba6-0be6-448f-96ed-318cff9d6c31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:27.495150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3fe3ba6-0be6-448f-96ed-318cff9d6c31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:27.495594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3fe3ba6-0be6-448f-96ed-318cff9d6c31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:27.496353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3fe3ba6-0be6-448f-96ed-318cff9d6c31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:27.496781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3fe3ba6-0be6-448f-96ed-318cff9d6c31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:27.525826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b3fe3ba6-0be6-448f-96ed-318cff9d6c31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041890 Mar 08 04:25:27.526383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 451/890] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:27 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:27.532495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8c0251e0-e1e5-427b-a869-385e1a1eafa2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:27.539930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8c0251e0-e1e5-427b-a869-385e1a1eafa2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151694 Mar 08 04:25:27.540714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 440/891] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:27 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:27.764467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ba55ad07-2579-4497-9b5a-32ea9b0fb016 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:27.765530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ba55ad07-2579-4497-9b5a-32ea9b0fb016 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:27.771794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba55ad07-2579-4497-9b5a-32ea9b0fb016 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:27.772238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba55ad07-2579-4497-9b5a-32ea9b0fb016 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:27.773000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba55ad07-2579-4497-9b5a-32ea9b0fb016 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:27.773434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba55ad07-2579-4497-9b5a-32ea9b0fb016 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:27.802488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ba55ad07-2579-4497-9b5a-32ea9b0fb016 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Mar 08 04:25:27.803028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 452/892] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:28.537553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d808b3a9-1433-4cfd-b70c-1a0d14a998cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:28.538481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d808b3a9-1433-4cfd-b70c-1a0d14a998cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:28.544751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d808b3a9-1433-4cfd-b70c-1a0d14a998cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:28.545192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d808b3a9-1433-4cfd-b70c-1a0d14a998cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:28.546105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d808b3a9-1433-4cfd-b70c-1a0d14a998cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:28.546743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d808b3a9-1433-4cfd-b70c-1a0d14a998cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:28.557479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-81252c44-572f-402f-8b30-4d38b765bdd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:28.558121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-81252c44-572f-402f-8b30-4d38b765bdd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:28.565360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81252c44-572f-402f-8b30-4d38b765bdd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:28.565837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81252c44-572f-402f-8b30-4d38b765bdd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:28.566607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81252c44-572f-402f-8b30-4d38b765bdd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:28.567180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81252c44-572f-402f-8b30-4d38b765bdd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:28.579510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d808b3a9-1433-4cfd-b70c-1a0d14a998cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045875 Mar 08 04:25:28.580070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 441/893] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:28.702066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-81252c44-572f-402f-8b30-4d38b765bdd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:28.710070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-81252c44-572f-402f-8b30-4d38b765bdd9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156385 Mar 08 04:25:28.710622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 453/894] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:28 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:25:28.814881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-db5285cb-e8c7-42e5-8d78-1f9d82faeb6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:28.815710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-db5285cb-e8c7-42e5-8d78-1f9d82faeb6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:28.821703 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-db5285cb-e8c7-42e5-8d78-1f9d82faeb6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:28.822158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-db5285cb-e8c7-42e5-8d78-1f9d82faeb6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:28.822965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-db5285cb-e8c7-42e5-8d78-1f9d82faeb6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:28.823410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-db5285cb-e8c7-42e5-8d78-1f9d82faeb6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:28.851284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-db5285cb-e8c7-42e5-8d78-1f9d82faeb6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041096 Mar 08 04:25:28.851837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 442/895] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:29.591616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-046ea356-43c6-4a94-a9f0-50650adf1494 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:29.592624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-046ea356-43c6-4a94-a9f0-50650adf1494 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:29.600135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-046ea356-43c6-4a94-a9f0-50650adf1494 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:29.600638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-046ea356-43c6-4a94-a9f0-50650adf1494 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:29.601500 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-046ea356-43c6-4a94-a9f0-50650adf1494 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:29.602012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-046ea356-43c6-4a94-a9f0-50650adf1494 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:29.631081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-046ea356-43c6-4a94-a9f0-50650adf1494 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Mar 08 04:25:29.631622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 454/896] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:29 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:29.729101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c9c00616-04b4-46a9-92f5-3a78aa0d5900 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:29.730111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c9c00616-04b4-46a9-92f5-3a78aa0d5900 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:29.736797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9c00616-04b4-46a9-92f5-3a78aa0d5900 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:29.737242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9c00616-04b4-46a9-92f5-3a78aa0d5900 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:29.738039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9c00616-04b4-46a9-92f5-3a78aa0d5900 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:29.738477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9c00616-04b4-46a9-92f5-3a78aa0d5900 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:29.863074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2629595f-7216-4531-b39e-6fa4c3e92fe4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:29.863987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2629595f-7216-4531-b39e-6fa4c3e92fe4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:29.869718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2629595f-7216-4531-b39e-6fa4c3e92fe4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:29.870177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2629595f-7216-4531-b39e-6fa4c3e92fe4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:29.870947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2629595f-7216-4531-b39e-6fa4c3e92fe4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:29.871383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2629595f-7216-4531-b39e-6fa4c3e92fe4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:29.877213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c9c00616-04b4-46a9-92f5-3a78aa0d5900 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:29.884582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c9c00616-04b4-46a9-92f5-3a78aa0d5900 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.162396 Mar 08 04:25:29.885238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 443/897] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:29 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:29.900475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2629595f-7216-4531-b39e-6fa4c3e92fe4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041683 Mar 08 04:25:29.901018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 455/898] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:30.642520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9bfeb406-eeae-495d-82cf-3a780df08f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:30.643461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9bfeb406-eeae-495d-82cf-3a780df08f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:30.649296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bfeb406-eeae-495d-82cf-3a780df08f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:30.649777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bfeb406-eeae-495d-82cf-3a780df08f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:30.650542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bfeb406-eeae-495d-82cf-3a780df08f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:30.650979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bfeb406-eeae-495d-82cf-3a780df08f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:30.680878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9bfeb406-eeae-495d-82cf-3a780df08f80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Mar 08 04:25:30.681426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 444/899] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:30 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:30.902194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4e5ba9f9-157c-4183-b4ee-60ab6dfae3c8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:30.902734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4e5ba9f9-157c-4183-b4ee-60ab6dfae3c8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:30.909933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e5ba9f9-157c-4183-b4ee-60ab6dfae3c8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:30.910378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e5ba9f9-157c-4183-b4ee-60ab6dfae3c8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:30.911139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e5ba9f9-157c-4183-b4ee-60ab6dfae3c8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:30.911569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e5ba9f9-157c-4183-b4ee-60ab6dfae3c8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:30.912331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3761ad67-be05-4c90-aaba-c700f86f7655 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:30.913299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3761ad67-be05-4c90-aaba-c700f86f7655 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:30.919257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3761ad67-be05-4c90-aaba-c700f86f7655 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:30.919705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3761ad67-be05-4c90-aaba-c700f86f7655 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:30.920474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3761ad67-be05-4c90-aaba-c700f86f7655 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:30.920917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3761ad67-be05-4c90-aaba-c700f86f7655 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:30.949295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3761ad67-be05-4c90-aaba-c700f86f7655 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040734 Mar 08 04:25:30.949881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 445/900] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:31.045898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4e5ba9f9-157c-4183-b4ee-60ab6dfae3c8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:31.053253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4e5ba9f9-157c-4183-b4ee-60ab6dfae3c8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155043 Mar 08 04:25:31.053834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 456/901] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:30 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:31.693764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-47f789b1-07f7-4cab-93ff-150eb27c4c48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:31.695183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-47f789b1-07f7-4cab-93ff-150eb27c4c48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:31.701474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-47f789b1-07f7-4cab-93ff-150eb27c4c48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:31.702118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-47f789b1-07f7-4cab-93ff-150eb27c4c48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:31.703322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-47f789b1-07f7-4cab-93ff-150eb27c4c48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:31.703982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-47f789b1-07f7-4cab-93ff-150eb27c4c48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:31.737531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-47f789b1-07f7-4cab-93ff-150eb27c4c48 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048596 Mar 08 04:25:31.738559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 446/902] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:31.961475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-169f8a7d-6cc4-4685-88f4-3ab6de786efd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:31.962405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-169f8a7d-6cc4-4685-88f4-3ab6de786efd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:31.969456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-169f8a7d-6cc4-4685-88f4-3ab6de786efd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:31.970015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-169f8a7d-6cc4-4685-88f4-3ab6de786efd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:31.971348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-169f8a7d-6cc4-4685-88f4-3ab6de786efd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:31.972156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-169f8a7d-6cc4-4685-88f4-3ab6de786efd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:32.003202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-169f8a7d-6cc4-4685-88f4-3ab6de786efd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 Mar 08 04:25:32.003760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 457/903] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:32.070536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a00623d3-4554-41a0-adbd-9da1b704cace tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:32.071149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a00623d3-4554-41a0-adbd-9da1b704cace tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:32.077780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a00623d3-4554-41a0-adbd-9da1b704cace tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:32.078232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a00623d3-4554-41a0-adbd-9da1b704cace tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:32.079192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a00623d3-4554-41a0-adbd-9da1b704cace tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:32.079629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a00623d3-4554-41a0-adbd-9da1b704cace tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:32.232261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a00623d3-4554-41a0-adbd-9da1b704cace tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:32.240256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a00623d3-4554-41a0-adbd-9da1b704cace tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.173599 Mar 08 04:25:32.240822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 447/904] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:32 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:32.750436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a3dfd3d2-2072-47ba-9496-a0783e74c929 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:32.751346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a3dfd3d2-2072-47ba-9496-a0783e74c929 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:32.757411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3dfd3d2-2072-47ba-9496-a0783e74c929 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:32.757896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3dfd3d2-2072-47ba-9496-a0783e74c929 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:32.758672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3dfd3d2-2072-47ba-9496-a0783e74c929 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:32.759116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3dfd3d2-2072-47ba-9496-a0783e74c929 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:32.787890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a3dfd3d2-2072-47ba-9496-a0783e74c929 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041676 Mar 08 04:25:32.788434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 458/905] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:33.017032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2253d819-3a21-4f2c-97cb-653c99da1d73 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:33.018026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2253d819-3a21-4f2c-97cb-653c99da1d73 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:33.024502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2253d819-3a21-4f2c-97cb-653c99da1d73 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:33.024998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2253d819-3a21-4f2c-97cb-653c99da1d73 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:33.025918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2253d819-3a21-4f2c-97cb-653c99da1d73 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:33.026396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2253d819-3a21-4f2c-97cb-653c99da1d73 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:33.057172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2253d819-3a21-4f2c-97cb-653c99da1d73 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045203 Mar 08 04:25:33.057823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 448/906] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:33.256619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-add52952-a1f6-4b81-9037-c8b345f0d151 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:33.257228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-add52952-a1f6-4b81-9037-c8b345f0d151 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:33.263494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-add52952-a1f6-4b81-9037-c8b345f0d151 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:33.263943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-add52952-a1f6-4b81-9037-c8b345f0d151 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:33.264709 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-add52952-a1f6-4b81-9037-c8b345f0d151 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:33.265772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-add52952-a1f6-4b81-9037-c8b345f0d151 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:33.398510 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-add52952-a1f6-4b81-9037-c8b345f0d151 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:33.406128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-add52952-a1f6-4b81-9037-c8b345f0d151 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153221 Mar 08 04:25:33.406681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 459/907] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:33 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:33.799795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-96a9e720-46ec-4140-9b06-96fe1eb2aace tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:33.800699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-96a9e720-46ec-4140-9b06-96fe1eb2aace tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:33.806967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96a9e720-46ec-4140-9b06-96fe1eb2aace tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:33.807415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96a9e720-46ec-4140-9b06-96fe1eb2aace tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:33.808180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96a9e720-46ec-4140-9b06-96fe1eb2aace tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:33.808617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96a9e720-46ec-4140-9b06-96fe1eb2aace tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:33.836171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-96a9e720-46ec-4140-9b06-96fe1eb2aace tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041120 Mar 08 04:25:33.836715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 449/908] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:34.068636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6ac2681a-3f27-4027-a6b2-4991f49bcb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:34.069459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6ac2681a-3f27-4027-a6b2-4991f49bcb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:34.075582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ac2681a-3f27-4027-a6b2-4991f49bcb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:34.076036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ac2681a-3f27-4027-a6b2-4991f49bcb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:34.076803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ac2681a-3f27-4027-a6b2-4991f49bcb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:34.078209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ac2681a-3f27-4027-a6b2-4991f49bcb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:34.106293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6ac2681a-3f27-4027-a6b2-4991f49bcb40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041690 Mar 08 04:25:34.106844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 460/909] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:34.423268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-45a64de0-68ef-4425-b43c-620c1183766b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:34.423883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-45a64de0-68ef-4425-b43c-620c1183766b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:34.429864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45a64de0-68ef-4425-b43c-620c1183766b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:34.430315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45a64de0-68ef-4425-b43c-620c1183766b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:34.431084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45a64de0-68ef-4425-b43c-620c1183766b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:34.431521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45a64de0-68ef-4425-b43c-620c1183766b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:34.567145 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-45a64de0-68ef-4425-b43c-620c1183766b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:34.574429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-45a64de0-68ef-4425-b43c-620c1183766b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155306 Mar 08 04:25:34.574991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 450/910] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:34 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:34.848039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7c80f76b-4651-4754-a397-cc1dcf236e2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:34.848888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7c80f76b-4651-4754-a397-cc1dcf236e2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:34.855194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c80f76b-4651-4754-a397-cc1dcf236e2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:34.855648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c80f76b-4651-4754-a397-cc1dcf236e2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:34.856428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c80f76b-4651-4754-a397-cc1dcf236e2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:34.856862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c80f76b-4651-4754-a397-cc1dcf236e2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:34.891689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7c80f76b-4651-4754-a397-cc1dcf236e2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Mar 08 04:25:34.892335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 461/911] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:34 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:35.118421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f7a3ba02-6374-4040-b8bf-e9b5ccce0db3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:35.119321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f7a3ba02-6374-4040-b8bf-e9b5ccce0db3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:35.126783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7a3ba02-6374-4040-b8bf-e9b5ccce0db3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:35.127224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7a3ba02-6374-4040-b8bf-e9b5ccce0db3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:35.127978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7a3ba02-6374-4040-b8bf-e9b5ccce0db3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:35.128410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7a3ba02-6374-4040-b8bf-e9b5ccce0db3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:35.157203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f7a3ba02-6374-4040-b8bf-e9b5ccce0db3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043181 Mar 08 04:25:35.157771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 451/912] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:35.595654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8d1b59a7-0b35-4b93-8285-c4b278a010f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:35.596257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8d1b59a7-0b35-4b93-8285-c4b278a010f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:35.602794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d1b59a7-0b35-4b93-8285-c4b278a010f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:35.603239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d1b59a7-0b35-4b93-8285-c4b278a010f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:35.603996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d1b59a7-0b35-4b93-8285-c4b278a010f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:35.604417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d1b59a7-0b35-4b93-8285-c4b278a010f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:35.737060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8d1b59a7-0b35-4b93-8285-c4b278a010f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:35.744283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8d1b59a7-0b35-4b93-8285-c4b278a010f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152638 Mar 08 04:25:35.744905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 462/913] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:35 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:35.903610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-41602d42-5698-4b51-86d4-628779f8bf80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:35.904522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-41602d42-5698-4b51-86d4-628779f8bf80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:35.911130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41602d42-5698-4b51-86d4-628779f8bf80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:35.911575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41602d42-5698-4b51-86d4-628779f8bf80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:35.912340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41602d42-5698-4b51-86d4-628779f8bf80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:35.912775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41602d42-5698-4b51-86d4-628779f8bf80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:35.940499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-41602d42-5698-4b51-86d4-628779f8bf80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041132 Mar 08 04:25:35.941041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 452/914] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:36.168419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6cbe72cd-86a0-42f4-a15e-dee5f30ef039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:36.169331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6cbe72cd-86a0-42f4-a15e-dee5f30ef039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:36.175251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6cbe72cd-86a0-42f4-a15e-dee5f30ef039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:36.175699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6cbe72cd-86a0-42f4-a15e-dee5f30ef039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:36.176458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6cbe72cd-86a0-42f4-a15e-dee5f30ef039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:36.176891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6cbe72cd-86a0-42f4-a15e-dee5f30ef039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:36.205871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6cbe72cd-86a0-42f4-a15e-dee5f30ef039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041359 Mar 08 04:25:36.206408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 463/915] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:36.761617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-07fec00a-ced6-4bf1-91c3-a75412ec95cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:36.762302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-07fec00a-ced6-4bf1-91c3-a75412ec95cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:36.768558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07fec00a-ced6-4bf1-91c3-a75412ec95cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:36.769006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07fec00a-ced6-4bf1-91c3-a75412ec95cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:36.769804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07fec00a-ced6-4bf1-91c3-a75412ec95cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:36.770265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07fec00a-ced6-4bf1-91c3-a75412ec95cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:36.911350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-07fec00a-ced6-4bf1-91c3-a75412ec95cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:36.918777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-07fec00a-ced6-4bf1-91c3-a75412ec95cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.161067 Mar 08 04:25:36.919334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 453/916] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:36 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:36.951493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e4f37ad5-f12e-434a-8854-7168965eb594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:36.952552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e4f37ad5-f12e-434a-8854-7168965eb594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:36.958684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4f37ad5-f12e-434a-8854-7168965eb594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:36.959132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4f37ad5-f12e-434a-8854-7168965eb594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:36.959894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4f37ad5-f12e-434a-8854-7168965eb594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:36.960330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4f37ad5-f12e-434a-8854-7168965eb594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:36.988696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e4f37ad5-f12e-434a-8854-7168965eb594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041091 Mar 08 04:25:36.989231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 464/917] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:37.217278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-485df571-b071-4103-a718-5035e90f8d61 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:37.218236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-485df571-b071-4103-a718-5035e90f8d61 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:37.224660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-485df571-b071-4103-a718-5035e90f8d61 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:37.225103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-485df571-b071-4103-a718-5035e90f8d61 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:37.225886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-485df571-b071-4103-a718-5035e90f8d61 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:37.226316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-485df571-b071-4103-a718-5035e90f8d61 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:37.253280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-485df571-b071-4103-a718-5035e90f8d61 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039957 Mar 08 04:25:37.253833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 454/918] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:37.936401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-33b14f56-9cde-443b-aabf-c7641aab50b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:37.937009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-33b14f56-9cde-443b-aabf-c7641aab50b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:37.943579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33b14f56-9cde-443b-aabf-c7641aab50b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:37.943999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33b14f56-9cde-443b-aabf-c7641aab50b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:37.944748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33b14f56-9cde-443b-aabf-c7641aab50b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:37.945179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33b14f56-9cde-443b-aabf-c7641aab50b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:38.000245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-82c62df2-a6aa-468b-83aa-cc662fee9ccd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:38.001616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-82c62df2-a6aa-468b-83aa-cc662fee9ccd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:38.007963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82c62df2-a6aa-468b-83aa-cc662fee9ccd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:38.008419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82c62df2-a6aa-468b-83aa-cc662fee9ccd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:38.009196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82c62df2-a6aa-468b-83aa-cc662fee9ccd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:38.009640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82c62df2-a6aa-468b-83aa-cc662fee9ccd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:38.039285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-82c62df2-a6aa-468b-83aa-cc662fee9ccd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042981 Mar 08 04:25:38.039864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 455/919] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:38.081824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-33b14f56-9cde-443b-aabf-c7641aab50b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:38.089123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-33b14f56-9cde-443b-aabf-c7641aab50b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156570 Mar 08 04:25:38.089679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 465/920] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:37 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:38.264349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ee1c6c5b-d5f3-44d1-b2d5-befcf2cbfb62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:38.265289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ee1c6c5b-d5f3-44d1-b2d5-befcf2cbfb62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:38.271847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee1c6c5b-d5f3-44d1-b2d5-befcf2cbfb62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:38.272298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee1c6c5b-d5f3-44d1-b2d5-befcf2cbfb62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:38.273061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee1c6c5b-d5f3-44d1-b2d5-befcf2cbfb62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:38.273499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee1c6c5b-d5f3-44d1-b2d5-befcf2cbfb62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:38.300828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ee1c6c5b-d5f3-44d1-b2d5-befcf2cbfb62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040474 Mar 08 04:25:38.301368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 456/921] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:39.051359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0ff05cc8-07ec-44e4-a4f2-2a02c19b3f44 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:39.052265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0ff05cc8-07ec-44e4-a4f2-2a02c19b3f44 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:39.058399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ff05cc8-07ec-44e4-a4f2-2a02c19b3f44 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:39.058843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ff05cc8-07ec-44e4-a4f2-2a02c19b3f44 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:39.059600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ff05cc8-07ec-44e4-a4f2-2a02c19b3f44 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:39.060030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ff05cc8-07ec-44e4-a4f2-2a02c19b3f44 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:39.086861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0ff05cc8-07ec-44e4-a4f2-2a02c19b3f44 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040093 Mar 08 04:25:39.087385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 466/922] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:39.105422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3a27628b-4af9-4424-b962-f8235edd9d45 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:39.106024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3a27628b-4af9-4424-b962-f8235edd9d45 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:39.112818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a27628b-4af9-4424-b962-f8235edd9d45 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:39.113265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a27628b-4af9-4424-b962-f8235edd9d45 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:39.114057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a27628b-4af9-4424-b962-f8235edd9d45 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:39.114499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a27628b-4af9-4424-b962-f8235edd9d45 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:39.245379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3a27628b-4af9-4424-b962-f8235edd9d45 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:39.253285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3a27628b-4af9-4424-b962-f8235edd9d45 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151730 Mar 08 04:25:39.253880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 457/923] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:39 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:39.312112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-298421b3-920c-420d-a730-7d348b85f518 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:39.313143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-298421b3-920c-420d-a730-7d348b85f518 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:39.318911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-298421b3-920c-420d-a730-7d348b85f518 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:39.319356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-298421b3-920c-420d-a730-7d348b85f518 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:39.320103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-298421b3-920c-420d-a730-7d348b85f518 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:39.320531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-298421b3-920c-420d-a730-7d348b85f518 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:39.348972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-298421b3-920c-420d-a730-7d348b85f518 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040763 Mar 08 04:25:39.349524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 467/924] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:40.099107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-672e5ec5-8aa5-4549-a56c-9cc197f887d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:40.100012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-672e5ec5-8aa5-4549-a56c-9cc197f887d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:40.105900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-672e5ec5-8aa5-4549-a56c-9cc197f887d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:40.106453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-672e5ec5-8aa5-4549-a56c-9cc197f887d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:40.107037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-672e5ec5-8aa5-4549-a56c-9cc197f887d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:40.107457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-672e5ec5-8aa5-4549-a56c-9cc197f887d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:40.136299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-672e5ec5-8aa5-4549-a56c-9cc197f887d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041836 Mar 08 04:25:40.136864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 458/925] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:40.269806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-878ce899-5d56-49c5-80b2-16d8adc0190b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:40.270410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-878ce899-5d56-49c5-80b2-16d8adc0190b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:40.276514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-878ce899-5d56-49c5-80b2-16d8adc0190b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:40.276954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-878ce899-5d56-49c5-80b2-16d8adc0190b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:40.277990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-878ce899-5d56-49c5-80b2-16d8adc0190b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:40.278420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-878ce899-5d56-49c5-80b2-16d8adc0190b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:40.361534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0a42e138-95b4-4447-9c89-872daaa24cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:40.362561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0a42e138-95b4-4447-9c89-872daaa24cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:40.368504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a42e138-95b4-4447-9c89-872daaa24cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:40.368952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a42e138-95b4-4447-9c89-872daaa24cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:40.369751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a42e138-95b4-4447-9c89-872daaa24cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:40.370193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a42e138-95b4-4447-9c89-872daaa24cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:40.399293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0a42e138-95b4-4447-9c89-872daaa24cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042735 Mar 08 04:25:40.399890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 459/926] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:40.415238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-878ce899-5d56-49c5-80b2-16d8adc0190b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:40.423214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-878ce899-5d56-49c5-80b2-16d8adc0190b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157853 Mar 08 04:25:40.423768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 468/927] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:40 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:41.148501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-608dc474-9aa6-4f8b-ba9c-7eb980d5b6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:41.149389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-608dc474-9aa6-4f8b-ba9c-7eb980d5b6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:41.155879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-608dc474-9aa6-4f8b-ba9c-7eb980d5b6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:41.156336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-608dc474-9aa6-4f8b-ba9c-7eb980d5b6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:41.157312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-608dc474-9aa6-4f8b-ba9c-7eb980d5b6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:41.157794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-608dc474-9aa6-4f8b-ba9c-7eb980d5b6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:41.186046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-608dc474-9aa6-4f8b-ba9c-7eb980d5b6fa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Mar 08 04:25:41.186829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 460/928] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:41.411493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-196b40f4-3f00-432f-949e-4caf927b8050 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:41.412403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-196b40f4-3f00-432f-949e-4caf927b8050 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:41.418797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-196b40f4-3f00-432f-949e-4caf927b8050 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:41.419262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-196b40f4-3f00-432f-949e-4caf927b8050 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:41.420016 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-196b40f4-3f00-432f-949e-4caf927b8050 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:41.420445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-196b40f4-3f00-432f-949e-4caf927b8050 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:41.440041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-02ed0152-1521-49b2-897f-bdf8266da41f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:41.440674 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-02ed0152-1521-49b2-897f-bdf8266da41f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:41.446413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02ed0152-1521-49b2-897f-bdf8266da41f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:41.446875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02ed0152-1521-49b2-897f-bdf8266da41f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:41.447640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02ed0152-1521-49b2-897f-bdf8266da41f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:41.448075 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02ed0152-1521-49b2-897f-bdf8266da41f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:41.449234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-196b40f4-3f00-432f-949e-4caf927b8050 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041650 Mar 08 04:25:41.449813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 469/929] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:41.579275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-02ed0152-1521-49b2-897f-bdf8266da41f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:41.586514 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-02ed0152-1521-49b2-897f-bdf8266da41f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150895 Mar 08 04:25:41.587079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 461/930] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:41 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:42.200395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ca18319e-e666-4c68-820e-044a8812dac9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:42.201787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ca18319e-e666-4c68-820e-044a8812dac9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:42.209232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca18319e-e666-4c68-820e-044a8812dac9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:42.209880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca18319e-e666-4c68-820e-044a8812dac9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:42.210923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca18319e-e666-4c68-820e-044a8812dac9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:42.211477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca18319e-e666-4c68-820e-044a8812dac9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:42.242431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ca18319e-e666-4c68-820e-044a8812dac9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047652 Mar 08 04:25:42.242966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 470/931] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:42 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:42.460900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9463d49b-b8e0-4b37-a685-02627b120211 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:42.461750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9463d49b-b8e0-4b37-a685-02627b120211 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:42.468056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9463d49b-b8e0-4b37-a685-02627b120211 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:42.468500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9463d49b-b8e0-4b37-a685-02627b120211 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:42.469420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9463d49b-b8e0-4b37-a685-02627b120211 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:42.469831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9463d49b-b8e0-4b37-a685-02627b120211 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:42.497280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9463d49b-b8e0-4b37-a685-02627b120211 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040340 Mar 08 04:25:42.498192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 462/932] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:42.605558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0ba6f1c2-e7bc-465d-8ca1-628f06a65015 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:42.606383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0ba6f1c2-e7bc-465d-8ca1-628f06a65015 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:42.614684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba6f1c2-e7bc-465d-8ca1-628f06a65015 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:42.615264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba6f1c2-e7bc-465d-8ca1-628f06a65015 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:42.616155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba6f1c2-e7bc-465d-8ca1-628f06a65015 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:42.616642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba6f1c2-e7bc-465d-8ca1-628f06a65015 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:42.751404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0ba6f1c2-e7bc-465d-8ca1-628f06a65015 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:42.759057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0ba6f1c2-e7bc-465d-8ca1-628f06a65015 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158294 Mar 08 04:25:42.759621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 471/933] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:42 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:43.254786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cfc49fd1-66a0-44b8-81f4-3b5d1377ac28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:43.255688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cfc49fd1-66a0-44b8-81f4-3b5d1377ac28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:43.261521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cfc49fd1-66a0-44b8-81f4-3b5d1377ac28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:43.262055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cfc49fd1-66a0-44b8-81f4-3b5d1377ac28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:43.262810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cfc49fd1-66a0-44b8-81f4-3b5d1377ac28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:43.263240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cfc49fd1-66a0-44b8-81f4-3b5d1377ac28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:43.291326 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cfc49fd1-66a0-44b8-81f4-3b5d1377ac28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 Mar 08 04:25:43.291864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 463/934] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:43.508576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ddf181b3-5f35-4a1f-b724-4a5f08a93aab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:43.509441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ddf181b3-5f35-4a1f-b724-4a5f08a93aab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:43.515339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ddf181b3-5f35-4a1f-b724-4a5f08a93aab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:43.515790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ddf181b3-5f35-4a1f-b724-4a5f08a93aab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:43.516834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ddf181b3-5f35-4a1f-b724-4a5f08a93aab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:43.517276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ddf181b3-5f35-4a1f-b724-4a5f08a93aab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:43.545343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ddf181b3-5f35-4a1f-b724-4a5f08a93aab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 Mar 08 04:25:43.545927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 472/935] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:43.777173 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a4988a4e-307b-418a-b919-4841ead9741f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:43.778163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a4988a4e-307b-418a-b919-4841ead9741f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:43.786204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4988a4e-307b-418a-b919-4841ead9741f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:43.786790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4988a4e-307b-418a-b919-4841ead9741f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:43.787750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4988a4e-307b-418a-b919-4841ead9741f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:43.788274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4988a4e-307b-418a-b919-4841ead9741f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:43.929898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a4988a4e-307b-418a-b919-4841ead9741f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:43.937251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a4988a4e-307b-418a-b919-4841ead9741f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.164877 Mar 08 04:25:43.938478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 464/936] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:43 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:44.302765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7a4777fb-e7ba-4dd3-a118-304c259d39e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:44.303668 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7a4777fb-e7ba-4dd3-a118-304c259d39e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:44.309927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a4777fb-e7ba-4dd3-a118-304c259d39e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:44.310374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a4777fb-e7ba-4dd3-a118-304c259d39e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:44.311134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a4777fb-e7ba-4dd3-a118-304c259d39e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:44.311565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a4777fb-e7ba-4dd3-a118-304c259d39e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:44.339899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7a4777fb-e7ba-4dd3-a118-304c259d39e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041109 Mar 08 04:25:44.340433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 473/937] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:44.557585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3d374e5c-3351-4546-bbdb-0a3623b839b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:44.558436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3d374e5c-3351-4546-bbdb-0a3623b839b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:44.564301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d374e5c-3351-4546-bbdb-0a3623b839b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:44.564747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d374e5c-3351-4546-bbdb-0a3623b839b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:44.565508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d374e5c-3351-4546-bbdb-0a3623b839b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:44.565974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d374e5c-3351-4546-bbdb-0a3623b839b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:44.593168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3d374e5c-3351-4546-bbdb-0a3623b839b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039625 Mar 08 04:25:44.593730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 465/938] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:44.955011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6b604cfa-bc4b-4b81-a74c-db6b9393b66c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:44.955669 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6b604cfa-bc4b-4b81-a74c-db6b9393b66c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:44.961548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b604cfa-bc4b-4b81-a74c-db6b9393b66c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:44.962025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b604cfa-bc4b-4b81-a74c-db6b9393b66c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:44.962782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b604cfa-bc4b-4b81-a74c-db6b9393b66c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:44.963216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b604cfa-bc4b-4b81-a74c-db6b9393b66c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:45.097534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6b604cfa-bc4b-4b81-a74c-db6b9393b66c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:45.104842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6b604cfa-bc4b-4b81-a74c-db6b9393b66c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153639 Mar 08 04:25:45.105343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 474/939] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:44 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:45.120389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:25:45.120880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:25:45.351427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2cdbc817-fc41-42c8-8136-c647d566c62d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:45.352338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2cdbc817-fc41-42c8-8136-c647d566c62d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:45.358678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2cdbc817-fc41-42c8-8136-c647d566c62d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:45.359071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2cdbc817-fc41-42c8-8136-c647d566c62d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:45.359836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2cdbc817-fc41-42c8-8136-c647d566c62d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:45.360277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2cdbc817-fc41-42c8-8136-c647d566c62d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:45.388720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2cdbc817-fc41-42c8-8136-c647d566c62d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 Mar 08 04:25:45.389260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 466/940] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:45.604620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-20093cd8-eac7-4468-a409-c10b005c622c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:45.605525 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-20093cd8-eac7-4468-a409-c10b005c622c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:45.612546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20093cd8-eac7-4468-a409-c10b005c622c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:45.612932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20093cd8-eac7-4468-a409-c10b005c622c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:45.613711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20093cd8-eac7-4468-a409-c10b005c622c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:45.614145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20093cd8-eac7-4468-a409-c10b005c622c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:45.642219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-20093cd8-eac7-4468-a409-c10b005c622c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041507 Mar 08 04:25:45.642811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 475/941] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:46.122150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7c8dc8a3-a33e-444e-9cce-e2b2346a4e29 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:46.122753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7c8dc8a3-a33e-444e-9cce-e2b2346a4e29 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:46.128621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c8dc8a3-a33e-444e-9cce-e2b2346a4e29 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:46.129061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c8dc8a3-a33e-444e-9cce-e2b2346a4e29 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:46.129854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c8dc8a3-a33e-444e-9cce-e2b2346a4e29 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:46.130285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c8dc8a3-a33e-444e-9cce-e2b2346a4e29 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:46.264009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7c8dc8a3-a33e-444e-9cce-e2b2346a4e29 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:46.271337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7c8dc8a3-a33e-444e-9cce-e2b2346a4e29 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153011 Mar 08 04:25:46.271896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 467/942] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:46 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:46.400108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4c9f746f-d1f0-4e12-868e-a6317fc74e1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:46.400931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4c9f746f-d1f0-4e12-868e-a6317fc74e1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:46.407036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c9f746f-d1f0-4e12-868e-a6317fc74e1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:46.407486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c9f746f-d1f0-4e12-868e-a6317fc74e1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:46.409036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c9f746f-d1f0-4e12-868e-a6317fc74e1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:46.409476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c9f746f-d1f0-4e12-868e-a6317fc74e1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:46.437033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4c9f746f-d1f0-4e12-868e-a6317fc74e1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040922 Mar 08 04:25:46.437571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 476/943] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:46.654427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0f7f2a7f-96a9-4681-8f05-c54be380a6ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:46.655236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0f7f2a7f-96a9-4681-8f05-c54be380a6ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:46.661763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f7f2a7f-96a9-4681-8f05-c54be380a6ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:46.662206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f7f2a7f-96a9-4681-8f05-c54be380a6ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:46.662959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f7f2a7f-96a9-4681-8f05-c54be380a6ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:46.663389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f7f2a7f-96a9-4681-8f05-c54be380a6ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:46.691531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0f7f2a7f-96a9-4681-8f05-c54be380a6ef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041488 Mar 08 04:25:46.692079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 468/944] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:47.288011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-055e38f9-f394-435a-acc0-7e0c839e3e09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:47.288618 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-055e38f9-f394-435a-acc0-7e0c839e3e09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:47.294947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-055e38f9-f394-435a-acc0-7e0c839e3e09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:47.295399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-055e38f9-f394-435a-acc0-7e0c839e3e09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:47.296165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-055e38f9-f394-435a-acc0-7e0c839e3e09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:47.296602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-055e38f9-f394-435a-acc0-7e0c839e3e09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:47.427665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-055e38f9-f394-435a-acc0-7e0c839e3e09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:47.435598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-055e38f9-f394-435a-acc0-7e0c839e3e09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151479 Mar 08 04:25:47.436161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 477/945] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:47 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:25:47.448349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4d14c278-69a8-43fd-a6d3-6bdfcb04a0be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:47.449258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4d14c278-69a8-43fd-a6d3-6bdfcb04a0be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:47.455489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d14c278-69a8-43fd-a6d3-6bdfcb04a0be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:47.456256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d14c278-69a8-43fd-a6d3-6bdfcb04a0be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:47.457237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d14c278-69a8-43fd-a6d3-6bdfcb04a0be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:47.457697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d14c278-69a8-43fd-a6d3-6bdfcb04a0be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:47.487589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4d14c278-69a8-43fd-a6d3-6bdfcb04a0be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Mar 08 04:25:47.488127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 469/946] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:47.702971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1340fb8d-9231-4141-a534-69cdf38921bb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:47.703884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1340fb8d-9231-4141-a534-69cdf38921bb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:47.710049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1340fb8d-9231-4141-a534-69cdf38921bb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:47.710501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1340fb8d-9231-4141-a534-69cdf38921bb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:47.711266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1340fb8d-9231-4141-a534-69cdf38921bb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:47.711707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1340fb8d-9231-4141-a534-69cdf38921bb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:47.740267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1340fb8d-9231-4141-a534-69cdf38921bb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041254 Mar 08 04:25:47.740819 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 478/947] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:48.455704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6191ff30-fd39-4323-9f8e-4a2e99c778a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:48.456308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6191ff30-fd39-4323-9f8e-4a2e99c778a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:48.462272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6191ff30-fd39-4323-9f8e-4a2e99c778a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:48.462719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6191ff30-fd39-4323-9f8e-4a2e99c778a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:48.463482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6191ff30-fd39-4323-9f8e-4a2e99c778a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:48.463920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6191ff30-fd39-4323-9f8e-4a2e99c778a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:48.499080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-40340e08-e17e-4429-a8b9-fbc5d667baa9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:48.500139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-40340e08-e17e-4429-a8b9-fbc5d667baa9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:48.507975 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-40340e08-e17e-4429-a8b9-fbc5d667baa9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:48.508445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-40340e08-e17e-4429-a8b9-fbc5d667baa9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:48.509247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-40340e08-e17e-4429-a8b9-fbc5d667baa9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:48.509748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-40340e08-e17e-4429-a8b9-fbc5d667baa9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:48.541227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-40340e08-e17e-4429-a8b9-fbc5d667baa9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Mar 08 04:25:48.541889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 479/948] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:48.599499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6191ff30-fd39-4323-9f8e-4a2e99c778a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:48.606714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6191ff30-fd39-4323-9f8e-4a2e99c778a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154987 Mar 08 04:25:48.607270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 470/949] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:48 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:48.752333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4f3000d1-4b0c-4e0c-8952-d1017210bc3b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:48.753279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4f3000d1-4b0c-4e0c-8952-d1017210bc3b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:48.759102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4f3000d1-4b0c-4e0c-8952-d1017210bc3b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:48.759552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4f3000d1-4b0c-4e0c-8952-d1017210bc3b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:48.760315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4f3000d1-4b0c-4e0c-8952-d1017210bc3b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:48.760781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4f3000d1-4b0c-4e0c-8952-d1017210bc3b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:48.789023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4f3000d1-4b0c-4e0c-8952-d1017210bc3b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041224 Mar 08 04:25:48.789564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 480/950] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:49.554194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e40b8e92-59fc-49db-bc49-d9dfb9493a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:49.555102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e40b8e92-59fc-49db-bc49-d9dfb9493a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:49.561390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e40b8e92-59fc-49db-bc49-d9dfb9493a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:49.561887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e40b8e92-59fc-49db-bc49-d9dfb9493a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:49.562659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e40b8e92-59fc-49db-bc49-d9dfb9493a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:49.563100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e40b8e92-59fc-49db-bc49-d9dfb9493a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:49.591518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e40b8e92-59fc-49db-bc49-d9dfb9493a70 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Mar 08 04:25:49.592064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 471/951] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:49.624181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0cacdab1-ec0a-4543-81dd-56181d396f77 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:49.624815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0cacdab1-ec0a-4543-81dd-56181d396f77 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:49.631616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cacdab1-ec0a-4543-81dd-56181d396f77 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:49.632057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cacdab1-ec0a-4543-81dd-56181d396f77 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:49.632841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cacdab1-ec0a-4543-81dd-56181d396f77 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:49.633270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cacdab1-ec0a-4543-81dd-56181d396f77 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:49.763506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0cacdab1-ec0a-4543-81dd-56181d396f77 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:49.771854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0cacdab1-ec0a-4543-81dd-56181d396f77 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151430 Mar 08 04:25:49.772416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 481/952] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:49 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:49.801033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7e8ef4de-d8c8-4961-91ad-a71feeeb1e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:49.801961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7e8ef4de-d8c8-4961-91ad-a71feeeb1e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:49.807748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8ef4de-d8c8-4961-91ad-a71feeeb1e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:49.808137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8ef4de-d8c8-4961-91ad-a71feeeb1e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:49.808889 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8ef4de-d8c8-4961-91ad-a71feeeb1e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:49.809320 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8ef4de-d8c8-4961-91ad-a71feeeb1e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:49.842400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7e8ef4de-d8c8-4961-91ad-a71feeeb1e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045448 Mar 08 04:25:49.842943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 472/953] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:50.602559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-07df0536-7d83-4d8a-8e9e-4b276df6f8cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:50.603411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-07df0536-7d83-4d8a-8e9e-4b276df6f8cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:50.609156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07df0536-7d83-4d8a-8e9e-4b276df6f8cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:50.609597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07df0536-7d83-4d8a-8e9e-4b276df6f8cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:50.610377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07df0536-7d83-4d8a-8e9e-4b276df6f8cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:50.611437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07df0536-7d83-4d8a-8e9e-4b276df6f8cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:50.638802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-07df0536-7d83-4d8a-8e9e-4b276df6f8cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040268 Mar 08 04:25:50.639440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 482/954] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:50 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:50.790922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e6422186-baf5-447f-9e0c-bda728c9a9a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:50.791540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e6422186-baf5-447f-9e0c-bda728c9a9a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:50.798037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6422186-baf5-447f-9e0c-bda728c9a9a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:50.799201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6422186-baf5-447f-9e0c-bda728c9a9a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:50.800054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6422186-baf5-447f-9e0c-bda728c9a9a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:50.800675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6422186-baf5-447f-9e0c-bda728c9a9a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:50.853881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e9d3d80c-8ef4-48f2-a341-632d088b310a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:50.855259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e9d3d80c-8ef4-48f2-a341-632d088b310a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:50.862135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9d3d80c-8ef4-48f2-a341-632d088b310a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:50.862613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9d3d80c-8ef4-48f2-a341-632d088b310a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:50.863405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9d3d80c-8ef4-48f2-a341-632d088b310a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:50.863840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9d3d80c-8ef4-48f2-a341-632d088b310a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:50.892880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e9d3d80c-8ef4-48f2-a341-632d088b310a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042529 Mar 08 04:25:50.893532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 483/955] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:50 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:50.936965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e6422186-baf5-447f-9e0c-bda728c9a9a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:50.944249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e6422186-baf5-447f-9e0c-bda728c9a9a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157234 Mar 08 04:25:50.944799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 473/956] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:50 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:51.650703 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ec14590d-3aef-4120-bb2f-75ef437477ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:51.651655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ec14590d-3aef-4120-bb2f-75ef437477ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:51.658557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec14590d-3aef-4120-bb2f-75ef437477ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:51.659007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec14590d-3aef-4120-bb2f-75ef437477ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:51.659852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec14590d-3aef-4120-bb2f-75ef437477ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:51.660286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec14590d-3aef-4120-bb2f-75ef437477ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:51.690473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ec14590d-3aef-4120-bb2f-75ef437477ba tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Mar 08 04:25:51.691013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 484/957] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:51.904158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6dce29be-57fb-4943-ba83-ae075653777d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:51.905009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6dce29be-57fb-4943-ba83-ae075653777d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:51.911952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dce29be-57fb-4943-ba83-ae075653777d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:51.912400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dce29be-57fb-4943-ba83-ae075653777d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:51.913167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dce29be-57fb-4943-ba83-ae075653777d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:51.913604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dce29be-57fb-4943-ba83-ae075653777d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:51.941949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6dce29be-57fb-4943-ba83-ae075653777d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042014 Mar 08 04:25:51.942494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 474/958] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:51.959978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1e616f47-d278-42a6-8355-85605947e992 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:51.960587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1e616f47-d278-42a6-8355-85605947e992 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:51.966369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e616f47-d278-42a6-8355-85605947e992 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:51.966810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e616f47-d278-42a6-8355-85605947e992 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:51.967570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e616f47-d278-42a6-8355-85605947e992 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:51.968000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e616f47-d278-42a6-8355-85605947e992 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:52.102244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1e616f47-d278-42a6-8355-85605947e992 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:52.109519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1e616f47-d278-42a6-8355-85605947e992 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153287 Mar 08 04:25:52.110104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 485/959] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:51 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:52.701876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c4a8f1c2-d1b3-4fa9-9e87-53d790fb2c5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:52.702819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c4a8f1c2-d1b3-4fa9-9e87-53d790fb2c5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:52.709394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4a8f1c2-d1b3-4fa9-9e87-53d790fb2c5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:52.709894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4a8f1c2-d1b3-4fa9-9e87-53d790fb2c5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:52.710669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4a8f1c2-d1b3-4fa9-9e87-53d790fb2c5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:52.711105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4a8f1c2-d1b3-4fa9-9e87-53d790fb2c5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:52.739585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c4a8f1c2-d1b3-4fa9-9e87-53d790fb2c5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041736 Mar 08 04:25:52.740136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 475/960] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:52.953491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-81a7c643-df51-4546-8677-43d886cca9fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:52.954417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-81a7c643-df51-4546-8677-43d886cca9fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:52.961192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81a7c643-df51-4546-8677-43d886cca9fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:52.961643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81a7c643-df51-4546-8677-43d886cca9fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:52.962422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81a7c643-df51-4546-8677-43d886cca9fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:52.962856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81a7c643-df51-4546-8677-43d886cca9fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:52.990257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-81a7c643-df51-4546-8677-43d886cca9fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040841 Mar 08 04:25:52.990794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 486/961] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:53.128018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c0929858-796a-4234-bbb5-9c44676838e8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:53.128623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c0929858-796a-4234-bbb5-9c44676838e8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:53.134815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0929858-796a-4234-bbb5-9c44676838e8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:53.135358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0929858-796a-4234-bbb5-9c44676838e8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:53.136126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0929858-796a-4234-bbb5-9c44676838e8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:53.136557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0929858-796a-4234-bbb5-9c44676838e8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:53.271432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c0929858-796a-4234-bbb5-9c44676838e8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:53.278997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c0929858-796a-4234-bbb5-9c44676838e8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155588 Mar 08 04:25:53.279557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 476/962] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:53 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:53.750300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d5dab9b1-3e77-4ada-9bdc-2175e62ae6cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:53.751313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d5dab9b1-3e77-4ada-9bdc-2175e62ae6cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:53.757123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5dab9b1-3e77-4ada-9bdc-2175e62ae6cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:53.757574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5dab9b1-3e77-4ada-9bdc-2175e62ae6cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:53.758372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5dab9b1-3e77-4ada-9bdc-2175e62ae6cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:53.758809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5dab9b1-3e77-4ada-9bdc-2175e62ae6cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:53.786796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d5dab9b1-3e77-4ada-9bdc-2175e62ae6cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040502 Mar 08 04:25:53.787337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 487/963] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:54.001876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3745a59c-16d4-496b-b751-8749efcf9d48 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:54.003068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3745a59c-16d4-496b-b751-8749efcf9d48 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:54.008943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3745a59c-16d4-496b-b751-8749efcf9d48 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:54.009384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3745a59c-16d4-496b-b751-8749efcf9d48 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:54.010169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3745a59c-16d4-496b-b751-8749efcf9d48 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:54.010599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3745a59c-16d4-496b-b751-8749efcf9d48 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:54.039207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3745a59c-16d4-496b-b751-8749efcf9d48 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 Mar 08 04:25:54.039744 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 477/964] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:54.296679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9e9507b0-5ff3-4335-a1bb-5b1bd983763f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:54.297281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9e9507b0-5ff3-4335-a1bb-5b1bd983763f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:54.304979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e9507b0-5ff3-4335-a1bb-5b1bd983763f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:54.305465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e9507b0-5ff3-4335-a1bb-5b1bd983763f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:54.306379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e9507b0-5ff3-4335-a1bb-5b1bd983763f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:54.306817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e9507b0-5ff3-4335-a1bb-5b1bd983763f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:54.446991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9e9507b0-5ff3-4335-a1bb-5b1bd983763f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:54.454256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9e9507b0-5ff3-4335-a1bb-5b1bd983763f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.161737 Mar 08 04:25:54.455480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 488/965] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:54 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:54.797833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-437249ea-0992-41ac-aa08-38911e2e3405 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:54.799025 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-437249ea-0992-41ac-aa08-38911e2e3405 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:54.805164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-437249ea-0992-41ac-aa08-38911e2e3405 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:54.805612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-437249ea-0992-41ac-aa08-38911e2e3405 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:54.806413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-437249ea-0992-41ac-aa08-38911e2e3405 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:54.806956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-437249ea-0992-41ac-aa08-38911e2e3405 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:54.836109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-437249ea-0992-41ac-aa08-38911e2e3405 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Mar 08 04:25:54.836669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 478/966] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:54 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:55.050745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-47eb8ab3-1831-4a81-9b9a-5bbc8d80fe63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:55.051615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-47eb8ab3-1831-4a81-9b9a-5bbc8d80fe63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:55.057521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47eb8ab3-1831-4a81-9b9a-5bbc8d80fe63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:55.058002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47eb8ab3-1831-4a81-9b9a-5bbc8d80fe63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:55.058772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47eb8ab3-1831-4a81-9b9a-5bbc8d80fe63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:55.059207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47eb8ab3-1831-4a81-9b9a-5bbc8d80fe63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:55.087435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-47eb8ab3-1831-4a81-9b9a-5bbc8d80fe63 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040737 Mar 08 04:25:55.087983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 489/967] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:55.471747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-559648d7-fcf1-4c61-93d4-5dc119e375f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:55.472353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-559648d7-fcf1-4c61-93d4-5dc119e375f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:55.478821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-559648d7-fcf1-4c61-93d4-5dc119e375f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:55.479274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-559648d7-fcf1-4c61-93d4-5dc119e375f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:55.480041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-559648d7-fcf1-4c61-93d4-5dc119e375f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:55.480475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-559648d7-fcf1-4c61-93d4-5dc119e375f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:55.611974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-559648d7-fcf1-4c61-93d4-5dc119e375f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:55.619840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-559648d7-fcf1-4c61-93d4-5dc119e375f4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151958 Mar 08 04:25:55.620401 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 479/968] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:55 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:55.847604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-28325733-2e6e-4cd7-9277-9786a6403b5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:55.849866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-28325733-2e6e-4cd7-9277-9786a6403b5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:55.856294 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28325733-2e6e-4cd7-9277-9786a6403b5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:55.856803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28325733-2e6e-4cd7-9277-9786a6403b5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:55.857629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28325733-2e6e-4cd7-9277-9786a6403b5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:55.858089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28325733-2e6e-4cd7-9277-9786a6403b5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:55.886750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-28325733-2e6e-4cd7-9277-9786a6403b5c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Mar 08 04:25:55.887297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 490/969] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:56.099657 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f40ee16a-7501-48dc-87f0-d95c71b1b86d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:56.100507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f40ee16a-7501-48dc-87f0-d95c71b1b86d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:56.106761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f40ee16a-7501-48dc-87f0-d95c71b1b86d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:56.107202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f40ee16a-7501-48dc-87f0-d95c71b1b86d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:56.107959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f40ee16a-7501-48dc-87f0-d95c71b1b86d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:56.108387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f40ee16a-7501-48dc-87f0-d95c71b1b86d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:56.136039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f40ee16a-7501-48dc-87f0-d95c71b1b86d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041249 Mar 08 04:25:56.136656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 480/970] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:56.637595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-311f813c-54c2-4d9e-8780-0345ac00a062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:56.638226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-311f813c-54c2-4d9e-8780-0345ac00a062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:56.644499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-311f813c-54c2-4d9e-8780-0345ac00a062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:56.645073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-311f813c-54c2-4d9e-8780-0345ac00a062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:56.646041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-311f813c-54c2-4d9e-8780-0345ac00a062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:56.646506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-311f813c-54c2-4d9e-8780-0345ac00a062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:56.786026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-311f813c-54c2-4d9e-8780-0345ac00a062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:56.793272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-311f813c-54c2-4d9e-8780-0345ac00a062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.159587 Mar 08 04:25:56.793863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 491/971] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:56 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:25:56.899061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9d7d9720-0107-4995-96c7-88e0d1c6d157 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:56.899896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9d7d9720-0107-4995-96c7-88e0d1c6d157 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:56.906709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d7d9720-0107-4995-96c7-88e0d1c6d157 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:56.907224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d7d9720-0107-4995-96c7-88e0d1c6d157 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:56.908056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d7d9720-0107-4995-96c7-88e0d1c6d157 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:56.908559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d7d9720-0107-4995-96c7-88e0d1c6d157 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:56.938799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9d7d9720-0107-4995-96c7-88e0d1c6d157 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Mar 08 04:25:56.939359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 481/972] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:57.148157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-262b2509-0c34-428e-9b65-6b5fa1367039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:57.149125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-262b2509-0c34-428e-9b65-6b5fa1367039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:57.155610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-262b2509-0c34-428e-9b65-6b5fa1367039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:57.156047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-262b2509-0c34-428e-9b65-6b5fa1367039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:57.156806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-262b2509-0c34-428e-9b65-6b5fa1367039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:57.157235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-262b2509-0c34-428e-9b65-6b5fa1367039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:57.187801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-262b2509-0c34-428e-9b65-6b5fa1367039 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Mar 08 04:25:57.188414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 492/973] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:57.811145 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cdb3807a-8485-43ef-950f-1ddf82e60337 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:57.811747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cdb3807a-8485-43ef-950f-1ddf82e60337 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:57.818455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdb3807a-8485-43ef-950f-1ddf82e60337 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:57.818897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdb3807a-8485-43ef-950f-1ddf82e60337 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:57.819658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdb3807a-8485-43ef-950f-1ddf82e60337 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:57.820086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdb3807a-8485-43ef-950f-1ddf82e60337 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:57.950793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d5f35e29-f9ae-4e3a-860b-9a9ce19cdb9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:57.951701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d5f35e29-f9ae-4e3a-860b-9a9ce19cdb9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:57.953442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cdb3807a-8485-43ef-950f-1ddf82e60337 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:57.957524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5f35e29-f9ae-4e3a-860b-9a9ce19cdb9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:57.958001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5f35e29-f9ae-4e3a-860b-9a9ce19cdb9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:57.958764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5f35e29-f9ae-4e3a-860b-9a9ce19cdb9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:57.959199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5f35e29-f9ae-4e3a-860b-9a9ce19cdb9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:57.960985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cdb3807a-8485-43ef-950f-1ddf82e60337 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153656 Mar 08 04:25:57.961556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 482/974] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:57 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:57.987109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d5f35e29-f9ae-4e3a-860b-9a9ce19cdb9a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040220 Mar 08 04:25:57.987648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 493/975] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:58.199570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d947fce7-96d5-4456-858f-92098be907db tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:58.200479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d947fce7-96d5-4456-858f-92098be907db tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:58.206294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d947fce7-96d5-4456-858f-92098be907db tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:58.206732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d947fce7-96d5-4456-858f-92098be907db tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:58.207718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d947fce7-96d5-4456-858f-92098be907db tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:58.208168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d947fce7-96d5-4456-858f-92098be907db tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:58.235707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d947fce7-96d5-4456-858f-92098be907db tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040069 Mar 08 04:25:58.236236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 483/976] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:25:58.978608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-30e82f8a-ce02-4571-b48a-24d9a5073ef6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:58.979153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-30e82f8a-ce02-4571-b48a-24d9a5073ef6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:58.985537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-30e82f8a-ce02-4571-b48a-24d9a5073ef6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:58.986015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-30e82f8a-ce02-4571-b48a-24d9a5073ef6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:58.986776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-30e82f8a-ce02-4571-b48a-24d9a5073ef6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:58.987214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-30e82f8a-ce02-4571-b48a-24d9a5073ef6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:58.998912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0fb2f1cf-b887-469e-9f11-6cc573da72e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:58.999841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0fb2f1cf-b887-469e-9f11-6cc573da72e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:59.005974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0fb2f1cf-b887-469e-9f11-6cc573da72e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:59.006421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0fb2f1cf-b887-469e-9f11-6cc573da72e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:59.007186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0fb2f1cf-b887-469e-9f11-6cc573da72e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:59.007621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0fb2f1cf-b887-469e-9f11-6cc573da72e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:59.036473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0fb2f1cf-b887-469e-9f11-6cc573da72e1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041350 Mar 08 04:25:59.037042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 484/977] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:25:59.121195 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-30e82f8a-ce02-4571-b48a-24d9a5073ef6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:25:59.130107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-30e82f8a-ce02-4571-b48a-24d9a5073ef6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155364 Mar 08 04:25:59.130680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 494/978] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:25:58 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:25:59.248347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a7f3fb44-d70a-40c0-935a-431c4c38726e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:25:59.249175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a7f3fb44-d70a-40c0-935a-431c4c38726e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:25:59.255595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7f3fb44-d70a-40c0-935a-431c4c38726e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:59.256034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7f3fb44-d70a-40c0-935a-431c4c38726e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:59.256785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7f3fb44-d70a-40c0-935a-431c4c38726e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:25:59.257215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7f3fb44-d70a-40c0-935a-431c4c38726e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:25:59.290286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a7f3fb44-d70a-40c0-935a-431c4c38726e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045997 Mar 08 04:25:59.291047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 485/979] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:25:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:00.047832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-59b23787-644e-47f2-b49c-824efcce1828 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:00.048747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-59b23787-644e-47f2-b49c-824efcce1828 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:00.055569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-59b23787-644e-47f2-b49c-824efcce1828 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:00.056021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-59b23787-644e-47f2-b49c-824efcce1828 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:00.056789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-59b23787-644e-47f2-b49c-824efcce1828 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:00.057255 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-59b23787-644e-47f2-b49c-824efcce1828 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:00.085589 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-59b23787-644e-47f2-b49c-824efcce1828 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041686 Mar 08 04:26:00.086165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 495/980] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:00.147597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1c9dbc66-2ed6-4c5f-bdc6-535af63b4a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:00.148264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1c9dbc66-2ed6-4c5f-bdc6-535af63b4a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:00.154735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c9dbc66-2ed6-4c5f-bdc6-535af63b4a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:00.155178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c9dbc66-2ed6-4c5f-bdc6-535af63b4a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:00.155941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c9dbc66-2ed6-4c5f-bdc6-535af63b4a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:00.156375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c9dbc66-2ed6-4c5f-bdc6-535af63b4a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:00.290277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1c9dbc66-2ed6-4c5f-bdc6-535af63b4a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:00.297547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1c9dbc66-2ed6-4c5f-bdc6-535af63b4a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154004 Mar 08 04:26:00.298121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 486/981] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:00 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:00.302102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4beb65ba-1af0-47a4-8356-01922b66cbf8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:00.303032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4beb65ba-1af0-47a4-8356-01922b66cbf8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:00.308760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4beb65ba-1af0-47a4-8356-01922b66cbf8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:00.309211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4beb65ba-1af0-47a4-8356-01922b66cbf8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:00.310002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4beb65ba-1af0-47a4-8356-01922b66cbf8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:00.310435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4beb65ba-1af0-47a4-8356-01922b66cbf8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:00.338228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4beb65ba-1af0-47a4-8356-01922b66cbf8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040214 Mar 08 04:26:00.338762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 496/982] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:01.096399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-49b78161-e960-47de-9d9e-e9fd969ff03c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:01.097283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-49b78161-e960-47de-9d9e-e9fd969ff03c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:01.104518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49b78161-e960-47de-9d9e-e9fd969ff03c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:01.104814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49b78161-e960-47de-9d9e-e9fd969ff03c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:01.105639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49b78161-e960-47de-9d9e-e9fd969ff03c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:01.106152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49b78161-e960-47de-9d9e-e9fd969ff03c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:01.136391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-49b78161-e960-47de-9d9e-e9fd969ff03c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Mar 08 04:26:01.137046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 487/983] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:01.313822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cf67afc7-74bc-40a7-915d-61a66b83f4c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:01.314537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cf67afc7-74bc-40a7-915d-61a66b83f4c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:01.320783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf67afc7-74bc-40a7-915d-61a66b83f4c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:01.321232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf67afc7-74bc-40a7-915d-61a66b83f4c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:01.322020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf67afc7-74bc-40a7-915d-61a66b83f4c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:01.322462 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf67afc7-74bc-40a7-915d-61a66b83f4c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:01.349623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-266804c1-8a73-455a-943d-ea95f3558c94 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:01.350797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-266804c1-8a73-455a-943d-ea95f3558c94 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:01.357316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-266804c1-8a73-455a-943d-ea95f3558c94 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:01.357818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-266804c1-8a73-455a-943d-ea95f3558c94 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:01.358658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-266804c1-8a73-455a-943d-ea95f3558c94 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:01.359158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-266804c1-8a73-455a-943d-ea95f3558c94 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:01.388743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-266804c1-8a73-455a-943d-ea95f3558c94 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Mar 08 04:26:01.389394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 488/984] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:01 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:01.458583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cf67afc7-74bc-40a7-915d-61a66b83f4c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:01.465934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cf67afc7-74bc-40a7-915d-61a66b83f4c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155912 Mar 08 04:26:01.466501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 497/985] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:01 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:02.148746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0c4588ea-acc1-467a-a335-0a9f192f7a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:02.149570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0c4588ea-acc1-467a-a335-0a9f192f7a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:02.155703 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c4588ea-acc1-467a-a335-0a9f192f7a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:02.156151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c4588ea-acc1-467a-a335-0a9f192f7a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:02.156916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c4588ea-acc1-467a-a335-0a9f192f7a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:02.157351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c4588ea-acc1-467a-a335-0a9f192f7a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:02.185770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0c4588ea-acc1-467a-a335-0a9f192f7a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041855 Mar 08 04:26:02.186324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 489/986] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:02.400268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b1665a2a-a37b-4a56-8e97-bdc7807ee82a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:02.401117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b1665a2a-a37b-4a56-8e97-bdc7807ee82a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:02.408494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1665a2a-a37b-4a56-8e97-bdc7807ee82a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:02.408941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1665a2a-a37b-4a56-8e97-bdc7807ee82a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:02.409720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1665a2a-a37b-4a56-8e97-bdc7807ee82a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:02.410687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1665a2a-a37b-4a56-8e97-bdc7807ee82a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:02.442119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b1665a2a-a37b-4a56-8e97-bdc7807ee82a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Mar 08 04:26:02.442628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 498/987] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:02.485365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d36f3a4e-014a-47a0-b64c-3175a6f5836b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:02.485993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d36f3a4e-014a-47a0-b64c-3175a6f5836b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:02.493123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36f3a4e-014a-47a0-b64c-3175a6f5836b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:02.493573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36f3a4e-014a-47a0-b64c-3175a6f5836b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:02.494441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36f3a4e-014a-47a0-b64c-3175a6f5836b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:02.494879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36f3a4e-014a-47a0-b64c-3175a6f5836b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:02.631184 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d36f3a4e-014a-47a0-b64c-3175a6f5836b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:02.638425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d36f3a4e-014a-47a0-b64c-3175a6f5836b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158813 Mar 08 04:26:02.639037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 490/988] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:02 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:03.197411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c645e1f8-2823-48d4-80cc-930cfaef2a43 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:03.198339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c645e1f8-2823-48d4-80cc-930cfaef2a43 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:03.204112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c645e1f8-2823-48d4-80cc-930cfaef2a43 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:03.204558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c645e1f8-2823-48d4-80cc-930cfaef2a43 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:03.205310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c645e1f8-2823-48d4-80cc-930cfaef2a43 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:03.205766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c645e1f8-2823-48d4-80cc-930cfaef2a43 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:03.233466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c645e1f8-2823-48d4-80cc-930cfaef2a43 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040023 Mar 08 04:26:03.234026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 499/989] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:03.454726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fe0dd5fd-1492-420a-979b-27bf2247998d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:03.455562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fe0dd5fd-1492-420a-979b-27bf2247998d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:03.462494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe0dd5fd-1492-420a-979b-27bf2247998d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:03.463020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe0dd5fd-1492-420a-979b-27bf2247998d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:03.463835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe0dd5fd-1492-420a-979b-27bf2247998d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:03.464309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe0dd5fd-1492-420a-979b-27bf2247998d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:03.493286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fe0dd5fd-1492-420a-979b-27bf2247998d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042526 Mar 08 04:26:03.493928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 491/990] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:03.656198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9bccc431-a121-439c-bc55-8764e68a96bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:03.656858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9bccc431-a121-439c-bc55-8764e68a96bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:03.664483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9bccc431-a121-439c-bc55-8764e68a96bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:03.664979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9bccc431-a121-439c-bc55-8764e68a96bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:03.665880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9bccc431-a121-439c-bc55-8764e68a96bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:03.666321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9bccc431-a121-439c-bc55-8764e68a96bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:03.799264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9bccc431-a121-439c-bc55-8764e68a96bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:03.807062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9bccc431-a121-439c-bc55-8764e68a96bf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155163 Mar 08 04:26:03.807614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 500/991] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:03 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:04.245251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a71060bb-c0aa-4d23-b19d-6f62ef9d8aa4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:04.246179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a71060bb-c0aa-4d23-b19d-6f62ef9d8aa4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:04.252138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a71060bb-c0aa-4d23-b19d-6f62ef9d8aa4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:04.252591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a71060bb-c0aa-4d23-b19d-6f62ef9d8aa4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:04.253354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a71060bb-c0aa-4d23-b19d-6f62ef9d8aa4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:04.254456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a71060bb-c0aa-4d23-b19d-6f62ef9d8aa4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:04.282639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a71060bb-c0aa-4d23-b19d-6f62ef9d8aa4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Mar 08 04:26:04.283178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 492/992] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:04.506032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cbc7bc59-891e-4ac1-9e2c-3e55505748a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:04.507315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cbc7bc59-891e-4ac1-9e2c-3e55505748a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:04.513477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbc7bc59-891e-4ac1-9e2c-3e55505748a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:04.513951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbc7bc59-891e-4ac1-9e2c-3e55505748a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:04.514707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbc7bc59-891e-4ac1-9e2c-3e55505748a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:04.515146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbc7bc59-891e-4ac1-9e2c-3e55505748a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:04.544811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cbc7bc59-891e-4ac1-9e2c-3e55505748a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043796 Mar 08 04:26:04.545348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 501/993] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:04.823951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-31731203-3adb-44fd-9202-ebb49e93670c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:04.824496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-31731203-3adb-44fd-9202-ebb49e93670c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:04.832396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31731203-3adb-44fd-9202-ebb49e93670c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:04.832945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31731203-3adb-44fd-9202-ebb49e93670c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:04.833984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31731203-3adb-44fd-9202-ebb49e93670c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:04.834416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31731203-3adb-44fd-9202-ebb49e93670c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:04.967111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-31731203-3adb-44fd-9202-ebb49e93670c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:04.974419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-31731203-3adb-44fd-9202-ebb49e93670c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154454 Mar 08 04:26:04.974981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 493/994] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:04 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:05.294042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-354b6eab-4304-4965-8572-bc360c55ca1a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:05.294946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-354b6eab-4304-4965-8572-bc360c55ca1a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:05.301945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-354b6eab-4304-4965-8572-bc360c55ca1a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:05.302379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-354b6eab-4304-4965-8572-bc360c55ca1a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:05.303142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-354b6eab-4304-4965-8572-bc360c55ca1a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:05.303573 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-354b6eab-4304-4965-8572-bc360c55ca1a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:05.330803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-354b6eab-4304-4965-8572-bc360c55ca1a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040717 Mar 08 04:26:05.331340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 502/995] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:05.557395 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7f77cfa3-2bcb-4995-994d-885cdb1bcca5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:05.558478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7f77cfa3-2bcb-4995-994d-885cdb1bcca5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:05.564288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f77cfa3-2bcb-4995-994d-885cdb1bcca5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:05.564736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f77cfa3-2bcb-4995-994d-885cdb1bcca5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:05.565492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f77cfa3-2bcb-4995-994d-885cdb1bcca5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:05.566018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f77cfa3-2bcb-4995-994d-885cdb1bcca5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:05.596032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7f77cfa3-2bcb-4995-994d-885cdb1bcca5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 Mar 08 04:26:05.596657 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 494/996] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:05.991997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-daf5b439-f97c-4530-b5c9-1797bc73388a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:05.992604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-daf5b439-f97c-4530-b5c9-1797bc73388a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:05.998710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-daf5b439-f97c-4530-b5c9-1797bc73388a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:05.999162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-daf5b439-f97c-4530-b5c9-1797bc73388a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:05.999926 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-daf5b439-f97c-4530-b5c9-1797bc73388a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:06.000358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-daf5b439-f97c-4530-b5c9-1797bc73388a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:06.134214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-daf5b439-f97c-4530-b5c9-1797bc73388a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:06.141365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-daf5b439-f97c-4530-b5c9-1797bc73388a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153938 Mar 08 04:26:06.141957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 503/997] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:06.342345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e7b0e30e-d59e-4bfc-b7c1-cbc2e766c1aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:06.343317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e7b0e30e-d59e-4bfc-b7c1-cbc2e766c1aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:06.350428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7b0e30e-d59e-4bfc-b7c1-cbc2e766c1aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:06.350883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7b0e30e-d59e-4bfc-b7c1-cbc2e766c1aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:06.351649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7b0e30e-d59e-4bfc-b7c1-cbc2e766c1aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:06.352084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7b0e30e-d59e-4bfc-b7c1-cbc2e766c1aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:06.379986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e7b0e30e-d59e-4bfc-b7c1-cbc2e766c1aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041587 Mar 08 04:26:06.380539 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 495/998] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:06.608647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f84cba6a-1cbd-4569-b1d5-7991adaa6d9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:06.609596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f84cba6a-1cbd-4569-b1d5-7991adaa6d9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:06.615830 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f84cba6a-1cbd-4569-b1d5-7991adaa6d9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:06.616277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f84cba6a-1cbd-4569-b1d5-7991adaa6d9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:06.617157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f84cba6a-1cbd-4569-b1d5-7991adaa6d9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:06.617553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f84cba6a-1cbd-4569-b1d5-7991adaa6d9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:06.646569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f84cba6a-1cbd-4569-b1d5-7991adaa6d9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041936 Mar 08 04:26:06.647112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 504/999] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:07.158373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f5c43efd-bc4b-4c95-8404-de06d4186c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:07.158930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f5c43efd-bc4b-4c95-8404-de06d4186c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:07.164739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c43efd-bc4b-4c95-8404-de06d4186c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:07.165184 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c43efd-bc4b-4c95-8404-de06d4186c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:07.165975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c43efd-bc4b-4c95-8404-de06d4186c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:07.166417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c43efd-bc4b-4c95-8404-de06d4186c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:07.297190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f5c43efd-bc4b-4c95-8404-de06d4186c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:07.305246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f5c43efd-bc4b-4c95-8404-de06d4186c85 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150865 Mar 08 04:26:07.305835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 496/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:07.391746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6b572b7e-7cbd-481b-9a36-6dbc08bfb29f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:07.392768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6b572b7e-7cbd-481b-9a36-6dbc08bfb29f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:07.399141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b572b7e-7cbd-481b-9a36-6dbc08bfb29f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:07.399583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b572b7e-7cbd-481b-9a36-6dbc08bfb29f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:07.400336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b572b7e-7cbd-481b-9a36-6dbc08bfb29f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:07.400763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b572b7e-7cbd-481b-9a36-6dbc08bfb29f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:07.429913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6b572b7e-7cbd-481b-9a36-6dbc08bfb29f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042160 Mar 08 04:26:07.430445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 505/1001] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:07.658363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-eb3b8ab8-de76-4c31-bb17-e349577e1ec5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:07.659268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-eb3b8ab8-de76-4c31-bb17-e349577e1ec5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:07.666229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb3b8ab8-de76-4c31-bb17-e349577e1ec5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:07.666676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb3b8ab8-de76-4c31-bb17-e349577e1ec5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:07.667440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb3b8ab8-de76-4c31-bb17-e349577e1ec5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:07.667872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb3b8ab8-de76-4c31-bb17-e349577e1ec5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:07.696692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-eb3b8ab8-de76-4c31-bb17-e349577e1ec5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Mar 08 04:26:07.697166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 497/1002] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:08.322589 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a56665d4-c16c-4b92-9e64-409d2758784f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:08.323219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a56665d4-c16c-4b92-9e64-409d2758784f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:08.329012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a56665d4-c16c-4b92-9e64-409d2758784f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:08.329458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a56665d4-c16c-4b92-9e64-409d2758784f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:08.330245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a56665d4-c16c-4b92-9e64-409d2758784f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:08.330677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a56665d4-c16c-4b92-9e64-409d2758784f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:08.440901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-af449bb9-6769-41bf-93bd-1ba34b30e596 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:08.442350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-af449bb9-6769-41bf-93bd-1ba34b30e596 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:08.448091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af449bb9-6769-41bf-93bd-1ba34b30e596 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:08.448543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af449bb9-6769-41bf-93bd-1ba34b30e596 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:08.449310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af449bb9-6769-41bf-93bd-1ba34b30e596 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:08.449772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af449bb9-6769-41bf-93bd-1ba34b30e596 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:08.466608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a56665d4-c16c-4b92-9e64-409d2758784f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:08.474246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a56665d4-c16c-4b92-9e64-409d2758784f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155570 Mar 08 04:26:08.474809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 506/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:08 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:08.478292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-af449bb9-6769-41bf-93bd-1ba34b30e596 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041308 Mar 08 04:26:08.478839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 498/1004] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:08.708236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a65df116-5bc3-44b3-8f85-44acf44d7a1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:08.709178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a65df116-5bc3-44b3-8f85-44acf44d7a1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:08.715052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a65df116-5bc3-44b3-8f85-44acf44d7a1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:08.715496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a65df116-5bc3-44b3-8f85-44acf44d7a1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:08.716256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a65df116-5bc3-44b3-8f85-44acf44d7a1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:08.716688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a65df116-5bc3-44b3-8f85-44acf44d7a1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:08.744523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a65df116-5bc3-44b3-8f85-44acf44d7a1a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040345 Mar 08 04:26:08.745071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 507/1005] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:09.490465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-814017d3-95c6-4c8b-8f92-5dd3b584bf61 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:09.491041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e0ad237f-c68a-4282-8248-a5f0ed300e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:09.491460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e0ad237f-c68a-4282-8248-a5f0ed300e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:09.491596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-814017d3-95c6-4c8b-8f92-5dd3b584bf61 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:09.497766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-814017d3-95c6-4c8b-8f92-5dd3b584bf61 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:09.497907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0ad237f-c68a-4282-8248-a5f0ed300e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:09.498203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-814017d3-95c6-4c8b-8f92-5dd3b584bf61 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:09.498330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0ad237f-c68a-4282-8248-a5f0ed300e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:09.498976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-814017d3-95c6-4c8b-8f92-5dd3b584bf61 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:09.499079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0ad237f-c68a-4282-8248-a5f0ed300e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:09.499409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0ad237f-c68a-4282-8248-a5f0ed300e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:09.499507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-814017d3-95c6-4c8b-8f92-5dd3b584bf61 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:09.528511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-814017d3-95c6-4c8b-8f92-5dd3b584bf61 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042149 Mar 08 04:26:09.529066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 499/1006] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:09 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:09.632576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e0ad237f-c68a-4282-8248-a5f0ed300e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:09.639893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e0ad237f-c68a-4282-8248-a5f0ed300e4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152780 Mar 08 04:26:09.640457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 508/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:26:09.756589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-82cf5e02-8ee1-42f9-8c9b-67b1613bb2d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:09.757427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-82cf5e02-8ee1-42f9-8c9b-67b1613bb2d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:09.763312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82cf5e02-8ee1-42f9-8c9b-67b1613bb2d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:09.763770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82cf5e02-8ee1-42f9-8c9b-67b1613bb2d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:09.764540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82cf5e02-8ee1-42f9-8c9b-67b1613bb2d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:09.764990 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82cf5e02-8ee1-42f9-8c9b-67b1613bb2d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:09.793338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-82cf5e02-8ee1-42f9-8c9b-67b1613bb2d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041292 Mar 08 04:26:09.793907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 500/1008] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:10.542367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-62492663-4a27-4888-9a36-dbf91704479d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:10.543321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-62492663-4a27-4888-9a36-dbf91704479d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:10.549593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62492663-4a27-4888-9a36-dbf91704479d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:10.550071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62492663-4a27-4888-9a36-dbf91704479d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:10.550824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62492663-4a27-4888-9a36-dbf91704479d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:10.551311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62492663-4a27-4888-9a36-dbf91704479d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:10.579119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-62492663-4a27-4888-9a36-dbf91704479d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Mar 08 04:26:10.579652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 509/1009] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:10.657759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-94ed9e08-8441-4932-9dcf-519c4c9f54a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:10.658362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-94ed9e08-8441-4932-9dcf-519c4c9f54a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:10.664973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94ed9e08-8441-4932-9dcf-519c4c9f54a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:10.665417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94ed9e08-8441-4932-9dcf-519c4c9f54a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:10.666209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94ed9e08-8441-4932-9dcf-519c4c9f54a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:10.666639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94ed9e08-8441-4932-9dcf-519c4c9f54a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:10.804495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bfc7614a-73c8-4990-8673-7d6107ce053b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:10.805544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-94ed9e08-8441-4932-9dcf-519c4c9f54a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:10.805735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bfc7614a-73c8-4990-8673-7d6107ce053b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:10.811789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfc7614a-73c8-4990-8673-7d6107ce053b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:10.812242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfc7614a-73c8-4990-8673-7d6107ce053b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:10.813002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-94ed9e08-8441-4932-9dcf-519c4c9f54a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.159023 Mar 08 04:26:10.813123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfc7614a-73c8-4990-8673-7d6107ce053b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:10.813463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfc7614a-73c8-4990-8673-7d6107ce053b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:10.813571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 501/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:10 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:10.842553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bfc7614a-73c8-4990-8673-7d6107ce053b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 Mar 08 04:26:10.843095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 510/1011] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:11.590610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d235d633-d81f-48e7-a86a-c4f5a35ce414 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:11.591521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d235d633-d81f-48e7-a86a-c4f5a35ce414 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:11.597366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d235d633-d81f-48e7-a86a-c4f5a35ce414 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:11.597855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d235d633-d81f-48e7-a86a-c4f5a35ce414 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:11.599352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d235d633-d81f-48e7-a86a-c4f5a35ce414 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:11.599815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d235d633-d81f-48e7-a86a-c4f5a35ce414 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:11.627028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d235d633-d81f-48e7-a86a-c4f5a35ce414 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040371 Mar 08 04:26:11.627563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 502/1012] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:11.830227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-909ee7df-69ca-4ccd-885a-7c4ca57a5021 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:11.830752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-909ee7df-69ca-4ccd-885a-7c4ca57a5021 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:11.837514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-909ee7df-69ca-4ccd-885a-7c4ca57a5021 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:11.838020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-909ee7df-69ca-4ccd-885a-7c4ca57a5021 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:11.838782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-909ee7df-69ca-4ccd-885a-7c4ca57a5021 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:11.839217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-909ee7df-69ca-4ccd-885a-7c4ca57a5021 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:11.855322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7c519249-2a1b-46f8-9890-956b72143225 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:11.856226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7c519249-2a1b-46f8-9890-956b72143225 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:11.863474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c519249-2a1b-46f8-9890-956b72143225 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:11.863961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c519249-2a1b-46f8-9890-956b72143225 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:11.864732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c519249-2a1b-46f8-9890-956b72143225 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:11.865170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c519249-2a1b-46f8-9890-956b72143225 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:11.894908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7c519249-2a1b-46f8-9890-956b72143225 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043598 Mar 08 04:26:11.896110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 503/1013] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:11.977243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-909ee7df-69ca-4ccd-885a-7c4ca57a5021 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:11.984445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-909ee7df-69ca-4ccd-885a-7c4ca57a5021 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158213 Mar 08 04:26:11.984999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 511/1014] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:11 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:12.638406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-73218841-d78d-4f44-a49b-6769f27cca2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:12.639310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-73218841-d78d-4f44-a49b-6769f27cca2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:12.645017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73218841-d78d-4f44-a49b-6769f27cca2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:12.645463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73218841-d78d-4f44-a49b-6769f27cca2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:12.646332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73218841-d78d-4f44-a49b-6769f27cca2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:12.646691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73218841-d78d-4f44-a49b-6769f27cca2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:12.674323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-73218841-d78d-4f44-a49b-6769f27cca2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039962 Mar 08 04:26:12.674855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 504/1015] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:12.907878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a760f19d-3341-4718-97af-a738d3ccd40e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:12.908717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a760f19d-3341-4718-97af-a738d3ccd40e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:12.915990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a760f19d-3341-4718-97af-a738d3ccd40e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:12.916434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a760f19d-3341-4718-97af-a738d3ccd40e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:12.917183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a760f19d-3341-4718-97af-a738d3ccd40e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:12.917611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a760f19d-3341-4718-97af-a738d3ccd40e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:12.945208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a760f19d-3341-4718-97af-a738d3ccd40e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041780 Mar 08 04:26:12.945780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 512/1016] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:13.001082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2626e324-1fa4-4a13-ad0d-ce39f1a7e18d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:13.001746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2626e324-1fa4-4a13-ad0d-ce39f1a7e18d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:13.007933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2626e324-1fa4-4a13-ad0d-ce39f1a7e18d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:13.008380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2626e324-1fa4-4a13-ad0d-ce39f1a7e18d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:13.009151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2626e324-1fa4-4a13-ad0d-ce39f1a7e18d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:13.009586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2626e324-1fa4-4a13-ad0d-ce39f1a7e18d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:13.143346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2626e324-1fa4-4a13-ad0d-ce39f1a7e18d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:13.151535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2626e324-1fa4-4a13-ad0d-ce39f1a7e18d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154293 Mar 08 04:26:13.152391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 505/1017] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:12 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:13.687357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bd29d44c-afc9-4f62-a9d7-86db863a99ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:13.688308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bd29d44c-afc9-4f62-a9d7-86db863a99ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:13.694963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd29d44c-afc9-4f62-a9d7-86db863a99ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:13.695405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd29d44c-afc9-4f62-a9d7-86db863a99ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:13.696160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd29d44c-afc9-4f62-a9d7-86db863a99ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:13.696593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd29d44c-afc9-4f62-a9d7-86db863a99ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:13.724655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bd29d44c-afc9-4f62-a9d7-86db863a99ea tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 Mar 08 04:26:13.725381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 513/1018] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:13.957337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-750367a2-3cc4-477d-afb6-e43c805b9ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:13.958235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-750367a2-3cc4-477d-afb6-e43c805b9ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:13.964066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-750367a2-3cc4-477d-afb6-e43c805b9ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:13.964513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-750367a2-3cc4-477d-afb6-e43c805b9ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:13.965271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-750367a2-3cc4-477d-afb6-e43c805b9ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:13.965728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-750367a2-3cc4-477d-afb6-e43c805b9ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:13.993901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-750367a2-3cc4-477d-afb6-e43c805b9ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040396 Mar 08 04:26:13.994448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 506/1019] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:14.168545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cdedec32-21aa-4dd3-bb4f-1c1a9800c889 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:14.169186 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cdedec32-21aa-4dd3-bb4f-1c1a9800c889 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:14.175448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cdedec32-21aa-4dd3-bb4f-1c1a9800c889 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:14.175897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cdedec32-21aa-4dd3-bb4f-1c1a9800c889 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:14.176658 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cdedec32-21aa-4dd3-bb4f-1c1a9800c889 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:14.177846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cdedec32-21aa-4dd3-bb4f-1c1a9800c889 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:14.317068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cdedec32-21aa-4dd3-bb4f-1c1a9800c889 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:14.324340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cdedec32-21aa-4dd3-bb4f-1c1a9800c889 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.159553 Mar 08 04:26:14.324785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 514/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:14 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:14.735852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e1458c3d-cc09-4c44-a335-f47f29547340 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:14.736747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e1458c3d-cc09-4c44-a335-f47f29547340 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:14.742971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1458c3d-cc09-4c44-a335-f47f29547340 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:14.743416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1458c3d-cc09-4c44-a335-f47f29547340 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:14.744163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1458c3d-cc09-4c44-a335-f47f29547340 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:14.744597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1458c3d-cc09-4c44-a335-f47f29547340 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:14.773476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e1458c3d-cc09-4c44-a335-f47f29547340 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041562 Mar 08 04:26:14.774043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 507/1021] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:15.005925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5c7b7799-4635-4eb5-a3c8-d18b7bcc0566 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:15.006768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5c7b7799-4635-4eb5-a3c8-d18b7bcc0566 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:15.012689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c7b7799-4635-4eb5-a3c8-d18b7bcc0566 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:15.013144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c7b7799-4635-4eb5-a3c8-d18b7bcc0566 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:15.013931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c7b7799-4635-4eb5-a3c8-d18b7bcc0566 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:15.014370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c7b7799-4635-4eb5-a3c8-d18b7bcc0566 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:15.042237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5c7b7799-4635-4eb5-a3c8-d18b7bcc0566 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040902 Mar 08 04:26:15.042778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 515/1022] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:15.340305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4ed91569-c4e9-474e-ac74-015a33afe0e4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:15.340827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4ed91569-c4e9-474e-ac74-015a33afe0e4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:15.346770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ed91569-c4e9-474e-ac74-015a33afe0e4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:15.347212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ed91569-c4e9-474e-ac74-015a33afe0e4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:15.347965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ed91569-c4e9-474e-ac74-015a33afe0e4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:15.348393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ed91569-c4e9-474e-ac74-015a33afe0e4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:15.479336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4ed91569-c4e9-474e-ac74-015a33afe0e4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:15.486524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4ed91569-c4e9-474e-ac74-015a33afe0e4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150122 Mar 08 04:26:15.487219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 508/1023] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:15 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:15.785334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1b577df4-9f16-4637-aa79-abd3b9d7f31c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:15.786310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1b577df4-9f16-4637-aa79-abd3b9d7f31c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:15.792615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b577df4-9f16-4637-aa79-abd3b9d7f31c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:15.793063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b577df4-9f16-4637-aa79-abd3b9d7f31c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:15.793866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b577df4-9f16-4637-aa79-abd3b9d7f31c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:15.794297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b577df4-9f16-4637-aa79-abd3b9d7f31c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:15.822417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1b577df4-9f16-4637-aa79-abd3b9d7f31c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040897 Mar 08 04:26:15.822979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 516/1024] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:16.054343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-31a48af6-973f-4363-a433-e62f95b62484 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:16.055157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-31a48af6-973f-4363-a433-e62f95b62484 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:16.061406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31a48af6-973f-4363-a433-e62f95b62484 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:16.061886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31a48af6-973f-4363-a433-e62f95b62484 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:16.062639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31a48af6-973f-4363-a433-e62f95b62484 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:16.063072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31a48af6-973f-4363-a433-e62f95b62484 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:16.090961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-31a48af6-973f-4363-a433-e62f95b62484 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041228 Mar 08 04:26:16.091507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 509/1025] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:16.503688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c6d1c402-0162-4b6a-9e9d-2d9d1af57153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:16.504298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c6d1c402-0162-4b6a-9e9d-2d9d1af57153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:16.510229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6d1c402-0162-4b6a-9e9d-2d9d1af57153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:16.510676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6d1c402-0162-4b6a-9e9d-2d9d1af57153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:16.511435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6d1c402-0162-4b6a-9e9d-2d9d1af57153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:16.511867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c6d1c402-0162-4b6a-9e9d-2d9d1af57153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:16.649583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c6d1c402-0162-4b6a-9e9d-2d9d1af57153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:16.657062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c6d1c402-0162-4b6a-9e9d-2d9d1af57153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157223 Mar 08 04:26:16.657623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 517/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:16.835485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-19175e3b-54a3-4b85-84b8-e2de55f0bca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:16.836316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-19175e3b-54a3-4b85-84b8-e2de55f0bca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:16.842142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19175e3b-54a3-4b85-84b8-e2de55f0bca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:16.842594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19175e3b-54a3-4b85-84b8-e2de55f0bca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:16.843357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19175e3b-54a3-4b85-84b8-e2de55f0bca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:16.843824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19175e3b-54a3-4b85-84b8-e2de55f0bca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:16.872474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-19175e3b-54a3-4b85-84b8-e2de55f0bca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 Mar 08 04:26:16.873026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 510/1027] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:16 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:17.102430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d99d5ed3-54dd-46c1-9787-13908021a31f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:17.103256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d99d5ed3-54dd-46c1-9787-13908021a31f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:17.109517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d99d5ed3-54dd-46c1-9787-13908021a31f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:17.109999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d99d5ed3-54dd-46c1-9787-13908021a31f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:17.110752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d99d5ed3-54dd-46c1-9787-13908021a31f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:17.111249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d99d5ed3-54dd-46c1-9787-13908021a31f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:17.139479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d99d5ed3-54dd-46c1-9787-13908021a31f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041108 Mar 08 04:26:17.140047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 518/1028] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:17.675004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-97e05488-d3d6-436a-9fdf-b4d7d223c8bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:17.675603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-97e05488-d3d6-436a-9fdf-b4d7d223c8bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:17.682321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97e05488-d3d6-436a-9fdf-b4d7d223c8bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:17.682765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97e05488-d3d6-436a-9fdf-b4d7d223c8bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:17.683519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97e05488-d3d6-436a-9fdf-b4d7d223c8bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:17.683954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-97e05488-d3d6-436a-9fdf-b4d7d223c8bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:17.812898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-97e05488-d3d6-436a-9fdf-b4d7d223c8bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:17.820885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-97e05488-d3d6-436a-9fdf-b4d7d223c8bd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149700 Mar 08 04:26:17.821477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 511/1029] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:17 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:17.883935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-687e7e3e-5b18-42e3-ae5f-633b18b5bdf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:17.884896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-687e7e3e-5b18-42e3-ae5f-633b18b5bdf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:17.892258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-687e7e3e-5b18-42e3-ae5f-633b18b5bdf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:17.892705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-687e7e3e-5b18-42e3-ae5f-633b18b5bdf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:17.893456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-687e7e3e-5b18-42e3-ae5f-633b18b5bdf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:17.893913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-687e7e3e-5b18-42e3-ae5f-633b18b5bdf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:17.922587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-687e7e3e-5b18-42e3-ae5f-633b18b5bdf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042677 Mar 08 04:26:17.923119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 519/1030] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:18.151023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1f849d5f-4557-414b-9121-8401fdfdacbb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:18.151873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1f849d5f-4557-414b-9121-8401fdfdacbb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:18.157929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f849d5f-4557-414b-9121-8401fdfdacbb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:18.158376 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f849d5f-4557-414b-9121-8401fdfdacbb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:18.159136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f849d5f-4557-414b-9121-8401fdfdacbb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:18.159568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f849d5f-4557-414b-9121-8401fdfdacbb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:18.188547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1f849d5f-4557-414b-9121-8401fdfdacbb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041524 Mar 08 04:26:18.189095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 512/1031] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:18.838649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-489c98d8-22d1-44af-bbbc-78bd28edcdf2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:18.839259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-489c98d8-22d1-44af-bbbc-78bd28edcdf2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:18.845440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-489c98d8-22d1-44af-bbbc-78bd28edcdf2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:18.845919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-489c98d8-22d1-44af-bbbc-78bd28edcdf2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:18.846680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-489c98d8-22d1-44af-bbbc-78bd28edcdf2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:18.847112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-489c98d8-22d1-44af-bbbc-78bd28edcdf2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:18.933957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2ed952ff-5437-4f04-bd43-ceecde99d9bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:18.935079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2ed952ff-5437-4f04-bd43-ceecde99d9bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:18.941517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ed952ff-5437-4f04-bd43-ceecde99d9bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:18.942078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ed952ff-5437-4f04-bd43-ceecde99d9bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:18.943861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ed952ff-5437-4f04-bd43-ceecde99d9bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:18.944291 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ed952ff-5437-4f04-bd43-ceecde99d9bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:18.971967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2ed952ff-5437-4f04-bd43-ceecde99d9bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041889 Mar 08 04:26:18.972525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 513/1032] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:18.978741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-489c98d8-22d1-44af-bbbc-78bd28edcdf2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:18.985972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-489c98d8-22d1-44af-bbbc-78bd28edcdf2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151168 Mar 08 04:26:18.986530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 520/1033] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:18 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:26:19.200264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-51a5b884-6f4c-4ae8-b679-9b317959eae4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:19.201172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-51a5b884-6f4c-4ae8-b679-9b317959eae4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:19.207036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-51a5b884-6f4c-4ae8-b679-9b317959eae4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:19.207489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-51a5b884-6f4c-4ae8-b679-9b317959eae4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:19.208794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-51a5b884-6f4c-4ae8-b679-9b317959eae4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:19.209200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-51a5b884-6f4c-4ae8-b679-9b317959eae4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:19.236680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-51a5b884-6f4c-4ae8-b679-9b317959eae4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040702 Mar 08 04:26:19.237223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 514/1034] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:19.983767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8d670f43-3ab9-415e-896d-297d25509c09 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:19.984678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8d670f43-3ab9-415e-896d-297d25509c09 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:19.991920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d670f43-3ab9-415e-896d-297d25509c09 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:19.992367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d670f43-3ab9-415e-896d-297d25509c09 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:19.993134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d670f43-3ab9-415e-896d-297d25509c09 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:19.993574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d670f43-3ab9-415e-896d-297d25509c09 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:20.003252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-41f7bdd3-a7b8-456d-a748-0c74e862ab4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:20.003857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-41f7bdd3-a7b8-456d-a748-0c74e862ab4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:20.012126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41f7bdd3-a7b8-456d-a748-0c74e862ab4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:20.012563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41f7bdd3-a7b8-456d-a748-0c74e862ab4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:20.013330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41f7bdd3-a7b8-456d-a748-0c74e862ab4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:20.013790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41f7bdd3-a7b8-456d-a748-0c74e862ab4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:20.023369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8d670f43-3ab9-415e-896d-297d25509c09 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Mar 08 04:26:20.023919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 521/1035] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:20.148097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-41f7bdd3-a7b8-456d-a748-0c74e862ab4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:20.155570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-41f7bdd3-a7b8-456d-a748-0c74e862ab4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156063 Mar 08 04:26:20.156118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 515/1036] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:26:20.248026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b5e813ab-fae9-453c-b5fd-160a9285a0b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:20.248932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b5e813ab-fae9-453c-b5fd-160a9285a0b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:20.255350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5e813ab-fae9-453c-b5fd-160a9285a0b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:20.255969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5e813ab-fae9-453c-b5fd-160a9285a0b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:20.256736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5e813ab-fae9-453c-b5fd-160a9285a0b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:20.257168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5e813ab-fae9-453c-b5fd-160a9285a0b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:20.285105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b5e813ab-fae9-453c-b5fd-160a9285a0b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041064 Mar 08 04:26:20.285644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 522/1037] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:21.035062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-425b9ecb-be45-4bc0-8d06-268675a5812d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:21.036429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-425b9ecb-be45-4bc0-8d06-268675a5812d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:21.042778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-425b9ecb-be45-4bc0-8d06-268675a5812d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:21.043229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-425b9ecb-be45-4bc0-8d06-268675a5812d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:21.043994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-425b9ecb-be45-4bc0-8d06-268675a5812d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:21.044431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-425b9ecb-be45-4bc0-8d06-268675a5812d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:21.072356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-425b9ecb-be45-4bc0-8d06-268675a5812d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Mar 08 04:26:21.072901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 516/1038] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:21 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:21.172310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-92e2b37d-a71b-4e7d-8d56-a807778aaeba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:21.172972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-92e2b37d-a71b-4e7d-8d56-a807778aaeba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:21.179898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92e2b37d-a71b-4e7d-8d56-a807778aaeba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:21.180348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92e2b37d-a71b-4e7d-8d56-a807778aaeba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:21.181110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92e2b37d-a71b-4e7d-8d56-a807778aaeba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:21.181546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92e2b37d-a71b-4e7d-8d56-a807778aaeba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:21.296484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8b6a56ed-60a8-4444-83f2-df1ee3c6d27e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:21.297428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8b6a56ed-60a8-4444-83f2-df1ee3c6d27e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:21.303235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8b6a56ed-60a8-4444-83f2-df1ee3c6d27e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:21.303684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8b6a56ed-60a8-4444-83f2-df1ee3c6d27e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:21.304451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8b6a56ed-60a8-4444-83f2-df1ee3c6d27e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:21.304885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8b6a56ed-60a8-4444-83f2-df1ee3c6d27e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:21.311420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-92e2b37d-a71b-4e7d-8d56-a807778aaeba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:21.318848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-92e2b37d-a71b-4e7d-8d56-a807778aaeba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150367 Mar 08 04:26:21.319411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 523/1039] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:21 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:21.334428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8b6a56ed-60a8-4444-83f2-df1ee3c6d27e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041781 Mar 08 04:26:21.334976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 517/1040] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:22.084283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0f920a63-1101-4b40-97bc-90e18215c1ee tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:22.085102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0f920a63-1101-4b40-97bc-90e18215c1ee tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:22.091027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f920a63-1101-4b40-97bc-90e18215c1ee tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:22.091467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f920a63-1101-4b40-97bc-90e18215c1ee tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:22.092218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f920a63-1101-4b40-97bc-90e18215c1ee tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:22.092645 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f920a63-1101-4b40-97bc-90e18215c1ee tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:22.120194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0f920a63-1101-4b40-97bc-90e18215c1ee tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040301 Mar 08 04:26:22.120726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 524/1041] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:22.335722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-91d972ae-1b61-41aa-ae69-eac3bfbf1f08 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:22.336247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-91d972ae-1b61-41aa-ae69-eac3bfbf1f08 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:22.342612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d972ae-1b61-41aa-ae69-eac3bfbf1f08 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:22.343066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d972ae-1b61-41aa-ae69-eac3bfbf1f08 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:22.343843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d972ae-1b61-41aa-ae69-eac3bfbf1f08 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:22.344281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d972ae-1b61-41aa-ae69-eac3bfbf1f08 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:22.345891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a404fb76-9d49-4486-8fdd-2dadadeef4d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:22.346829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a404fb76-9d49-4486-8fdd-2dadadeef4d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:22.353607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a404fb76-9d49-4486-8fdd-2dadadeef4d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:22.354112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a404fb76-9d49-4486-8fdd-2dadadeef4d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:22.354880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a404fb76-9d49-4486-8fdd-2dadadeef4d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:22.355312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a404fb76-9d49-4486-8fdd-2dadadeef4d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:22.383605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a404fb76-9d49-4486-8fdd-2dadadeef4d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041805 Mar 08 04:26:22.384163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 525/1042] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:22.483040 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-91d972ae-1b61-41aa-ae69-eac3bfbf1f08 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:22.490973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-91d972ae-1b61-41aa-ae69-eac3bfbf1f08 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.159224 Mar 08 04:26:22.491537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 518/1043] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:22 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:23.132236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3a3899a6-fe12-4670-b914-841df3df8893 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:23.133151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3a3899a6-fe12-4670-b914-841df3df8893 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:23.139104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a3899a6-fe12-4670-b914-841df3df8893 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:23.139547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a3899a6-fe12-4670-b914-841df3df8893 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:23.140322 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a3899a6-fe12-4670-b914-841df3df8893 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:23.140750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a3899a6-fe12-4670-b914-841df3df8893 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:23.169266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3a3899a6-fe12-4670-b914-841df3df8893 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041944 Mar 08 04:26:23.169812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 526/1044] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:23.395178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b6748f97-3a5d-42c3-8f8b-e705b3da91c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:23.396017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b6748f97-3a5d-42c3-8f8b-e705b3da91c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:23.402581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b6748f97-3a5d-42c3-8f8b-e705b3da91c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:23.403032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b6748f97-3a5d-42c3-8f8b-e705b3da91c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:23.403798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b6748f97-3a5d-42c3-8f8b-e705b3da91c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:23.404249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b6748f97-3a5d-42c3-8f8b-e705b3da91c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:23.432315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b6748f97-3a5d-42c3-8f8b-e705b3da91c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041198 Mar 08 04:26:23.432852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 519/1045] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:23.507971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6b48c0cb-8829-4184-a5d2-11a789d04479 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:23.508578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6b48c0cb-8829-4184-a5d2-11a789d04479 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:23.514812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b48c0cb-8829-4184-a5d2-11a789d04479 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:23.515258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b48c0cb-8829-4184-a5d2-11a789d04479 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:23.516020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b48c0cb-8829-4184-a5d2-11a789d04479 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:23.516456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b48c0cb-8829-4184-a5d2-11a789d04479 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:23.646420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6b48c0cb-8829-4184-a5d2-11a789d04479 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:23.653807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6b48c0cb-8829-4184-a5d2-11a789d04479 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149943 Mar 08 04:26:23.654367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 527/1046] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:24.181070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6f19d5d0-6ca2-4919-85c4-d03646073054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:24.181993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6f19d5d0-6ca2-4919-85c4-d03646073054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:24.187775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f19d5d0-6ca2-4919-85c4-d03646073054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:24.188219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f19d5d0-6ca2-4919-85c4-d03646073054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:24.188968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f19d5d0-6ca2-4919-85c4-d03646073054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:24.189403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f19d5d0-6ca2-4919-85c4-d03646073054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:24.217009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6f19d5d0-6ca2-4919-85c4-d03646073054 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040398 Mar 08 04:26:24.217544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 520/1047] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:24 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:24.444610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-10a2936b-301e-42e9-85b9-f6048977ab6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:24.445435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-10a2936b-301e-42e9-85b9-f6048977ab6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:24.451317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10a2936b-301e-42e9-85b9-f6048977ab6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:24.451763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10a2936b-301e-42e9-85b9-f6048977ab6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:24.452517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10a2936b-301e-42e9-85b9-f6048977ab6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:24.452947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10a2936b-301e-42e9-85b9-f6048977ab6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:24.480306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-10a2936b-301e-42e9-85b9-f6048977ab6e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040404 Mar 08 04:26:24.484052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 528/1048] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:24.671151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4448fc3a-ac8d-43e1-a2bf-40a376265100 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:24.671758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4448fc3a-ac8d-43e1-a2bf-40a376265100 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:24.679752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4448fc3a-ac8d-43e1-a2bf-40a376265100 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:24.680126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4448fc3a-ac8d-43e1-a2bf-40a376265100 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:24.680899 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4448fc3a-ac8d-43e1-a2bf-40a376265100 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:24.681341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4448fc3a-ac8d-43e1-a2bf-40a376265100 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:24.821139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4448fc3a-ac8d-43e1-a2bf-40a376265100 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:24.828474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4448fc3a-ac8d-43e1-a2bf-40a376265100 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.161198 Mar 08 04:26:24.829025 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 521/1049] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:24 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:25.228853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-58840809-2aa6-4a89-b7ab-eecad249f777 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:25.229791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-58840809-2aa6-4a89-b7ab-eecad249f777 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:25.236024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58840809-2aa6-4a89-b7ab-eecad249f777 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:25.236466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58840809-2aa6-4a89-b7ab-eecad249f777 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:25.237215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58840809-2aa6-4a89-b7ab-eecad249f777 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:25.237642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58840809-2aa6-4a89-b7ab-eecad249f777 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:25.264586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-58840809-2aa6-4a89-b7ab-eecad249f777 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039726 Mar 08 04:26:25.265127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 529/1050] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:25 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:25.491230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0a58e9fe-6d77-4443-bfb9-5dbffdfbd1a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:25.492060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0a58e9fe-6d77-4443-bfb9-5dbffdfbd1a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:25.497847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a58e9fe-6d77-4443-bfb9-5dbffdfbd1a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:25.498294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a58e9fe-6d77-4443-bfb9-5dbffdfbd1a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:25.499047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a58e9fe-6d77-4443-bfb9-5dbffdfbd1a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:25.499478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a58e9fe-6d77-4443-bfb9-5dbffdfbd1a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:25.527371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0a58e9fe-6d77-4443-bfb9-5dbffdfbd1a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040056 Mar 08 04:26:25.527898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 522/1051] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:25.845714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ead319b3-847a-4372-8651-e50ac0904ab9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:25.846293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ead319b3-847a-4372-8651-e50ac0904ab9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:25.852372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ead319b3-847a-4372-8651-e50ac0904ab9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:25.852818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ead319b3-847a-4372-8651-e50ac0904ab9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:25.853579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ead319b3-847a-4372-8651-e50ac0904ab9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:25.854031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ead319b3-847a-4372-8651-e50ac0904ab9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:25.986081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ead319b3-847a-4372-8651-e50ac0904ab9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:25.993973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ead319b3-847a-4372-8651-e50ac0904ab9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152082 Mar 08 04:26:25.994538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 530/1052] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:26.276124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e58f2d4a-7f24-4498-9d84-f589cd123a0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:26.277299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e58f2d4a-7f24-4498-9d84-f589cd123a0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:26.283572 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e58f2d4a-7f24-4498-9d84-f589cd123a0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:26.284021 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e58f2d4a-7f24-4498-9d84-f589cd123a0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:26.284787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e58f2d4a-7f24-4498-9d84-f589cd123a0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:26.285229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e58f2d4a-7f24-4498-9d84-f589cd123a0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:26.315636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e58f2d4a-7f24-4498-9d84-f589cd123a0e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 Mar 08 04:26:26.316204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 523/1053] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:26.539724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7f5d28a7-48d4-484b-9efa-bf34ce7db96f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:26.540615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7f5d28a7-48d4-484b-9efa-bf34ce7db96f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:26.547158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f5d28a7-48d4-484b-9efa-bf34ce7db96f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:26.547598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f5d28a7-48d4-484b-9efa-bf34ce7db96f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:26.548352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f5d28a7-48d4-484b-9efa-bf34ce7db96f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:26.548781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f5d28a7-48d4-484b-9efa-bf34ce7db96f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:26.577479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7f5d28a7-48d4-484b-9efa-bf34ce7db96f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042661 Mar 08 04:26:26.578041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 531/1054] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:27.010928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-87f4f61f-fec7-4734-8438-2dc855083de5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:27.011543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-87f4f61f-fec7-4734-8438-2dc855083de5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:27.017445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87f4f61f-fec7-4734-8438-2dc855083de5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:27.017920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87f4f61f-fec7-4734-8438-2dc855083de5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:27.018687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87f4f61f-fec7-4734-8438-2dc855083de5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:27.019125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87f4f61f-fec7-4734-8438-2dc855083de5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:27.149919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-87f4f61f-fec7-4734-8438-2dc855083de5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:27.157359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-87f4f61f-fec7-4734-8438-2dc855083de5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150214 Mar 08 04:26:27.157960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 524/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:27 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:27.326933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-988adbbc-c525-4ff8-89f8-d00c75f89d02 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:27.327888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-988adbbc-c525-4ff8-89f8-d00c75f89d02 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:27.333828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-988adbbc-c525-4ff8-89f8-d00c75f89d02 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:27.334270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-988adbbc-c525-4ff8-89f8-d00c75f89d02 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:27.335018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-988adbbc-c525-4ff8-89f8-d00c75f89d02 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:27.335446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-988adbbc-c525-4ff8-89f8-d00c75f89d02 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:27.362315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-988adbbc-c525-4ff8-89f8-d00c75f89d02 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039274 Mar 08 04:26:27.362843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 532/1056] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:27 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:27.588855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4c3cc354-70e3-47dd-80b0-8c409f76ea75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:27.589798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4c3cc354-70e3-47dd-80b0-8c409f76ea75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:27.596110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c3cc354-70e3-47dd-80b0-8c409f76ea75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:27.596566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c3cc354-70e3-47dd-80b0-8c409f76ea75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:27.597333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c3cc354-70e3-47dd-80b0-8c409f76ea75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:27.597815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c3cc354-70e3-47dd-80b0-8c409f76ea75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:27.626368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4c3cc354-70e3-47dd-80b0-8c409f76ea75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 Mar 08 04:26:27.626912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 525/1057] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:28.174261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-000067b0-8839-4c3a-bf1a-7951a9a1cad3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:28.174871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-000067b0-8839-4c3a-bf1a-7951a9a1cad3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:28.181215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-000067b0-8839-4c3a-bf1a-7951a9a1cad3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:28.181672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-000067b0-8839-4c3a-bf1a-7951a9a1cad3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:28.182450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-000067b0-8839-4c3a-bf1a-7951a9a1cad3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:28.182887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-000067b0-8839-4c3a-bf1a-7951a9a1cad3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:28.374587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e9f915c8-db91-4991-860f-1d1b8bc554fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:28.375521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e9f915c8-db91-4991-860f-1d1b8bc554fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:28.382161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9f915c8-db91-4991-860f-1d1b8bc554fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:28.382617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9f915c8-db91-4991-860f-1d1b8bc554fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:28.383412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9f915c8-db91-4991-860f-1d1b8bc554fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:28.383855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9f915c8-db91-4991-860f-1d1b8bc554fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:28.414290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e9f915c8-db91-4991-860f-1d1b8bc554fb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043583 Mar 08 04:26:28.414868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 526/1058] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:28.524074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-000067b0-8839-4c3a-bf1a-7951a9a1cad3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:28.531492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-000067b0-8839-4c3a-bf1a-7951a9a1cad3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.361034 Mar 08 04:26:28.532040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 533/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:28 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:28.637741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ffab82ed-ec51-42c4-b6a2-aa85a5531cd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:28.638641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ffab82ed-ec51-42c4-b6a2-aa85a5531cd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:28.645042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ffab82ed-ec51-42c4-b6a2-aa85a5531cd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:28.645802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ffab82ed-ec51-42c4-b6a2-aa85a5531cd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:28.646586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ffab82ed-ec51-42c4-b6a2-aa85a5531cd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:28.647028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ffab82ed-ec51-42c4-b6a2-aa85a5531cd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:28.677094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ffab82ed-ec51-42c4-b6a2-aa85a5531cd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042554 Mar 08 04:26:28.677884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 527/1060] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:29.425922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7ffe0c91-b7f1-482c-bc34-b33e98b822ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:29.427510 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7ffe0c91-b7f1-482c-bc34-b33e98b822ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:29.433754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ffe0c91-b7f1-482c-bc34-b33e98b822ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:29.434215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ffe0c91-b7f1-482c-bc34-b33e98b822ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:29.434983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ffe0c91-b7f1-482c-bc34-b33e98b822ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:29.435424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ffe0c91-b7f1-482c-bc34-b33e98b822ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:29.463482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7ffe0c91-b7f1-482c-bc34-b33e98b822ad tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041547 Mar 08 04:26:29.464024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 534/1061] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:29 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:29.548128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8c0bd956-b598-4168-9930-eb2150e2f222 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:29.548730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8c0bd956-b598-4168-9930-eb2150e2f222 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:29.554526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c0bd956-b598-4168-9930-eb2150e2f222 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:29.554966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c0bd956-b598-4168-9930-eb2150e2f222 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:29.555724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c0bd956-b598-4168-9930-eb2150e2f222 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:29.556161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c0bd956-b598-4168-9930-eb2150e2f222 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:29.685580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8c0bd956-b598-4168-9930-eb2150e2f222 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:29.688632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a2a1bab6-54ca-46a9-b7d5-1dbd2057d7b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:29.690208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a2a1bab6-54ca-46a9-b7d5-1dbd2057d7b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:29.693799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8c0bd956-b598-4168-9930-eb2150e2f222 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149417 Mar 08 04:26:29.694709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 528/1062] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:29 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:29.699387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2a1bab6-54ca-46a9-b7d5-1dbd2057d7b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:29.699834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2a1bab6-54ca-46a9-b7d5-1dbd2057d7b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:29.700614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2a1bab6-54ca-46a9-b7d5-1dbd2057d7b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:29.701050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2a1bab6-54ca-46a9-b7d5-1dbd2057d7b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:29.732603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a2a1bab6-54ca-46a9-b7d5-1dbd2057d7b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047997 Mar 08 04:26:29.733365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 535/1063] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:30.475242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-278d0631-796c-4469-9451-0f12d368111e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:30.476144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-278d0631-796c-4469-9451-0f12d368111e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:30.482008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-278d0631-796c-4469-9451-0f12d368111e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:30.482459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-278d0631-796c-4469-9451-0f12d368111e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:30.483221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-278d0631-796c-4469-9451-0f12d368111e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:30.483656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-278d0631-796c-4469-9451-0f12d368111e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:30.510671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-278d0631-796c-4469-9451-0f12d368111e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039948 Mar 08 04:26:30.511210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 529/1064] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:30 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:30.711198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9cb68388-dca0-4a3c-bbbe-4f93c513f04c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:30.711800 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9cb68388-dca0-4a3c-bbbe-4f93c513f04c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:30.718194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9cb68388-dca0-4a3c-bbbe-4f93c513f04c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:30.718648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9cb68388-dca0-4a3c-bbbe-4f93c513f04c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:30.719413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9cb68388-dca0-4a3c-bbbe-4f93c513f04c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:30.719883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9cb68388-dca0-4a3c-bbbe-4f93c513f04c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:30.744225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fe34e115-0581-4727-a956-92d080467774 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:30.745186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fe34e115-0581-4727-a956-92d080467774 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:30.751425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe34e115-0581-4727-a956-92d080467774 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:30.751867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe34e115-0581-4727-a956-92d080467774 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:30.752629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe34e115-0581-4727-a956-92d080467774 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:30.753063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe34e115-0581-4727-a956-92d080467774 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:30.782918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fe34e115-0581-4727-a956-92d080467774 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042543 Mar 08 04:26:30.783473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 530/1065] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:30.858715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9cb68388-dca0-4a3c-bbbe-4f93c513f04c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:30.866331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9cb68388-dca0-4a3c-bbbe-4f93c513f04c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.159462 Mar 08 04:26:30.866945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 536/1066] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:30 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:31.522487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3e424592-4ace-4ea2-8598-303347654258 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:31.523545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3e424592-4ace-4ea2-8598-303347654258 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:31.529748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e424592-4ace-4ea2-8598-303347654258 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:31.530197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e424592-4ace-4ea2-8598-303347654258 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:31.530960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e424592-4ace-4ea2-8598-303347654258 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:31.531399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e424592-4ace-4ea2-8598-303347654258 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:31.559722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3e424592-4ace-4ea2-8598-303347654258 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041185 Mar 08 04:26:31.560262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 531/1067] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:31.794102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f9306421-0c06-4d36-b6e3-26118c2cfb3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:31.794924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f9306421-0c06-4d36-b6e3-26118c2cfb3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:31.801310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9306421-0c06-4d36-b6e3-26118c2cfb3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:31.801818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9306421-0c06-4d36-b6e3-26118c2cfb3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:31.802603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9306421-0c06-4d36-b6e3-26118c2cfb3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:31.803037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9306421-0c06-4d36-b6e3-26118c2cfb3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:31.831507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f9306421-0c06-4d36-b6e3-26118c2cfb3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041370 Mar 08 04:26:31.832914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 537/1068] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:31.883202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9021b59f-b710-4b7c-a972-e2c0492535ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:31.883805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9021b59f-b710-4b7c-a972-e2c0492535ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:31.890020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9021b59f-b710-4b7c-a972-e2c0492535ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:31.890458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9021b59f-b710-4b7c-a972-e2c0492535ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:31.891216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9021b59f-b710-4b7c-a972-e2c0492535ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:31.891644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9021b59f-b710-4b7c-a972-e2c0492535ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:32.022313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9021b59f-b710-4b7c-a972-e2c0492535ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:32.029749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9021b59f-b710-4b7c-a972-e2c0492535ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150349 Mar 08 04:26:32.030307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 532/1069] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:31 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:32.571788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4c3ae585-aa1a-4f1e-863f-22b8b2da16c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:32.572693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4c3ae585-aa1a-4f1e-863f-22b8b2da16c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:32.578600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c3ae585-aa1a-4f1e-863f-22b8b2da16c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:32.579057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c3ae585-aa1a-4f1e-863f-22b8b2da16c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:32.579817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c3ae585-aa1a-4f1e-863f-22b8b2da16c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:32.580258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c3ae585-aa1a-4f1e-863f-22b8b2da16c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:32.608470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4c3ae585-aa1a-4f1e-863f-22b8b2da16c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040747 Mar 08 04:26:32.609005 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 538/1070] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:32.843594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4c7da8a5-82ca-4dc4-af63-a45a7ae6b330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:32.844559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4c7da8a5-82ca-4dc4-af63-a45a7ae6b330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:32.850513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c7da8a5-82ca-4dc4-af63-a45a7ae6b330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:32.850957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c7da8a5-82ca-4dc4-af63-a45a7ae6b330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:32.851721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c7da8a5-82ca-4dc4-af63-a45a7ae6b330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:32.852151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c7da8a5-82ca-4dc4-af63-a45a7ae6b330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:32.880976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4c7da8a5-82ca-4dc4-af63-a45a7ae6b330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041389 Mar 08 04:26:32.881513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 533/1071] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:33.047542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-042d5af8-fa92-4f76-9f69-c940ccb227a3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:33.048157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-042d5af8-fa92-4f76-9f69-c940ccb227a3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:33.054531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-042d5af8-fa92-4f76-9f69-c940ccb227a3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:33.054979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-042d5af8-fa92-4f76-9f69-c940ccb227a3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:33.055748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-042d5af8-fa92-4f76-9f69-c940ccb227a3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:33.056184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-042d5af8-fa92-4f76-9f69-c940ccb227a3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:33.185927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-042d5af8-fa92-4f76-9f69-c940ccb227a3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:33.194945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-042d5af8-fa92-4f76-9f69-c940ccb227a3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151270 Mar 08 04:26:33.195509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 539/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:33 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:33.620112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-541d64f3-9fbf-42e8-a405-00b58e8d97db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:33.621015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-541d64f3-9fbf-42e8-a405-00b58e8d97db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:33.628062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-541d64f3-9fbf-42e8-a405-00b58e8d97db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:33.628501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-541d64f3-9fbf-42e8-a405-00b58e8d97db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:33.629891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-541d64f3-9fbf-42e8-a405-00b58e8d97db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:33.630488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-541d64f3-9fbf-42e8-a405-00b58e8d97db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:33.660366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-541d64f3-9fbf-42e8-a405-00b58e8d97db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Mar 08 04:26:33.661251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 534/1073] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:33.893056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2dc2a56f-f863-4fb8-8a4f-da3dfcd29dca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:33.893999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2dc2a56f-f863-4fb8-8a4f-da3dfcd29dca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:33.900927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2dc2a56f-f863-4fb8-8a4f-da3dfcd29dca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:33.901685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2dc2a56f-f863-4fb8-8a4f-da3dfcd29dca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:33.902783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2dc2a56f-f863-4fb8-8a4f-da3dfcd29dca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:33.903217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2dc2a56f-f863-4fb8-8a4f-da3dfcd29dca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:33.934332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2dc2a56f-f863-4fb8-8a4f-da3dfcd29dca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Mar 08 04:26:33.934891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 540/1074] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:34.212452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f908514c-eae7-4921-b57a-80079e1304ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:34.213052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f908514c-eae7-4921-b57a-80079e1304ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:34.218962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f908514c-eae7-4921-b57a-80079e1304ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:34.219403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f908514c-eae7-4921-b57a-80079e1304ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:34.220157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f908514c-eae7-4921-b57a-80079e1304ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:34.220588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f908514c-eae7-4921-b57a-80079e1304ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:34.361182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f908514c-eae7-4921-b57a-80079e1304ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:34.369215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f908514c-eae7-4921-b57a-80079e1304ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.160584 Mar 08 04:26:34.369800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 535/1075] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:34 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:34.672602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3dde9944-97b9-470d-9503-566245dae121 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:34.673509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3dde9944-97b9-470d-9503-566245dae121 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:34.680332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3dde9944-97b9-470d-9503-566245dae121 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:34.680777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3dde9944-97b9-470d-9503-566245dae121 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:34.681528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3dde9944-97b9-470d-9503-566245dae121 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:34.681983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3dde9944-97b9-470d-9503-566245dae121 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:34.859100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3dde9944-97b9-470d-9503-566245dae121 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190425 Mar 08 04:26:34.859648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 541/1076] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:34 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:34.945869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d98ac86a-4b5f-4934-88c9-56fdd34d72e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:34.946742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d98ac86a-4b5f-4934-88c9-56fdd34d72e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:34.952983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d98ac86a-4b5f-4934-88c9-56fdd34d72e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:34.953428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d98ac86a-4b5f-4934-88c9-56fdd34d72e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:34.954222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d98ac86a-4b5f-4934-88c9-56fdd34d72e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:34.954659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d98ac86a-4b5f-4934-88c9-56fdd34d72e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:34.983242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d98ac86a-4b5f-4934-88c9-56fdd34d72e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041489 Mar 08 04:26:34.983781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 536/1077] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:35.386583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-021dcc88-5352-47de-a9ab-c09c1fd139ef tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:35.387110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-021dcc88-5352-47de-a9ab-c09c1fd139ef tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:35.392947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021dcc88-5352-47de-a9ab-c09c1fd139ef tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:35.393399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021dcc88-5352-47de-a9ab-c09c1fd139ef tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:35.394192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021dcc88-5352-47de-a9ab-c09c1fd139ef tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:35.395284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021dcc88-5352-47de-a9ab-c09c1fd139ef tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:35.524790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-021dcc88-5352-47de-a9ab-c09c1fd139ef tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:35.532348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-021dcc88-5352-47de-a9ab-c09c1fd139ef tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149701 Mar 08 04:26:35.532902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 542/1078] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:35 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:35.870787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-82c50a8c-d16f-46d6-81a9-e8f5f2bb63d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:35.871697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-82c50a8c-d16f-46d6-81a9-e8f5f2bb63d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:35.877498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82c50a8c-d16f-46d6-81a9-e8f5f2bb63d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:35.877979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82c50a8c-d16f-46d6-81a9-e8f5f2bb63d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:35.878746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82c50a8c-d16f-46d6-81a9-e8f5f2bb63d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:35.879918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82c50a8c-d16f-46d6-81a9-e8f5f2bb63d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:35.907803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-82c50a8c-d16f-46d6-81a9-e8f5f2bb63d3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040990 Mar 08 04:26:35.908341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 537/1079] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:35.995365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ef522323-a1a5-4057-9d51-b7d5c40c743b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:35.996278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ef522323-a1a5-4057-9d51-b7d5c40c743b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:36.002902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef522323-a1a5-4057-9d51-b7d5c40c743b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:36.003445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef522323-a1a5-4057-9d51-b7d5c40c743b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:36.004214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef522323-a1a5-4057-9d51-b7d5c40c743b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:36.004658 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef522323-a1a5-4057-9d51-b7d5c40c743b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:36.037295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ef522323-a1a5-4057-9d51-b7d5c40c743b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045995 Mar 08 04:26:36.037860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 543/1080] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:36.549130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5fe16c7b-14b2-4b21-a408-74db8d0ed83b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:36.549757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5fe16c7b-14b2-4b21-a408-74db8d0ed83b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:36.556030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5fe16c7b-14b2-4b21-a408-74db8d0ed83b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:36.556501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5fe16c7b-14b2-4b21-a408-74db8d0ed83b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:36.557257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5fe16c7b-14b2-4b21-a408-74db8d0ed83b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:36.557707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5fe16c7b-14b2-4b21-a408-74db8d0ed83b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:36.693066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5fe16c7b-14b2-4b21-a408-74db8d0ed83b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:36.700420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5fe16c7b-14b2-4b21-a408-74db8d0ed83b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155090 Mar 08 04:26:36.700985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 538/1081] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:36 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:36.918470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e5481cb5-391e-4176-b5b6-5f1e3d9becb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:36.919412 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e5481cb5-391e-4176-b5b6-5f1e3d9becb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:36.925612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5481cb5-391e-4176-b5b6-5f1e3d9becb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:36.926611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5481cb5-391e-4176-b5b6-5f1e3d9becb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:36.927381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5481cb5-391e-4176-b5b6-5f1e3d9becb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:36.927818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5481cb5-391e-4176-b5b6-5f1e3d9becb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:36.955373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e5481cb5-391e-4176-b5b6-5f1e3d9becb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040880 Mar 08 04:26:36.955902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 544/1082] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:37.050341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-35d8c8ca-2165-4122-8e57-335e1fe0d3f7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:37.052444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-35d8c8ca-2165-4122-8e57-335e1fe0d3f7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:37.058697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35d8c8ca-2165-4122-8e57-335e1fe0d3f7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:37.059148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35d8c8ca-2165-4122-8e57-335e1fe0d3f7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:37.059912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35d8c8ca-2165-4122-8e57-335e1fe0d3f7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:37.060461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35d8c8ca-2165-4122-8e57-335e1fe0d3f7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:37.088354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-35d8c8ca-2165-4122-8e57-335e1fe0d3f7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043527 Mar 08 04:26:37.088900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 539/1083] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:37.718199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-432dd525-d553-4154-b8aa-80cc2c46565a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:37.718810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-432dd525-d553-4154-b8aa-80cc2c46565a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:37.725527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-432dd525-d553-4154-b8aa-80cc2c46565a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:37.726012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-432dd525-d553-4154-b8aa-80cc2c46565a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:37.726787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-432dd525-d553-4154-b8aa-80cc2c46565a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:37.727229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-432dd525-d553-4154-b8aa-80cc2c46565a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:37.869455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-432dd525-d553-4154-b8aa-80cc2c46565a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:37.877105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-432dd525-d553-4154-b8aa-80cc2c46565a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.162694 Mar 08 04:26:37.877698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 545/1084] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:37 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:37.966872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-169e3509-63f8-412d-9bfe-59f0b25dfecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:37.967769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-169e3509-63f8-412d-9bfe-59f0b25dfecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:37.974848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-169e3509-63f8-412d-9bfe-59f0b25dfecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:37.975235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-169e3509-63f8-412d-9bfe-59f0b25dfecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:37.975993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-169e3509-63f8-412d-9bfe-59f0b25dfecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:37.976423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-169e3509-63f8-412d-9bfe-59f0b25dfecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:38.003563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-169e3509-63f8-412d-9bfe-59f0b25dfecf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040576 Mar 08 04:26:38.004284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 540/1085] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:38.099844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d648e2c9-d76f-48ea-957d-84548fdb8b58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:38.100747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d648e2c9-d76f-48ea-957d-84548fdb8b58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:38.106982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d648e2c9-d76f-48ea-957d-84548fdb8b58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:38.107461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d648e2c9-d76f-48ea-957d-84548fdb8b58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:38.109636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d648e2c9-d76f-48ea-957d-84548fdb8b58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:38.109636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d648e2c9-d76f-48ea-957d-84548fdb8b58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:38.136309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d648e2c9-d76f-48ea-957d-84548fdb8b58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040529 Mar 08 04:26:38.136836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 546/1086] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:38.894383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-06dc4361-fa56-4172-92b0-6f26c93b579c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:38.895343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-06dc4361-fa56-4172-92b0-6f26c93b579c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:38.901139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06dc4361-fa56-4172-92b0-6f26c93b579c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:38.901589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06dc4361-fa56-4172-92b0-6f26c93b579c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:38.902641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06dc4361-fa56-4172-92b0-6f26c93b579c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:38.903079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06dc4361-fa56-4172-92b0-6f26c93b579c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:39.015088 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-19b0b3da-9f6e-4f1b-94c9-d8c76d31849d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:39.016148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-19b0b3da-9f6e-4f1b-94c9-d8c76d31849d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:39.021963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-19b0b3da-9f6e-4f1b-94c9-d8c76d31849d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:39.022410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-19b0b3da-9f6e-4f1b-94c9-d8c76d31849d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:39.023172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-19b0b3da-9f6e-4f1b-94c9-d8c76d31849d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:39.023603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-19b0b3da-9f6e-4f1b-94c9-d8c76d31849d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:39.036980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-06dc4361-fa56-4172-92b0-6f26c93b579c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:39.044349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-06dc4361-fa56-4172-92b0-6f26c93b579c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153941 Mar 08 04:26:39.044922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 541/1087] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:38 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:39.052913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-19b0b3da-9f6e-4f1b-94c9-d8c76d31849d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041715 Mar 08 04:26:39.053443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 547/1088] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:39.147682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-92fe247f-1abe-4535-a2ca-f3c04547445f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:39.148525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-92fe247f-1abe-4535-a2ca-f3c04547445f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:39.158134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92fe247f-1abe-4535-a2ca-f3c04547445f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:39.158884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92fe247f-1abe-4535-a2ca-f3c04547445f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:39.159954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92fe247f-1abe-4535-a2ca-f3c04547445f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:39.160917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92fe247f-1abe-4535-a2ca-f3c04547445f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:39.189111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-92fe247f-1abe-4535-a2ca-f3c04547445f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Mar 08 04:26:39.189680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 542/1089] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:40.062479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bd84bdac-955e-42d1-b060-82a54ae12e13 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:40.063090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bd84bdac-955e-42d1-b060-82a54ae12e13 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:40.063218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dac0dec3-c8ac-4dbd-bb9a-e5195458b804 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:40.063994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dac0dec3-c8ac-4dbd-bb9a-e5195458b804 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:40.070227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd84bdac-955e-42d1-b060-82a54ae12e13 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:40.070679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd84bdac-955e-42d1-b060-82a54ae12e13 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:40.070796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dac0dec3-c8ac-4dbd-bb9a-e5195458b804 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:40.071125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dac0dec3-c8ac-4dbd-bb9a-e5195458b804 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:40.071455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd84bdac-955e-42d1-b060-82a54ae12e13 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:40.071884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dac0dec3-c8ac-4dbd-bb9a-e5195458b804 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:40.071987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd84bdac-955e-42d1-b060-82a54ae12e13 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:40.072319 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dac0dec3-c8ac-4dbd-bb9a-e5195458b804 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:40.100427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dac0dec3-c8ac-4dbd-bb9a-e5195458b804 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041159 Mar 08 04:26:40.101228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 543/1090] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:40.199757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f87d93d3-d24f-4976-a6cb-22b093ed616c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:40.200703 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f87d93d3-d24f-4976-a6cb-22b093ed616c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:40.201477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bd84bdac-955e-42d1-b060-82a54ae12e13 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:40.206502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f87d93d3-d24f-4976-a6cb-22b093ed616c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:40.206993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f87d93d3-d24f-4976-a6cb-22b093ed616c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:40.207770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f87d93d3-d24f-4976-a6cb-22b093ed616c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:40.208206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f87d93d3-d24f-4976-a6cb-22b093ed616c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:40.208993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bd84bdac-955e-42d1-b060-82a54ae12e13 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150325 Mar 08 04:26:40.209557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 548/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:40 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:40.235774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f87d93d3-d24f-4976-a6cb-22b093ed616c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039956 Mar 08 04:26:40.236295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 544/1092] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:41.112105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9b98f409-ca79-478e-b12d-4a7c0222977f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:41.112948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9b98f409-ca79-478e-b12d-4a7c0222977f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:41.119805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b98f409-ca79-478e-b12d-4a7c0222977f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:41.120256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b98f409-ca79-478e-b12d-4a7c0222977f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:41.121025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b98f409-ca79-478e-b12d-4a7c0222977f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:41.121458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b98f409-ca79-478e-b12d-4a7c0222977f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:41.150662 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9b98f409-ca79-478e-b12d-4a7c0222977f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042604 Mar 08 04:26:41.151235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 549/1093] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:41.226499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f8b28c39-845b-402c-9296-d9dd10d3b0a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:41.227142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f8b28c39-845b-402c-9296-d9dd10d3b0a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:41.233363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8b28c39-845b-402c-9296-d9dd10d3b0a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:41.233859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8b28c39-845b-402c-9296-d9dd10d3b0a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:41.234629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8b28c39-845b-402c-9296-d9dd10d3b0a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:41.235072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8b28c39-845b-402c-9296-d9dd10d3b0a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:41.247683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-df1bb1a0-0c7b-4a7e-9db8-19b9c21393f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:41.248598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-df1bb1a0-0c7b-4a7e-9db8-19b9c21393f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:41.254405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df1bb1a0-0c7b-4a7e-9db8-19b9c21393f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:41.254850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df1bb1a0-0c7b-4a7e-9db8-19b9c21393f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:41.255617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df1bb1a0-0c7b-4a7e-9db8-19b9c21393f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:41.256048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df1bb1a0-0c7b-4a7e-9db8-19b9c21393f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:41.283868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-df1bb1a0-0c7b-4a7e-9db8-19b9c21393f2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040004 Mar 08 04:26:41.284416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 550/1094] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:41.369377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f8b28c39-845b-402c-9296-d9dd10d3b0a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:41.376631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f8b28c39-845b-402c-9296-d9dd10d3b0a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154733 Mar 08 04:26:41.377189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 545/1095] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:41 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:42.162586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b3fd8a11-fdda-46f1-98ff-89d8dc2a5eb3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:42.163520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b3fd8a11-fdda-46f1-98ff-89d8dc2a5eb3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:42.169835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3fd8a11-fdda-46f1-98ff-89d8dc2a5eb3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:42.170279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3fd8a11-fdda-46f1-98ff-89d8dc2a5eb3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:42.171029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3fd8a11-fdda-46f1-98ff-89d8dc2a5eb3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:42.171460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3fd8a11-fdda-46f1-98ff-89d8dc2a5eb3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:42.199851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b3fd8a11-fdda-46f1-98ff-89d8dc2a5eb3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041375 Mar 08 04:26:42.200367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 551/1096] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:42 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:42.295743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-de4679f8-9aab-46c3-a575-e50097d851b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:42.296651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-de4679f8-9aab-46c3-a575-e50097d851b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:42.303471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de4679f8-9aab-46c3-a575-e50097d851b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:42.303918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de4679f8-9aab-46c3-a575-e50097d851b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:42.304678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de4679f8-9aab-46c3-a575-e50097d851b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:42.305114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de4679f8-9aab-46c3-a575-e50097d851b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:42.332592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-de4679f8-9aab-46c3-a575-e50097d851b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040812 Mar 08 04:26:42.333156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 546/1097] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:42.393347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7e89aded-d884-4f6c-a2e3-40e564c07d41 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:42.393970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7e89aded-d884-4f6c-a2e3-40e564c07d41 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:42.399970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e89aded-d884-4f6c-a2e3-40e564c07d41 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:42.400415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e89aded-d884-4f6c-a2e3-40e564c07d41 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:42.401162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e89aded-d884-4f6c-a2e3-40e564c07d41 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:42.401880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e89aded-d884-4f6c-a2e3-40e564c07d41 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:42.535731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7e89aded-d884-4f6c-a2e3-40e564c07d41 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:42.542958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7e89aded-d884-4f6c-a2e3-40e564c07d41 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153422 Mar 08 04:26:42.543504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 552/1098] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:42 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:43.211499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0db612aa-dfef-4cbb-85df-aadc1c43ba94 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:43.212431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0db612aa-dfef-4cbb-85df-aadc1c43ba94 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:43.218249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0db612aa-dfef-4cbb-85df-aadc1c43ba94 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:43.218697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0db612aa-dfef-4cbb-85df-aadc1c43ba94 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:43.219460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0db612aa-dfef-4cbb-85df-aadc1c43ba94 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:43.219892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0db612aa-dfef-4cbb-85df-aadc1c43ba94 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:43.247369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0db612aa-dfef-4cbb-85df-aadc1c43ba94 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039962 Mar 08 04:26:43.247901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 547/1099] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:43.343944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c604c602-17b9-49c3-ba23-1ecece7ce711 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:43.344870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c604c602-17b9-49c3-ba23-1ecece7ce711 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:43.351660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c604c602-17b9-49c3-ba23-1ecece7ce711 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:43.352109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c604c602-17b9-49c3-ba23-1ecece7ce711 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:43.352858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c604c602-17b9-49c3-ba23-1ecece7ce711 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:43.353290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c604c602-17b9-49c3-ba23-1ecece7ce711 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:43.382696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c604c602-17b9-49c3-ba23-1ecece7ce711 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Mar 08 04:26:43.383376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 553/1100] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:43.560493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bf6bc30a-995e-4fd2-b2c4-8b098df9a62a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:43.561046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bf6bc30a-995e-4fd2-b2c4-8b098df9a62a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:43.567369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6bc30a-995e-4fd2-b2c4-8b098df9a62a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:43.567816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6bc30a-995e-4fd2-b2c4-8b098df9a62a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:43.568586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6bc30a-995e-4fd2-b2c4-8b098df9a62a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:43.569026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6bc30a-995e-4fd2-b2c4-8b098df9a62a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:43.698371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bf6bc30a-995e-4fd2-b2c4-8b098df9a62a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:43.705594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bf6bc30a-995e-4fd2-b2c4-8b098df9a62a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149027 Mar 08 04:26:43.706185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 548/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:43 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:44.258983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c9735036-6c52-42be-94f9-e8466d562b27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:44.259896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c9735036-6c52-42be-94f9-e8466d562b27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:44.265636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9735036-6c52-42be-94f9-e8466d562b27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:44.266107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9735036-6c52-42be-94f9-e8466d562b27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:44.266859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9735036-6c52-42be-94f9-e8466d562b27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:44.267291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9735036-6c52-42be-94f9-e8466d562b27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:44.294763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c9735036-6c52-42be-94f9-e8466d562b27 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039754 Mar 08 04:26:44.295289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 554/1102] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:44.394408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b5c0749d-a5c4-4aec-8aeb-938adbc9a604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:44.395414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b5c0749d-a5c4-4aec-8aeb-938adbc9a604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:44.401405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5c0749d-a5c4-4aec-8aeb-938adbc9a604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:44.402147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5c0749d-a5c4-4aec-8aeb-938adbc9a604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:44.402911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5c0749d-a5c4-4aec-8aeb-938adbc9a604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:44.403347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5c0749d-a5c4-4aec-8aeb-938adbc9a604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:44.431491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b5c0749d-a5c4-4aec-8aeb-938adbc9a604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041160 Mar 08 04:26:44.432021 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 549/1103] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:44.723346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8b271962-52ee-4f52-bff9-4a46494173d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:44.723983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8b271962-52ee-4f52-bff9-4a46494173d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:44.730349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8b271962-52ee-4f52-bff9-4a46494173d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:44.730793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8b271962-52ee-4f52-bff9-4a46494173d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:44.731548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8b271962-52ee-4f52-bff9-4a46494173d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:44.731978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8b271962-52ee-4f52-bff9-4a46494173d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:44.882923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8b271962-52ee-4f52-bff9-4a46494173d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:44.890160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8b271962-52ee-4f52-bff9-4a46494173d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.170742 Mar 08 04:26:44.890707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 555/1104] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:44 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:45.305142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-258cbfe0-7e5e-4f3a-8d13-6e0624b5ec28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:45.306104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-258cbfe0-7e5e-4f3a-8d13-6e0624b5ec28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:45.312359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-258cbfe0-7e5e-4f3a-8d13-6e0624b5ec28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:45.312808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-258cbfe0-7e5e-4f3a-8d13-6e0624b5ec28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:45.313577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-258cbfe0-7e5e-4f3a-8d13-6e0624b5ec28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:45.314046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-258cbfe0-7e5e-4f3a-8d13-6e0624b5ec28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:45.341481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-258cbfe0-7e5e-4f3a-8d13-6e0624b5ec28 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040294 Mar 08 04:26:45.342048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 550/1105] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:45.443788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3c90dfb6-1254-441b-914b-77261f4f1f5b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:45.444692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3c90dfb6-1254-441b-914b-77261f4f1f5b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:45.450701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c90dfb6-1254-441b-914b-77261f4f1f5b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:45.451153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c90dfb6-1254-441b-914b-77261f4f1f5b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:45.451991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c90dfb6-1254-441b-914b-77261f4f1f5b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:45.452428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c90dfb6-1254-441b-914b-77261f4f1f5b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:45.479578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3c90dfb6-1254-441b-914b-77261f4f1f5b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040458 Mar 08 04:26:45.480112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 556/1106] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:45.907218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-16d56b0e-a2ab-4518-a062-2ae22b48cbc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:45.907849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-16d56b0e-a2ab-4518-a062-2ae22b48cbc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:45.914296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d56b0e-a2ab-4518-a062-2ae22b48cbc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:45.914748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d56b0e-a2ab-4518-a062-2ae22b48cbc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:45.915498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d56b0e-a2ab-4518-a062-2ae22b48cbc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:45.915937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d56b0e-a2ab-4518-a062-2ae22b48cbc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:46.045572 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-16d56b0e-a2ab-4518-a062-2ae22b48cbc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:46.053783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-16d56b0e-a2ab-4518-a062-2ae22b48cbc6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150381 Mar 08 04:26:46.054357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 551/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:45 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:46.352791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bbdb6f7a-0377-42ab-b2c4-b2ee298485dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:46.353739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bbdb6f7a-0377-42ab-b2c4-b2ee298485dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:46.359935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bbdb6f7a-0377-42ab-b2c4-b2ee298485dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:46.360381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bbdb6f7a-0377-42ab-b2c4-b2ee298485dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:46.361132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bbdb6f7a-0377-42ab-b2c4-b2ee298485dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:46.361564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bbdb6f7a-0377-42ab-b2c4-b2ee298485dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:46.388973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bbdb6f7a-0377-42ab-b2c4-b2ee298485dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040146 Mar 08 04:26:46.389503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 557/1108] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:46.491146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cdcde2d2-f1d9-498e-813e-a260cf6f1988 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:46.492046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cdcde2d2-f1d9-498e-813e-a260cf6f1988 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:46.498318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdcde2d2-f1d9-498e-813e-a260cf6f1988 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:46.498765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdcde2d2-f1d9-498e-813e-a260cf6f1988 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:46.499533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdcde2d2-f1d9-498e-813e-a260cf6f1988 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:46.499971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdcde2d2-f1d9-498e-813e-a260cf6f1988 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:46.528471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cdcde2d2-f1d9-498e-813e-a260cf6f1988 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041297 Mar 08 04:26:46.529008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 552/1109] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:47.071370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ae04b128-8e6c-4824-87e3-f8ab6217b5a0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:47.071980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ae04b128-8e6c-4824-87e3-f8ab6217b5a0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:47.077854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ae04b128-8e6c-4824-87e3-f8ab6217b5a0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:47.078307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ae04b128-8e6c-4824-87e3-f8ab6217b5a0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:47.079069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ae04b128-8e6c-4824-87e3-f8ab6217b5a0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:47.079507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ae04b128-8e6c-4824-87e3-f8ab6217b5a0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:47.211425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ae04b128-8e6c-4824-87e3-f8ab6217b5a0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:47.218609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ae04b128-8e6c-4824-87e3-f8ab6217b5a0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151193 Mar 08 04:26:47.219154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 558/1110] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:47 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:47.400388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6bb373cd-3d98-40ae-9a5d-b4f43271cd5a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:47.401332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6bb373cd-3d98-40ae-9a5d-b4f43271cd5a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:47.407444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bb373cd-3d98-40ae-9a5d-b4f43271cd5a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:47.407896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bb373cd-3d98-40ae-9a5d-b4f43271cd5a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:47.408667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bb373cd-3d98-40ae-9a5d-b4f43271cd5a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:47.409108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bb373cd-3d98-40ae-9a5d-b4f43271cd5a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:47.437937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6bb373cd-3d98-40ae-9a5d-b4f43271cd5a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041331 Mar 08 04:26:47.438409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 553/1111] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:47.540646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dc8fac48-a7f7-4beb-b8e7-11594d466293 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:47.541606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dc8fac48-a7f7-4beb-b8e7-11594d466293 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:47.547885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc8fac48-a7f7-4beb-b8e7-11594d466293 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:47.548337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc8fac48-a7f7-4beb-b8e7-11594d466293 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:47.549105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc8fac48-a7f7-4beb-b8e7-11594d466293 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:47.549548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc8fac48-a7f7-4beb-b8e7-11594d466293 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:47.576808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dc8fac48-a7f7-4beb-b8e7-11594d466293 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040160 Mar 08 04:26:47.577348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 559/1112] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:48.236403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-01e02724-df7d-4e7b-9464-8bb39cb35ebf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:48.237001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-01e02724-df7d-4e7b-9464-8bb39cb35ebf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:48.243307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-01e02724-df7d-4e7b-9464-8bb39cb35ebf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:48.243757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-01e02724-df7d-4e7b-9464-8bb39cb35ebf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:48.244510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-01e02724-df7d-4e7b-9464-8bb39cb35ebf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:48.244940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-01e02724-df7d-4e7b-9464-8bb39cb35ebf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:48.377885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-01e02724-df7d-4e7b-9464-8bb39cb35ebf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:48.387053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-01e02724-df7d-4e7b-9464-8bb39cb35ebf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154237 Mar 08 04:26:48.387534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 554/1113] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:48 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:48.457968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b8a761d3-503f-4c8d-9b28-8121e2e35443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:48.458876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b8a761d3-503f-4c8d-9b28-8121e2e35443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:48.464895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8a761d3-503f-4c8d-9b28-8121e2e35443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:48.465348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8a761d3-503f-4c8d-9b28-8121e2e35443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:48.466153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8a761d3-503f-4c8d-9b28-8121e2e35443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:48.466595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8a761d3-503f-4c8d-9b28-8121e2e35443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:48.494846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b8a761d3-503f-4c8d-9b28-8121e2e35443 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041005 Mar 08 04:26:48.495313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 560/1114] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:48.588048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-aa0be6f2-7fd3-4a2a-89be-ed44b3eeb18d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:48.588960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-aa0be6f2-7fd3-4a2a-89be-ed44b3eeb18d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:48.594780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aa0be6f2-7fd3-4a2a-89be-ed44b3eeb18d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:48.595230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aa0be6f2-7fd3-4a2a-89be-ed44b3eeb18d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:48.595988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aa0be6f2-7fd3-4a2a-89be-ed44b3eeb18d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:48.596418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aa0be6f2-7fd3-4a2a-89be-ed44b3eeb18d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:48.624796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-aa0be6f2-7fd3-4a2a-89be-ed44b3eeb18d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040731 Mar 08 04:26:48.625335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 555/1115] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:49.404442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ff0ed9cd-b341-425f-b00a-c4d3dba17206 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:49.405074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ff0ed9cd-b341-425f-b00a-c4d3dba17206 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:49.411358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff0ed9cd-b341-425f-b00a-c4d3dba17206 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:49.411804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff0ed9cd-b341-425f-b00a-c4d3dba17206 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:49.412559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff0ed9cd-b341-425f-b00a-c4d3dba17206 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:49.412992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff0ed9cd-b341-425f-b00a-c4d3dba17206 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:49.507338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-68c978cc-c625-4774-8b4f-72f4452cb64f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:49.508424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-68c978cc-c625-4774-8b4f-72f4452cb64f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:49.514832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-68c978cc-c625-4774-8b4f-72f4452cb64f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:49.515286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-68c978cc-c625-4774-8b4f-72f4452cb64f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:49.516067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-68c978cc-c625-4774-8b4f-72f4452cb64f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:49.516509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-68c978cc-c625-4774-8b4f-72f4452cb64f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:49.545933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-68c978cc-c625-4774-8b4f-72f4452cb64f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Mar 08 04:26:49.546499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 556/1116] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:49.552791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ff0ed9cd-b341-425f-b00a-c4d3dba17206 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:49.560082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ff0ed9cd-b341-425f-b00a-c4d3dba17206 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.159759 Mar 08 04:26:49.560627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 561/1117] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:49 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:49.636148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bb02a74b-4b38-47a3-b97c-17e18acf334b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:49.637057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bb02a74b-4b38-47a3-b97c-17e18acf334b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:49.642998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb02a74b-4b38-47a3-b97c-17e18acf334b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:49.643445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb02a74b-4b38-47a3-b97c-17e18acf334b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:49.644956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb02a74b-4b38-47a3-b97c-17e18acf334b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:49.645536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb02a74b-4b38-47a3-b97c-17e18acf334b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:49.673159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bb02a74b-4b38-47a3-b97c-17e18acf334b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040876 Mar 08 04:26:49.673742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 557/1118] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:50.557424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7488ea44-e042-43b6-83cd-7f6b69fef5a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:50.558359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7488ea44-e042-43b6-83cd-7f6b69fef5a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:50.564590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7488ea44-e042-43b6-83cd-7f6b69fef5a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:50.565036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7488ea44-e042-43b6-83cd-7f6b69fef5a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:50.566438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7488ea44-e042-43b6-83cd-7f6b69fef5a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:50.566878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7488ea44-e042-43b6-83cd-7f6b69fef5a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:50.577998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-67b45e98-6e79-4b94-a06b-eb220fbb9603 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:50.578532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-67b45e98-6e79-4b94-a06b-eb220fbb9603 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:50.584721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67b45e98-6e79-4b94-a06b-eb220fbb9603 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:50.585163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67b45e98-6e79-4b94-a06b-eb220fbb9603 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:50.585947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67b45e98-6e79-4b94-a06b-eb220fbb9603 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:50.586378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67b45e98-6e79-4b94-a06b-eb220fbb9603 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:50.594993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7488ea44-e042-43b6-83cd-7f6b69fef5a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041457 Mar 08 04:26:50.595564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 562/1119] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:50 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:50.684857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3b8fef50-f587-4566-8a62-a540d299698c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:50.685878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3b8fef50-f587-4566-8a62-a540d299698c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:50.692329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b8fef50-f587-4566-8a62-a540d299698c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:50.692788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b8fef50-f587-4566-8a62-a540d299698c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:50.693549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b8fef50-f587-4566-8a62-a540d299698c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:50.694018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b8fef50-f587-4566-8a62-a540d299698c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:50.723732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3b8fef50-f587-4566-8a62-a540d299698c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 Mar 08 04:26:50.724314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 563/1120] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:50 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:26:50.725486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-67b45e98-6e79-4b94-a06b-eb220fbb9603 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:50.732775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-67b45e98-6e79-4b94-a06b-eb220fbb9603 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158883 Mar 08 04:26:50.733322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 558/1121] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:50 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:26:51.606728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-76318750-63c2-4797-bbe1-86a14def5e42 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:51.607630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-76318750-63c2-4797-bbe1-86a14def5e42 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:51.614428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-76318750-63c2-4797-bbe1-86a14def5e42 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:51.614874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-76318750-63c2-4797-bbe1-86a14def5e42 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:51.615628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-76318750-63c2-4797-bbe1-86a14def5e42 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:51.616058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-76318750-63c2-4797-bbe1-86a14def5e42 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:51.642796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-76318750-63c2-4797-bbe1-86a14def5e42 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040106 Mar 08 04:26:51.643328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 564/1122] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:51.735073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4e75012f-3e32-4c10-b34c-14fbc7bfd8fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:51.736012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4e75012f-3e32-4c10-b34c-14fbc7bfd8fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:51.743066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e75012f-3e32-4c10-b34c-14fbc7bfd8fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:51.743511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e75012f-3e32-4c10-b34c-14fbc7bfd8fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:51.744296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e75012f-3e32-4c10-b34c-14fbc7bfd8fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:51.744732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e75012f-3e32-4c10-b34c-14fbc7bfd8fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:51.749985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9b70cedf-4da7-4420-ac30-658e5962171f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:51.750596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9b70cedf-4da7-4420-ac30-658e5962171f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:51.756299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b70cedf-4da7-4420-ac30-658e5962171f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:51.756745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b70cedf-4da7-4420-ac30-658e5962171f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:51.757512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b70cedf-4da7-4420-ac30-658e5962171f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:51.757964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b70cedf-4da7-4420-ac30-658e5962171f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:51.773723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4e75012f-3e32-4c10-b34c-14fbc7bfd8fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042496 Mar 08 04:26:51.774490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 559/1123] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:51.891204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9b70cedf-4da7-4420-ac30-658e5962171f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:51.898828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9b70cedf-4da7-4420-ac30-658e5962171f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152675 Mar 08 04:26:51.899379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 565/1124] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:51 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:26:52.654481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-24efd36b-6848-450a-9a6d-f7b5cc124349 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:52.655424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-24efd36b-6848-450a-9a6d-f7b5cc124349 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:52.661908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24efd36b-6848-450a-9a6d-f7b5cc124349 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:52.662360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24efd36b-6848-450a-9a6d-f7b5cc124349 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:52.663130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24efd36b-6848-450a-9a6d-f7b5cc124349 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:52.663570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24efd36b-6848-450a-9a6d-f7b5cc124349 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:52.691833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-24efd36b-6848-450a-9a6d-f7b5cc124349 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 Mar 08 04:26:52.692380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 560/1125] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:52.786960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d27bea80-2d49-4397-8753-8cb0e8d85f84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:52.788087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d27bea80-2d49-4397-8753-8cb0e8d85f84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:52.794346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d27bea80-2d49-4397-8753-8cb0e8d85f84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:52.794791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d27bea80-2d49-4397-8753-8cb0e8d85f84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:52.795556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d27bea80-2d49-4397-8753-8cb0e8d85f84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:52.795986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d27bea80-2d49-4397-8753-8cb0e8d85f84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:52.824035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d27bea80-2d49-4397-8753-8cb0e8d85f84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042333 Mar 08 04:26:52.824582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 566/1126] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:52.916978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f838bcac-d1c6-4a41-83bd-07ad12ca7e19 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:52.917590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f838bcac-d1c6-4a41-83bd-07ad12ca7e19 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:52.923847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f838bcac-d1c6-4a41-83bd-07ad12ca7e19 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:52.924300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f838bcac-d1c6-4a41-83bd-07ad12ca7e19 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:52.925210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f838bcac-d1c6-4a41-83bd-07ad12ca7e19 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:52.925818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f838bcac-d1c6-4a41-83bd-07ad12ca7e19 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:53.060410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f838bcac-d1c6-4a41-83bd-07ad12ca7e19 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:53.068428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f838bcac-d1c6-4a41-83bd-07ad12ca7e19 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155335 Mar 08 04:26:53.068995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 561/1127] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:52 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:53.703935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b5e2532b-55ce-4a6c-baf8-24e6285f7904 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:53.704868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b5e2532b-55ce-4a6c-baf8-24e6285f7904 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:53.710668 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5e2532b-55ce-4a6c-baf8-24e6285f7904 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:53.711113 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5e2532b-55ce-4a6c-baf8-24e6285f7904 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:53.711865 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5e2532b-55ce-4a6c-baf8-24e6285f7904 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:53.712297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5e2532b-55ce-4a6c-baf8-24e6285f7904 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:53.739738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b5e2532b-55ce-4a6c-baf8-24e6285f7904 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039793 Mar 08 04:26:53.740271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 567/1128] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:53.835648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-33561117-c6a3-4e96-ba92-cee9003c6d8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:53.836592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-33561117-c6a3-4e96-ba92-cee9003c6d8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:53.842518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33561117-c6a3-4e96-ba92-cee9003c6d8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:53.842968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33561117-c6a3-4e96-ba92-cee9003c6d8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:53.843727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33561117-c6a3-4e96-ba92-cee9003c6d8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:53.844162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33561117-c6a3-4e96-ba92-cee9003c6d8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:53.873616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-33561117-c6a3-4e96-ba92-cee9003c6d8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042069 Mar 08 04:26:53.874189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 562/1129] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:54.084667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-18e9ffb9-6b76-4a8b-a0c9-006765ba06be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:54.085245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-18e9ffb9-6b76-4a8b-a0c9-006765ba06be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:54.091306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18e9ffb9-6b76-4a8b-a0c9-006765ba06be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:54.091755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18e9ffb9-6b76-4a8b-a0c9-006765ba06be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:54.092519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18e9ffb9-6b76-4a8b-a0c9-006765ba06be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:54.092954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18e9ffb9-6b76-4a8b-a0c9-006765ba06be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:54.224882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-18e9ffb9-6b76-4a8b-a0c9-006765ba06be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:54.232119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-18e9ffb9-6b76-4a8b-a0c9-006765ba06be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151407 Mar 08 04:26:54.232691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 568/1130] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:54 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:54.751088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-09782533-a752-46b0-9136-26aeea42a2e6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:54.752089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-09782533-a752-46b0-9136-26aeea42a2e6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:54.758408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-09782533-a752-46b0-9136-26aeea42a2e6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:54.758857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-09782533-a752-46b0-9136-26aeea42a2e6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:54.759621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-09782533-a752-46b0-9136-26aeea42a2e6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:54.760056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-09782533-a752-46b0-9136-26aeea42a2e6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:54.788793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-09782533-a752-46b0-9136-26aeea42a2e6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041633 Mar 08 04:26:54.789340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 563/1131] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:54 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:54.884736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-67b99f95-d289-4932-9a50-654a05524908 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:54.885644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-67b99f95-d289-4932-9a50-654a05524908 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:54.891478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67b99f95-d289-4932-9a50-654a05524908 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:54.891920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67b99f95-d289-4932-9a50-654a05524908 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:54.892671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67b99f95-d289-4932-9a50-654a05524908 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:54.893102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67b99f95-d289-4932-9a50-654a05524908 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:54.921100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-67b99f95-d289-4932-9a50-654a05524908 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040366 Mar 08 04:26:54.921644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 569/1132] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:55.249650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2a657cce-8149-4da6-9484-cdb9dea2c739 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:55.250272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2a657cce-8149-4da6-9484-cdb9dea2c739 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:55.256115 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a657cce-8149-4da6-9484-cdb9dea2c739 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:55.256555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a657cce-8149-4da6-9484-cdb9dea2c739 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:55.257310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a657cce-8149-4da6-9484-cdb9dea2c739 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:55.257768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a657cce-8149-4da6-9484-cdb9dea2c739 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:55.386633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2a657cce-8149-4da6-9484-cdb9dea2c739 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:55.394550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2a657cce-8149-4da6-9484-cdb9dea2c739 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.148015 Mar 08 04:26:55.395107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 564/1133] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:55 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:55.799505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-09aabae3-7e25-450c-8478-128b981be0c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:55.800998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-09aabae3-7e25-450c-8478-128b981be0c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:55.807206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-09aabae3-7e25-450c-8478-128b981be0c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:55.807651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-09aabae3-7e25-450c-8478-128b981be0c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:55.808408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-09aabae3-7e25-450c-8478-128b981be0c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:55.808840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-09aabae3-7e25-450c-8478-128b981be0c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:55.838137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-09aabae3-7e25-450c-8478-128b981be0c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042521 Mar 08 04:26:55.838711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 570/1134] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:55.933318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c75e195a-4fb8-4a96-8fb7-fc3ea57aea58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:55.934243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c75e195a-4fb8-4a96-8fb7-fc3ea57aea58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:55.940363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c75e195a-4fb8-4a96-8fb7-fc3ea57aea58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:55.941396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c75e195a-4fb8-4a96-8fb7-fc3ea57aea58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:55.942179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c75e195a-4fb8-4a96-8fb7-fc3ea57aea58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:55.942610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c75e195a-4fb8-4a96-8fb7-fc3ea57aea58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:55.969531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c75e195a-4fb8-4a96-8fb7-fc3ea57aea58 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040094 Mar 08 04:26:55.970098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 565/1135] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:56.412193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-61469253-613f-4c89-a673-12953822c1ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:56.412799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-61469253-613f-4c89-a673-12953822c1ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:56.418921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61469253-613f-4c89-a673-12953822c1ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:56.419370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61469253-613f-4c89-a673-12953822c1ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:56.420164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61469253-613f-4c89-a673-12953822c1ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:56.420598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61469253-613f-4c89-a673-12953822c1ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:56.554853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-61469253-613f-4c89-a673-12953822c1ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:56.562061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-61469253-613f-4c89-a673-12953822c1ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154171 Mar 08 04:26:56.562611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 571/1136] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:56 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:56.849942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-722e9dbe-2c12-48c2-9731-6b2a43752240 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:56.851447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-722e9dbe-2c12-48c2-9731-6b2a43752240 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:56.858876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-722e9dbe-2c12-48c2-9731-6b2a43752240 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:56.859330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-722e9dbe-2c12-48c2-9731-6b2a43752240 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:56.860112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-722e9dbe-2c12-48c2-9731-6b2a43752240 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:56.860557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-722e9dbe-2c12-48c2-9731-6b2a43752240 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:56.888962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-722e9dbe-2c12-48c2-9731-6b2a43752240 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Mar 08 04:26:56.889496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 566/1137] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:56.981314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b1844735-8734-41d3-ba3e-a2b9033a5d77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:56.982266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b1844735-8734-41d3-ba3e-a2b9033a5d77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:56.988731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1844735-8734-41d3-ba3e-a2b9033a5d77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:56.989433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1844735-8734-41d3-ba3e-a2b9033a5d77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:56.990478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1844735-8734-41d3-ba3e-a2b9033a5d77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:56.990986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1844735-8734-41d3-ba3e-a2b9033a5d77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:57.022301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b1844735-8734-41d3-ba3e-a2b9033a5d77 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044854 Mar 08 04:26:57.022858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 572/1138] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:57.578885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7e67570f-d039-4073-9af4-2ee2510a05ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:57.579495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7e67570f-d039-4073-9af4-2ee2510a05ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:57.585997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e67570f-d039-4073-9af4-2ee2510a05ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:57.586444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e67570f-d039-4073-9af4-2ee2510a05ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:57.587265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e67570f-d039-4073-9af4-2ee2510a05ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:57.587698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e67570f-d039-4073-9af4-2ee2510a05ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:57.719397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7e67570f-d039-4073-9af4-2ee2510a05ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:57.726597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7e67570f-d039-4073-9af4-2ee2510a05ee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151537 Mar 08 04:26:57.727156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 567/1139] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:57 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:57.900811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3ef0507d-5cdd-4109-b2e5-2e3076b87399 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:57.902002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3ef0507d-5cdd-4109-b2e5-2e3076b87399 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:57.907783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ef0507d-5cdd-4109-b2e5-2e3076b87399 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:57.908228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ef0507d-5cdd-4109-b2e5-2e3076b87399 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:57.908981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ef0507d-5cdd-4109-b2e5-2e3076b87399 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:57.909626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ef0507d-5cdd-4109-b2e5-2e3076b87399 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:57.937375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3ef0507d-5cdd-4109-b2e5-2e3076b87399 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040503 Mar 08 04:26:57.937946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 573/1140] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:58.034971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-029d2040-01dd-478d-81d8-a3ec09aac0e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:58.035876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-029d2040-01dd-478d-81d8-a3ec09aac0e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:58.041747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-029d2040-01dd-478d-81d8-a3ec09aac0e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:58.042203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-029d2040-01dd-478d-81d8-a3ec09aac0e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:58.042963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-029d2040-01dd-478d-81d8-a3ec09aac0e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:58.043400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-029d2040-01dd-478d-81d8-a3ec09aac0e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:58.071876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-029d2040-01dd-478d-81d8-a3ec09aac0e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040904 Mar 08 04:26:58.072426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 568/1141] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:58.743639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-75a5349f-64ea-4f80-8bb5-f9d9a81a90ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:58.744256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-75a5349f-64ea-4f80-8bb5-f9d9a81a90ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:58.750514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75a5349f-64ea-4f80-8bb5-f9d9a81a90ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:58.750978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75a5349f-64ea-4f80-8bb5-f9d9a81a90ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:58.751748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75a5349f-64ea-4f80-8bb5-f9d9a81a90ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:58.752184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75a5349f-64ea-4f80-8bb5-f9d9a81a90ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:58.886157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-75a5349f-64ea-4f80-8bb5-f9d9a81a90ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:26:58.894001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-75a5349f-64ea-4f80-8bb5-f9d9a81a90ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153697 Mar 08 04:26:58.894856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 574/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:58 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:26:58.949280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-781c8673-eba2-4e95-bd1d-ea482e773628 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:58.950210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-781c8673-eba2-4e95-bd1d-ea482e773628 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:58.956999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-781c8673-eba2-4e95-bd1d-ea482e773628 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:58.957438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-781c8673-eba2-4e95-bd1d-ea482e773628 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:58.958223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-781c8673-eba2-4e95-bd1d-ea482e773628 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:58.958656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-781c8673-eba2-4e95-bd1d-ea482e773628 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:58.986607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-781c8673-eba2-4e95-bd1d-ea482e773628 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041242 Mar 08 04:26:58.987138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 569/1143] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:59.084093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4cbf85fc-de22-4bca-9edc-3a7bc01f7d6a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:59.084923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4cbf85fc-de22-4bca-9edc-3a7bc01f7d6a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:59.090746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cbf85fc-de22-4bca-9edc-3a7bc01f7d6a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:59.091188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cbf85fc-de22-4bca-9edc-3a7bc01f7d6a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:59.091941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cbf85fc-de22-4bca-9edc-3a7bc01f7d6a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:59.092373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cbf85fc-de22-4bca-9edc-3a7bc01f7d6a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:59.119376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4cbf85fc-de22-4bca-9edc-3a7bc01f7d6a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039920 Mar 08 04:26:59.119906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 575/1144] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:26:59.911542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f9936ab4-7b54-48a2-960e-8b5f4c220a33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:59.912180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f9936ab4-7b54-48a2-960e-8b5f4c220a33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:26:59.918017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9936ab4-7b54-48a2-960e-8b5f4c220a33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:59.918464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9936ab4-7b54-48a2-960e-8b5f4c220a33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:59.919229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9936ab4-7b54-48a2-960e-8b5f4c220a33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:26:59.919665 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9936ab4-7b54-48a2-960e-8b5f4c220a33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:26:59.998373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ec1e529d-a826-4ba3-af29-67d42b05d65d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:26:59.999293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ec1e529d-a826-4ba3-af29-67d42b05d65d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:00.006456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec1e529d-a826-4ba3-af29-67d42b05d65d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:00.006910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec1e529d-a826-4ba3-af29-67d42b05d65d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:00.007685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec1e529d-a826-4ba3-af29-67d42b05d65d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:00.008128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec1e529d-a826-4ba3-af29-67d42b05d65d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:00.037680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ec1e529d-a826-4ba3-af29-67d42b05d65d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Mar 08 04:27:00.038247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 576/1145] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:26:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:00.054987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f9936ab4-7b54-48a2-960e-8b5f4c220a33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:00.062313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f9936ab4-7b54-48a2-960e-8b5f4c220a33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155122 Mar 08 04:27:00.062862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 570/1146] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:26:59 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:00.131170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-de86637e-61c1-4f25-a62f-e3ee3839ae9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:00.132000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-de86637e-61c1-4f25-a62f-e3ee3839ae9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:00.137866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de86637e-61c1-4f25-a62f-e3ee3839ae9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:00.138308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de86637e-61c1-4f25-a62f-e3ee3839ae9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:00.139062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de86637e-61c1-4f25-a62f-e3ee3839ae9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:00.139519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de86637e-61c1-4f25-a62f-e3ee3839ae9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:00.167157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-de86637e-61c1-4f25-a62f-e3ee3839ae9d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040442 Mar 08 04:27:00.167892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 577/1147] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:00.299167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:27:00.299407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:27:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:27:01.049178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d8a9389b-5bc5-4cfc-a381-705eb42f0753 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:01.051361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d8a9389b-5bc5-4cfc-a381-705eb42f0753 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:01.057776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8a9389b-5bc5-4cfc-a381-705eb42f0753 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:01.058356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8a9389b-5bc5-4cfc-a381-705eb42f0753 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:01.058988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8a9389b-5bc5-4cfc-a381-705eb42f0753 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:01.059424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d8a9389b-5bc5-4cfc-a381-705eb42f0753 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:01.079678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9d6a496a-b7e4-4f0a-b72f-842522416eb8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:01.080279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9d6a496a-b7e4-4f0a-b72f-842522416eb8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:01.086716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d6a496a-b7e4-4f0a-b72f-842522416eb8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:01.087160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d6a496a-b7e4-4f0a-b72f-842522416eb8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:01.087922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d6a496a-b7e4-4f0a-b72f-842522416eb8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:01.088353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d6a496a-b7e4-4f0a-b72f-842522416eb8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:01.089798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d8a9389b-5bc5-4cfc-a381-705eb42f0753 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Mar 08 04:27:01.090554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 571/1148] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:01.179391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-da4a7083-1874-4524-a993-86566422a234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:01.180309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-da4a7083-1874-4524-a993-86566422a234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:01.186325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da4a7083-1874-4524-a993-86566422a234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:01.186770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da4a7083-1874-4524-a993-86566422a234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:01.187643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da4a7083-1874-4524-a993-86566422a234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:01.188232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da4a7083-1874-4524-a993-86566422a234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:01.228512 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-da4a7083-1874-4524-a993-86566422a234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053947 Mar 08 04:27:01.229389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 572/1149] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:01 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:01.232470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9d6a496a-b7e4-4f0a-b72f-842522416eb8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:01.240536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9d6a496a-b7e4-4f0a-b72f-842522416eb8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.164658 Mar 08 04:27:01.241082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 578/1150] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:01 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:27:02.100953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1c67bb87-e787-4f59-9c6e-f110b207b382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:02.101885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1c67bb87-e787-4f59-9c6e-f110b207b382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:02.108059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c67bb87-e787-4f59-9c6e-f110b207b382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:02.108444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c67bb87-e787-4f59-9c6e-f110b207b382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:02.109200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c67bb87-e787-4f59-9c6e-f110b207b382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:02.109633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c67bb87-e787-4f59-9c6e-f110b207b382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:02.138460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1c67bb87-e787-4f59-9c6e-f110b207b382 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041906 Mar 08 04:27:02.139119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 573/1151] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:02.240304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e9582bd6-7cea-4b54-ada2-3b712eb56584 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:02.241224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e9582bd6-7cea-4b54-ada2-3b712eb56584 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:02.247424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9582bd6-7cea-4b54-ada2-3b712eb56584 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:02.247868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9582bd6-7cea-4b54-ada2-3b712eb56584 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:02.248621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9582bd6-7cea-4b54-ada2-3b712eb56584 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:02.249069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9582bd6-7cea-4b54-ada2-3b712eb56584 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:02.257421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0c467761-8f90-4d8f-a7be-35a1868f3a1f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:02.258060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0c467761-8f90-4d8f-a7be-35a1868f3a1f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:02.263805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c467761-8f90-4d8f-a7be-35a1868f3a1f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:02.264259 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c467761-8f90-4d8f-a7be-35a1868f3a1f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:02.265027 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c467761-8f90-4d8f-a7be-35a1868f3a1f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:02.265466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c467761-8f90-4d8f-a7be-35a1868f3a1f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:02.277000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e9582bd6-7cea-4b54-ada2-3b712eb56584 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041394 Mar 08 04:27:02.277547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 579/1152] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:02.397943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0c467761-8f90-4d8f-a7be-35a1868f3a1f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:02.405415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0c467761-8f90-4d8f-a7be-35a1868f3a1f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151753 Mar 08 04:27:02.406017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 574/1153] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:02 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:27:03.150904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-81c8ae55-2ea3-4548-89ac-c0b6cd3509f7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:03.152581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-81c8ae55-2ea3-4548-89ac-c0b6cd3509f7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:03.159505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81c8ae55-2ea3-4548-89ac-c0b6cd3509f7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:03.160133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81c8ae55-2ea3-4548-89ac-c0b6cd3509f7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:03.161354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81c8ae55-2ea3-4548-89ac-c0b6cd3509f7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:03.162034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-81c8ae55-2ea3-4548-89ac-c0b6cd3509f7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:03.203009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-81c8ae55-2ea3-4548-89ac-c0b6cd3509f7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055808 Mar 08 04:27:03.203773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 580/1154] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:03.288379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-89f0fad1-f0ec-470e-9bde-e1d530b1e3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:03.289301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-89f0fad1-f0ec-470e-9bde-e1d530b1e3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:03.295508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89f0fad1-f0ec-470e-9bde-e1d530b1e3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:03.295960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89f0fad1-f0ec-470e-9bde-e1d530b1e3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:03.296737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89f0fad1-f0ec-470e-9bde-e1d530b1e3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:03.297178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89f0fad1-f0ec-470e-9bde-e1d530b1e3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:03.326194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-89f0fad1-f0ec-470e-9bde-e1d530b1e3ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041648 Mar 08 04:27:03.326758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 575/1155] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:03.423616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2e2fc9c9-1244-47bd-8231-80cfa6a47b95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:03.424208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2e2fc9c9-1244-47bd-8231-80cfa6a47b95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:03.430259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2e2fc9c9-1244-47bd-8231-80cfa6a47b95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:03.430705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2e2fc9c9-1244-47bd-8231-80cfa6a47b95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:03.431468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2e2fc9c9-1244-47bd-8231-80cfa6a47b95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:03.431904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2e2fc9c9-1244-47bd-8231-80cfa6a47b95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:03.564373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2e2fc9c9-1244-47bd-8231-80cfa6a47b95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:03.572333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2e2fc9c9-1244-47bd-8231-80cfa6a47b95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152996 Mar 08 04:27:03.573107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 581/1156] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:03 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:04.214742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b56cdfea-1ee1-4c47-afb8-824d25b42680 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:04.215668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b56cdfea-1ee1-4c47-afb8-824d25b42680 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:04.221746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b56cdfea-1ee1-4c47-afb8-824d25b42680 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:04.222207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b56cdfea-1ee1-4c47-afb8-824d25b42680 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:04.222974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b56cdfea-1ee1-4c47-afb8-824d25b42680 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:04.223408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b56cdfea-1ee1-4c47-afb8-824d25b42680 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:04.251084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b56cdfea-1ee1-4c47-afb8-824d25b42680 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040285 Mar 08 04:27:04.251623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 576/1157] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:04.337563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-13079a05-084b-47d0-b31f-d5be257c2c01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:04.338517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-13079a05-084b-47d0-b31f-d5be257c2c01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:04.344283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13079a05-084b-47d0-b31f-d5be257c2c01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:04.344728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13079a05-084b-47d0-b31f-d5be257c2c01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:04.345484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13079a05-084b-47d0-b31f-d5be257c2c01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:04.345938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13079a05-084b-47d0-b31f-d5be257c2c01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:04.374263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-13079a05-084b-47d0-b31f-d5be257c2c01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040679 Mar 08 04:27:04.374789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 582/1158] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:04.590521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1a7aeae8-38c0-4fdc-91ce-d91ae8b857a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:04.591061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1a7aeae8-38c0-4fdc-91ce-d91ae8b857a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:04.597815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a7aeae8-38c0-4fdc-91ce-d91ae8b857a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:04.598270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a7aeae8-38c0-4fdc-91ce-d91ae8b857a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:04.599031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a7aeae8-38c0-4fdc-91ce-d91ae8b857a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:04.599466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a7aeae8-38c0-4fdc-91ce-d91ae8b857a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:04.734830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1a7aeae8-38c0-4fdc-91ce-d91ae8b857a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:04.743645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1a7aeae8-38c0-4fdc-91ce-d91ae8b857a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156957 Mar 08 04:27:04.744230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 577/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:04 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:05.263203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d30a8198-2fd7-4d71-8fe6-c5be0f95ba3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:05.264105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d30a8198-2fd7-4d71-8fe6-c5be0f95ba3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:05.270921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d30a8198-2fd7-4d71-8fe6-c5be0f95ba3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:05.271367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d30a8198-2fd7-4d71-8fe6-c5be0f95ba3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:05.272122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d30a8198-2fd7-4d71-8fe6-c5be0f95ba3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:05.272554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d30a8198-2fd7-4d71-8fe6-c5be0f95ba3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:05.299564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d30a8198-2fd7-4d71-8fe6-c5be0f95ba3e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040315 Mar 08 04:27:05.300091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 583/1160] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:05.385977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fbce4559-120d-49bc-9a09-53f841199c37 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:05.386916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fbce4559-120d-49bc-9a09-53f841199c37 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:05.392700 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbce4559-120d-49bc-9a09-53f841199c37 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:05.393151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbce4559-120d-49bc-9a09-53f841199c37 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:05.393951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbce4559-120d-49bc-9a09-53f841199c37 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:05.395015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fbce4559-120d-49bc-9a09-53f841199c37 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:05.422981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fbce4559-120d-49bc-9a09-53f841199c37 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040982 Mar 08 04:27:05.423516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 578/1161] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:05.762804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e93aa564-5203-4081-93c9-40e45a3059d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:05.763436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e93aa564-5203-4081-93c9-40e45a3059d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:05.769509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e93aa564-5203-4081-93c9-40e45a3059d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:05.770022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e93aa564-5203-4081-93c9-40e45a3059d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:05.770792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e93aa564-5203-4081-93c9-40e45a3059d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:05.771231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e93aa564-5203-4081-93c9-40e45a3059d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:05.905736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e93aa564-5203-4081-93c9-40e45a3059d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:05.918720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e93aa564-5203-4081-93c9-40e45a3059d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155377 Mar 08 04:27:05.918720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 584/1162] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:06.311242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-30b8cb78-e893-41a6-9281-e4a43903de37 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:06.312059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-30b8cb78-e893-41a6-9281-e4a43903de37 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:06.318985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30b8cb78-e893-41a6-9281-e4a43903de37 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:06.319435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30b8cb78-e893-41a6-9281-e4a43903de37 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:06.320193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30b8cb78-e893-41a6-9281-e4a43903de37 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:06.320653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30b8cb78-e893-41a6-9281-e4a43903de37 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:06.347863 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-30b8cb78-e893-41a6-9281-e4a43903de37 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040644 Mar 08 04:27:06.348402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 579/1163] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:06.434945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-72f8b580-6bdd-44d9-9812-7eea858032e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:06.435837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-72f8b580-6bdd-44d9-9812-7eea858032e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:06.442318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72f8b580-6bdd-44d9-9812-7eea858032e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:06.442767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72f8b580-6bdd-44d9-9812-7eea858032e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:06.443529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72f8b580-6bdd-44d9-9812-7eea858032e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:06.443966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72f8b580-6bdd-44d9-9812-7eea858032e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:06.470978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-72f8b580-6bdd-44d9-9812-7eea858032e2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039990 Mar 08 04:27:06.471514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 585/1164] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:06.932327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7a2b0dab-ecb7-4e0a-b833-5a116d376df3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:06.932938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7a2b0dab-ecb7-4e0a-b833-5a116d376df3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:06.938802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a2b0dab-ecb7-4e0a-b833-5a116d376df3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:06.939251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a2b0dab-ecb7-4e0a-b833-5a116d376df3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:06.940011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a2b0dab-ecb7-4e0a-b833-5a116d376df3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:06.940469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a2b0dab-ecb7-4e0a-b833-5a116d376df3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:07.077490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7a2b0dab-ecb7-4e0a-b833-5a116d376df3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:07.085003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7a2b0dab-ecb7-4e0a-b833-5a116d376df3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156503 Mar 08 04:27:07.085563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 580/1165] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:07.359608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-91475934-6f2a-4c40-a164-ca77636143ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:07.360448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-91475934-6f2a-4c40-a164-ca77636143ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:07.367190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91475934-6f2a-4c40-a164-ca77636143ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:07.367638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91475934-6f2a-4c40-a164-ca77636143ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:07.368392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91475934-6f2a-4c40-a164-ca77636143ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:07.368827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91475934-6f2a-4c40-a164-ca77636143ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:07.396490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-91475934-6f2a-4c40-a164-ca77636143ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041027 Mar 08 04:27:07.397015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 586/1166] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:07.482586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4fc44f0d-7ce5-4d20-90f7-35c6a44a1438 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:07.483499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4fc44f0d-7ce5-4d20-90f7-35c6a44a1438 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:07.490463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4fc44f0d-7ce5-4d20-90f7-35c6a44a1438 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:07.490917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4fc44f0d-7ce5-4d20-90f7-35c6a44a1438 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:07.491690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4fc44f0d-7ce5-4d20-90f7-35c6a44a1438 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:07.492127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4fc44f0d-7ce5-4d20-90f7-35c6a44a1438 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:07.519418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4fc44f0d-7ce5-4d20-90f7-35c6a44a1438 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040719 Mar 08 04:27:07.519962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 581/1167] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:08.102035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-725c7cb4-77fa-41cc-b8e4-76ab16a931b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:08.102648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-725c7cb4-77fa-41cc-b8e4-76ab16a931b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:08.108522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-725c7cb4-77fa-41cc-b8e4-76ab16a931b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:08.108919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-725c7cb4-77fa-41cc-b8e4-76ab16a931b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:08.109707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-725c7cb4-77fa-41cc-b8e4-76ab16a931b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:08.110151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-725c7cb4-77fa-41cc-b8e4-76ab16a931b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:08.244906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-725c7cb4-77fa-41cc-b8e4-76ab16a931b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:08.252127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-725c7cb4-77fa-41cc-b8e4-76ab16a931b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153981 Mar 08 04:27:08.252683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 587/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:08 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:08.407345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-253ce4fc-3f05-41ca-b7f2-be5c3685b865 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:08.408199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-253ce4fc-3f05-41ca-b7f2-be5c3685b865 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:08.414804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-253ce4fc-3f05-41ca-b7f2-be5c3685b865 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:08.415252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-253ce4fc-3f05-41ca-b7f2-be5c3685b865 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:08.416013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-253ce4fc-3f05-41ca-b7f2-be5c3685b865 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:08.416440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-253ce4fc-3f05-41ca-b7f2-be5c3685b865 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:08.443920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-253ce4fc-3f05-41ca-b7f2-be5c3685b865 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040519 Mar 08 04:27:08.444454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 582/1169] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:08.530923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ec52b996-6f6d-461a-93e5-ad7421aa7a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:08.531843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ec52b996-6f6d-461a-93e5-ad7421aa7a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:08.538782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec52b996-6f6d-461a-93e5-ad7421aa7a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:08.539239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec52b996-6f6d-461a-93e5-ad7421aa7a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:08.540008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec52b996-6f6d-461a-93e5-ad7421aa7a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:08.540447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec52b996-6f6d-461a-93e5-ad7421aa7a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:08.567636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ec52b996-6f6d-461a-93e5-ad7421aa7a0d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040618 Mar 08 04:27:08.568173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 588/1170] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:09.269630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-685ca0e8-9fbf-45db-9c09-274a675f6030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:09.270272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-685ca0e8-9fbf-45db-9c09-274a675f6030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:09.276752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-685ca0e8-9fbf-45db-9c09-274a675f6030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:09.277202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-685ca0e8-9fbf-45db-9c09-274a675f6030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:09.278003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-685ca0e8-9fbf-45db-9c09-274a675f6030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:09.278443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-685ca0e8-9fbf-45db-9c09-274a675f6030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:09.408132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-685ca0e8-9fbf-45db-9c09-274a675f6030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:09.415456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-685ca0e8-9fbf-45db-9c09-274a675f6030 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149812 Mar 08 04:27:09.416077 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 583/1171] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:09.455117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0497fc15-9a2a-4558-928f-3ec54ed19f0b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:09.456030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0497fc15-9a2a-4558-928f-3ec54ed19f0b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:09.462361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0497fc15-9a2a-4558-928f-3ec54ed19f0b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:09.462814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0497fc15-9a2a-4558-928f-3ec54ed19f0b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:09.463577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0497fc15-9a2a-4558-928f-3ec54ed19f0b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:09.464015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0497fc15-9a2a-4558-928f-3ec54ed19f0b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:09.491983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0497fc15-9a2a-4558-928f-3ec54ed19f0b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040827 Mar 08 04:27:09.492517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 589/1172] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:09 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:09.579061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5085c624-1998-401d-9446-65a7aa238b34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:09.579900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5085c624-1998-401d-9446-65a7aa238b34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:09.586324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5085c624-1998-401d-9446-65a7aa238b34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:09.586773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5085c624-1998-401d-9446-65a7aa238b34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:09.587534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5085c624-1998-401d-9446-65a7aa238b34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:09.587969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5085c624-1998-401d-9446-65a7aa238b34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:09.614693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5085c624-1998-401d-9446-65a7aa238b34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039637 Mar 08 04:27:09.615229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 584/1173] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:10.433583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5ac1d941-2fac-4893-a012-02194a34a7b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:10.434216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5ac1d941-2fac-4893-a012-02194a34a7b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:10.440369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5ac1d941-2fac-4893-a012-02194a34a7b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:10.441067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5ac1d941-2fac-4893-a012-02194a34a7b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:10.441868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5ac1d941-2fac-4893-a012-02194a34a7b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:10.442305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5ac1d941-2fac-4893-a012-02194a34a7b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:10.503518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6c05b9c6-ee13-4f2b-8fe4-b03a86b1c8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:10.504424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6c05b9c6-ee13-4f2b-8fe4-b03a86b1c8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:10.510306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c05b9c6-ee13-4f2b-8fe4-b03a86b1c8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:10.510747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c05b9c6-ee13-4f2b-8fe4-b03a86b1c8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:10.511513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c05b9c6-ee13-4f2b-8fe4-b03a86b1c8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:10.511942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c05b9c6-ee13-4f2b-8fe4-b03a86b1c8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:10.540375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6c05b9c6-ee13-4f2b-8fe4-b03a86b1c8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040874 Mar 08 04:27:10.540929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 585/1174] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:10.578556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5ac1d941-2fac-4893-a012-02194a34a7b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:10.585950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5ac1d941-2fac-4893-a012-02194a34a7b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156252 Mar 08 04:27:10.586496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 590/1175] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:10 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:10.625805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a941384c-a701-40d1-a104-761d80d99598 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:10.626900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a941384c-a701-40d1-a104-761d80d99598 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:10.632722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a941384c-a701-40d1-a104-761d80d99598 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:10.633172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a941384c-a701-40d1-a104-761d80d99598 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:10.633958 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a941384c-a701-40d1-a104-761d80d99598 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:10.634394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a941384c-a701-40d1-a104-761d80d99598 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:10.661978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a941384c-a701-40d1-a104-761d80d99598 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040024 Mar 08 04:27:10.662513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 586/1176] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:11.551850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-95a5e5c6-bcb9-4746-98ed-04769551de3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:11.552761 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-95a5e5c6-bcb9-4746-98ed-04769551de3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:11.559040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95a5e5c6-bcb9-4746-98ed-04769551de3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:11.559472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95a5e5c6-bcb9-4746-98ed-04769551de3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:11.560234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95a5e5c6-bcb9-4746-98ed-04769551de3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:11.560671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95a5e5c6-bcb9-4746-98ed-04769551de3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:11.588723 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-95a5e5c6-bcb9-4746-98ed-04769551de3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040817 Mar 08 04:27:11.589279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 591/1177] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:11.602519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f4510896-2993-4928-882b-22c633623363 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:11.603120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f4510896-2993-4928-882b-22c633623363 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:11.609290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4510896-2993-4928-882b-22c633623363 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:11.609770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4510896-2993-4928-882b-22c633623363 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:11.610525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4510896-2993-4928-882b-22c633623363 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:11.610957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4510896-2993-4928-882b-22c633623363 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:11.672421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e65b98c8-f84a-496c-aaa1-55884dc0bd1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:11.673393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e65b98c8-f84a-496c-aaa1-55884dc0bd1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:11.679323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e65b98c8-f84a-496c-aaa1-55884dc0bd1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:11.679775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e65b98c8-f84a-496c-aaa1-55884dc0bd1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:11.680550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e65b98c8-f84a-496c-aaa1-55884dc0bd1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:11.680983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e65b98c8-f84a-496c-aaa1-55884dc0bd1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:11.709721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e65b98c8-f84a-496c-aaa1-55884dc0bd1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 Mar 08 04:27:11.710278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 592/1178] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:11.742405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f4510896-2993-4928-882b-22c633623363 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:11.749597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f4510896-2993-4928-882b-22c633623363 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150941 Mar 08 04:27:11.750180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 587/1179] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:11 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:12.600095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1e5991d4-1fe5-4c4f-b3fa-ea9907796b03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:12.601002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1e5991d4-1fe5-4c4f-b3fa-ea9907796b03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:12.607224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e5991d4-1fe5-4c4f-b3fa-ea9907796b03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:12.607677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e5991d4-1fe5-4c4f-b3fa-ea9907796b03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:12.608444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e5991d4-1fe5-4c4f-b3fa-ea9907796b03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:12.608908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e5991d4-1fe5-4c4f-b3fa-ea9907796b03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:12.636567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1e5991d4-1fe5-4c4f-b3fa-ea9907796b03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040392 Mar 08 04:27:12.637103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 593/1180] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:12.720802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7ececde6-4012-4445-9832-76b401c73fef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:12.721785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7ececde6-4012-4445-9832-76b401c73fef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:12.728538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7ececde6-4012-4445-9832-76b401c73fef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:12.728976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7ececde6-4012-4445-9832-76b401c73fef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:12.729759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7ececde6-4012-4445-9832-76b401c73fef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:12.730191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7ececde6-4012-4445-9832-76b401c73fef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:12.759100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7ececde6-4012-4445-9832-76b401c73fef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042174 Mar 08 04:27:12.759669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 588/1181] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:12.766271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e458bfb7-218f-4a63-bf00-9d143cf8c915 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:12.766883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e458bfb7-218f-4a63-bf00-9d143cf8c915 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:12.773236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e458bfb7-218f-4a63-bf00-9d143cf8c915 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:12.773719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e458bfb7-218f-4a63-bf00-9d143cf8c915 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:12.774559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e458bfb7-218f-4a63-bf00-9d143cf8c915 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:12.775019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e458bfb7-218f-4a63-bf00-9d143cf8c915 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:12.908970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e458bfb7-218f-4a63-bf00-9d143cf8c915 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:12.916272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e458bfb7-218f-4a63-bf00-9d143cf8c915 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153784 Mar 08 04:27:12.916820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 594/1182] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:12 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:13.648249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0df7aaba-c3a4-4ad8-acb9-7d4b72e0457d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:13.649155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0df7aaba-c3a4-4ad8-acb9-7d4b72e0457d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:13.655321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0df7aaba-c3a4-4ad8-acb9-7d4b72e0457d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:13.655769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0df7aaba-c3a4-4ad8-acb9-7d4b72e0457d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:13.656530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0df7aaba-c3a4-4ad8-acb9-7d4b72e0457d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:13.656974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0df7aaba-c3a4-4ad8-acb9-7d4b72e0457d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:13.685603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0df7aaba-c3a4-4ad8-acb9-7d4b72e0457d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041532 Mar 08 04:27:13.686208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 589/1183] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:13.770318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a5d32a7e-7fe8-4dd7-9a18-6f4196ad1993 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:13.771217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a5d32a7e-7fe8-4dd7-9a18-6f4196ad1993 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:13.777724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5d32a7e-7fe8-4dd7-9a18-6f4196ad1993 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:13.778172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5d32a7e-7fe8-4dd7-9a18-6f4196ad1993 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:13.778927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5d32a7e-7fe8-4dd7-9a18-6f4196ad1993 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:13.779356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5d32a7e-7fe8-4dd7-9a18-6f4196ad1993 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:13.807611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a5d32a7e-7fe8-4dd7-9a18-6f4196ad1993 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041741 Mar 08 04:27:13.808155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 595/1184] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:13.933847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b61bd9de-1f6e-4370-8fa2-557d9c38b263 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:13.934461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b61bd9de-1f6e-4370-8fa2-557d9c38b263 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:13.941276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b61bd9de-1f6e-4370-8fa2-557d9c38b263 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:13.941854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b61bd9de-1f6e-4370-8fa2-557d9c38b263 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:13.942632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b61bd9de-1f6e-4370-8fa2-557d9c38b263 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:13.943077 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b61bd9de-1f6e-4370-8fa2-557d9c38b263 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:14.075022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b61bd9de-1f6e-4370-8fa2-557d9c38b263 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:14.082627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b61bd9de-1f6e-4370-8fa2-557d9c38b263 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152672 Mar 08 04:27:14.083205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 590/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:13 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:14.697153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2f4f1e0a-224f-4f64-ab9c-2c4021035d72 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:14.698138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2f4f1e0a-224f-4f64-ab9c-2c4021035d72 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:14.703930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2f4f1e0a-224f-4f64-ab9c-2c4021035d72 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:14.704381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2f4f1e0a-224f-4f64-ab9c-2c4021035d72 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:14.705145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2f4f1e0a-224f-4f64-ab9c-2c4021035d72 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:14.705584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2f4f1e0a-224f-4f64-ab9c-2c4021035d72 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:14.732552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2f4f1e0a-224f-4f64-ab9c-2c4021035d72 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039390 Mar 08 04:27:14.733089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 596/1186] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:14.818920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57cf2c68-e9f0-4224-8326-4339b7f5684b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:14.819978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-57cf2c68-e9f0-4224-8326-4339b7f5684b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:14.825821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57cf2c68-e9f0-4224-8326-4339b7f5684b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:14.826264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57cf2c68-e9f0-4224-8326-4339b7f5684b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:14.827014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57cf2c68-e9f0-4224-8326-4339b7f5684b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:14.827444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57cf2c68-e9f0-4224-8326-4339b7f5684b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:14.855933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-57cf2c68-e9f0-4224-8326-4339b7f5684b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040938 Mar 08 04:27:14.856485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 591/1187] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:15.100806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8b4b934e-1d9a-445d-955b-47f9833aef4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:15.101637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8b4b934e-1d9a-445d-955b-47f9833aef4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:15.108768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8b4b934e-1d9a-445d-955b-47f9833aef4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:15.109215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8b4b934e-1d9a-445d-955b-47f9833aef4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:15.110021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8b4b934e-1d9a-445d-955b-47f9833aef4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:15.110455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8b4b934e-1d9a-445d-955b-47f9833aef4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:15.242363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8b4b934e-1d9a-445d-955b-47f9833aef4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:15.249586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8b4b934e-1d9a-445d-955b-47f9833aef4e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154579 Mar 08 04:27:15.250173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 597/1188] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:15 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:15.744571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a2f49185-196e-46b9-8a6b-1fa2d020c9d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:15.745474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a2f49185-196e-46b9-8a6b-1fa2d020c9d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:15.751677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2f49185-196e-46b9-8a6b-1fa2d020c9d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:15.752118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2f49185-196e-46b9-8a6b-1fa2d020c9d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:15.752902 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2f49185-196e-46b9-8a6b-1fa2d020c9d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:15.753330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2f49185-196e-46b9-8a6b-1fa2d020c9d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:15.781967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a2f49185-196e-46b9-8a6b-1fa2d020c9d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041168 Mar 08 04:27:15.782510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 592/1189] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:15.869995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ab39afa8-8d07-4e64-a0e0-5a5813bf185b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:15.870908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ab39afa8-8d07-4e64-a0e0-5a5813bf185b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:15.876920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab39afa8-8d07-4e64-a0e0-5a5813bf185b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:15.877589 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab39afa8-8d07-4e64-a0e0-5a5813bf185b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:15.878532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab39afa8-8d07-4e64-a0e0-5a5813bf185b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:15.879198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab39afa8-8d07-4e64-a0e0-5a5813bf185b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:15.913605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ab39afa8-8d07-4e64-a0e0-5a5813bf185b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050122 Mar 08 04:27:15.914168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 598/1190] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:16.266397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0dd9a68c-42a2-467c-ab98-c41d2d462be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:16.267006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0dd9a68c-42a2-467c-ab98-c41d2d462be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:16.272865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0dd9a68c-42a2-467c-ab98-c41d2d462be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:16.273316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0dd9a68c-42a2-467c-ab98-c41d2d462be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:16.274104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0dd9a68c-42a2-467c-ab98-c41d2d462be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:16.274537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0dd9a68c-42a2-467c-ab98-c41d2d462be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:16.407023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0dd9a68c-42a2-467c-ab98-c41d2d462be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:16.414754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0dd9a68c-42a2-467c-ab98-c41d2d462be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152189 Mar 08 04:27:16.415314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 593/1191] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:16.793612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-04e05830-2618-4503-a7a4-bf4ac6faf9ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:16.794546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-04e05830-2618-4503-a7a4-bf4ac6faf9ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:16.801215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04e05830-2618-4503-a7a4-bf4ac6faf9ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:16.801679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04e05830-2618-4503-a7a4-bf4ac6faf9ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:16.802438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04e05830-2618-4503-a7a4-bf4ac6faf9ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:16.802867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04e05830-2618-4503-a7a4-bf4ac6faf9ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:16.830881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-04e05830-2618-4503-a7a4-bf4ac6faf9ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041216 Mar 08 04:27:16.831421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 599/1192] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:16 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:16.924421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bf6ce085-3f57-4975-9330-1a401f5d425a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:16.925332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bf6ce085-3f57-4975-9330-1a401f5d425a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:16.931670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6ce085-3f57-4975-9330-1a401f5d425a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:16.932114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6ce085-3f57-4975-9330-1a401f5d425a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:16.932882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6ce085-3f57-4975-9330-1a401f5d425a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:16.933323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6ce085-3f57-4975-9330-1a401f5d425a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:16.961044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bf6ce085-3f57-4975-9330-1a401f5d425a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040587 Mar 08 04:27:16.961581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 594/1193] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:17.431679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bf32d3a2-07cf-419c-afbf-fb9a0a3a3b4d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:17.432288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bf32d3a2-07cf-419c-afbf-fb9a0a3a3b4d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:17.438331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf32d3a2-07cf-419c-afbf-fb9a0a3a3b4d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:17.438784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf32d3a2-07cf-419c-afbf-fb9a0a3a3b4d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:17.439547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf32d3a2-07cf-419c-afbf-fb9a0a3a3b4d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:17.439985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf32d3a2-07cf-419c-afbf-fb9a0a3a3b4d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:17.577441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bf32d3a2-07cf-419c-afbf-fb9a0a3a3b4d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:17.584715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bf32d3a2-07cf-419c-afbf-fb9a0a3a3b4d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156926 Mar 08 04:27:17.585273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 600/1194] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:17 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:17.842600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-893fbbbc-56df-4a11-9525-cbcad083414e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:17.843502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-893fbbbc-56df-4a11-9525-cbcad083414e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:17.852436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-893fbbbc-56df-4a11-9525-cbcad083414e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:17.852885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-893fbbbc-56df-4a11-9525-cbcad083414e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:17.853685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-893fbbbc-56df-4a11-9525-cbcad083414e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:17.854660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-893fbbbc-56df-4a11-9525-cbcad083414e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:17.882802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-893fbbbc-56df-4a11-9525-cbcad083414e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Mar 08 04:27:17.883341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 595/1195] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:17.972795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ed30eb79-be6e-4d93-b237-b5d0469ac03f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:17.973723 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ed30eb79-be6e-4d93-b237-b5d0469ac03f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:17.979964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed30eb79-be6e-4d93-b237-b5d0469ac03f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:17.980434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed30eb79-be6e-4d93-b237-b5d0469ac03f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:17.981174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed30eb79-be6e-4d93-b237-b5d0469ac03f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:17.981608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed30eb79-be6e-4d93-b237-b5d0469ac03f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:18.009636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ed30eb79-be6e-4d93-b237-b5d0469ac03f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040877 Mar 08 04:27:18.010195 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 601/1196] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:18.601823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-46bd2ec9-2fe2-4139-9a68-f8777e911446 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:18.602432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-46bd2ec9-2fe2-4139-9a68-f8777e911446 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:18.608233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46bd2ec9-2fe2-4139-9a68-f8777e911446 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:18.608680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46bd2ec9-2fe2-4139-9a68-f8777e911446 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:18.610097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46bd2ec9-2fe2-4139-9a68-f8777e911446 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:18.610535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46bd2ec9-2fe2-4139-9a68-f8777e911446 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:18.746260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-46bd2ec9-2fe2-4139-9a68-f8777e911446 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:18.754084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-46bd2ec9-2fe2-4139-9a68-f8777e911446 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155572 Mar 08 04:27:18.754887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 596/1197] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:18 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:18.894220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5eb38157-d985-4eff-8e22-ed6e4a5cc2f1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:18.895788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5eb38157-d985-4eff-8e22-ed6e4a5cc2f1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:18.902024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5eb38157-d985-4eff-8e22-ed6e4a5cc2f1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:18.902469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5eb38157-d985-4eff-8e22-ed6e4a5cc2f1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:18.903230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5eb38157-d985-4eff-8e22-ed6e4a5cc2f1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:18.903659 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5eb38157-d985-4eff-8e22-ed6e4a5cc2f1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:18.933212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5eb38157-d985-4eff-8e22-ed6e4a5cc2f1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Mar 08 04:27:18.933768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 602/1198] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:19.020372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f0e68547-419d-4897-ba23-f7fd868c91b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:19.021217 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f0e68547-419d-4897-ba23-f7fd868c91b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:19.027764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f0e68547-419d-4897-ba23-f7fd868c91b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:19.028210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f0e68547-419d-4897-ba23-f7fd868c91b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:19.028970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f0e68547-419d-4897-ba23-f7fd868c91b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:19.029407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f0e68547-419d-4897-ba23-f7fd868c91b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:19.057488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f0e68547-419d-4897-ba23-f7fd868c91b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041030 Mar 08 04:27:19.058063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 597/1199] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:19.771729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d8b03dd5-857e-4228-969b-3c4152f91e47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:19.772422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d8b03dd5-857e-4228-969b-3c4152f91e47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:19.779025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8b03dd5-857e-4228-969b-3c4152f91e47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:19.779468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8b03dd5-857e-4228-969b-3c4152f91e47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:19.780227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8b03dd5-857e-4228-969b-3c4152f91e47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:19.780660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8b03dd5-857e-4228-969b-3c4152f91e47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:19.919036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d8b03dd5-857e-4228-969b-3c4152f91e47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:19.923719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:27:19.924176 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:27:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:27:19.926215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d8b03dd5-857e-4228-969b-3c4152f91e47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158768 Mar 08 04:27:19.926959 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 603/1200] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:19.944157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-05bb58a3-8e20-4ab8-94d5-88e4c47ce67d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:19.945095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-05bb58a3-8e20-4ab8-94d5-88e4c47ce67d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:19.950956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05bb58a3-8e20-4ab8-94d5-88e4c47ce67d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:19.951396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05bb58a3-8e20-4ab8-94d5-88e4c47ce67d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:19.952161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05bb58a3-8e20-4ab8-94d5-88e4c47ce67d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:19.952591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05bb58a3-8e20-4ab8-94d5-88e4c47ce67d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:19.980082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-05bb58a3-8e20-4ab8-94d5-88e4c47ce67d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039803 Mar 08 04:27:19.980609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 598/1201] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:20.069512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-88109701-8eb2-401c-9a7f-2ed4d12c315c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:20.070383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-88109701-8eb2-401c-9a7f-2ed4d12c315c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:20.076229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88109701-8eb2-401c-9a7f-2ed4d12c315c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:20.076685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88109701-8eb2-401c-9a7f-2ed4d12c315c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:20.077484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88109701-8eb2-401c-9a7f-2ed4d12c315c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:20.077942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88109701-8eb2-401c-9a7f-2ed4d12c315c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:20.106082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-88109701-8eb2-401c-9a7f-2ed4d12c315c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041247 Mar 08 04:27:20.106632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 604/1202] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:20.943924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4af91bfe-32c7-4a7d-a062-2e9ce765f616 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:20.944570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4af91bfe-32c7-4a7d-a062-2e9ce765f616 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:20.950784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4af91bfe-32c7-4a7d-a062-2e9ce765f616 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:20.951235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4af91bfe-32c7-4a7d-a062-2e9ce765f616 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:20.951997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4af91bfe-32c7-4a7d-a062-2e9ce765f616 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:20.952430 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4af91bfe-32c7-4a7d-a062-2e9ce765f616 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:20.991573 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b57f7d29-de42-418a-93e2-ec1ec33c0c2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:20.992544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b57f7d29-de42-418a-93e2-ec1ec33c0c2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:20.999077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b57f7d29-de42-418a-93e2-ec1ec33c0c2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:20.999599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b57f7d29-de42-418a-93e2-ec1ec33c0c2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:21.000428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b57f7d29-de42-418a-93e2-ec1ec33c0c2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:21.000928 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b57f7d29-de42-418a-93e2-ec1ec33c0c2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:21.030121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b57f7d29-de42-418a-93e2-ec1ec33c0c2a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042596 Mar 08 04:27:21.030679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 605/1203] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:20 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:21.088457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4af91bfe-32c7-4a7d-a062-2e9ce765f616 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:21.095773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4af91bfe-32c7-4a7d-a062-2e9ce765f616 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156014 Mar 08 04:27:21.096362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 599/1204] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:20 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:21.117517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6d6b8608-f3d4-4135-9534-28521956889e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:21.118511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6d6b8608-f3d4-4135-9534-28521956889e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:21.124192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d6b8608-f3d4-4135-9534-28521956889e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:21.124644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d6b8608-f3d4-4135-9534-28521956889e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:21.125407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d6b8608-f3d4-4135-9534-28521956889e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:21.125879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d6b8608-f3d4-4135-9534-28521956889e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:21.160192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6d6b8608-f3d4-4135-9534-28521956889e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047140 Mar 08 04:27:21.160734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 606/1205] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:22.042014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d1b98818-08f6-4921-9b31-f23223880215 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:22.042836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d1b98818-08f6-4921-9b31-f23223880215 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:22.048977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d1b98818-08f6-4921-9b31-f23223880215 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:22.049422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d1b98818-08f6-4921-9b31-f23223880215 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:22.050847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d1b98818-08f6-4921-9b31-f23223880215 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:22.051362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d1b98818-08f6-4921-9b31-f23223880215 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:22.079079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d1b98818-08f6-4921-9b31-f23223880215 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041153 Mar 08 04:27:22.079607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 600/1206] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:22.112266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ca7b0d1e-8a58-4554-b5f2-a8524877334e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:22.112917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ca7b0d1e-8a58-4554-b5f2-a8524877334e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:22.119208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca7b0d1e-8a58-4554-b5f2-a8524877334e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:22.119659 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca7b0d1e-8a58-4554-b5f2-a8524877334e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:22.120426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca7b0d1e-8a58-4554-b5f2-a8524877334e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:22.120868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ca7b0d1e-8a58-4554-b5f2-a8524877334e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:22.171736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-325b34ac-b139-44df-9bf4-ac9c7cb48444 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:22.172776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-325b34ac-b139-44df-9bf4-ac9c7cb48444 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:22.179559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-325b34ac-b139-44df-9bf4-ac9c7cb48444 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:22.180013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-325b34ac-b139-44df-9bf4-ac9c7cb48444 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:22.180815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-325b34ac-b139-44df-9bf4-ac9c7cb48444 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:22.181260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-325b34ac-b139-44df-9bf4-ac9c7cb48444 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:22.210910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-325b34ac-b139-44df-9bf4-ac9c7cb48444 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 Mar 08 04:27:22.211471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 601/1207] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:22.256244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ca7b0d1e-8a58-4554-b5f2-a8524877334e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:22.263473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ca7b0d1e-8a58-4554-b5f2-a8524877334e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155150 Mar 08 04:27:22.264022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 607/1208] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:22 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:27:23.091607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-437a5697-87a3-4bd8-b8e7-42a8b5b2f54c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:23.092549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-437a5697-87a3-4bd8-b8e7-42a8b5b2f54c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:23.099616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-437a5697-87a3-4bd8-b8e7-42a8b5b2f54c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:23.100068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-437a5697-87a3-4bd8-b8e7-42a8b5b2f54c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:23.100839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-437a5697-87a3-4bd8-b8e7-42a8b5b2f54c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:23.101274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-437a5697-87a3-4bd8-b8e7-42a8b5b2f54c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:23.129627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-437a5697-87a3-4bd8-b8e7-42a8b5b2f54c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 Mar 08 04:27:23.130200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 602/1209] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:23.223314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-32dbd3e4-f1bb-4367-ac9c-aef145bbf4c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:23.224221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-32dbd3e4-f1bb-4367-ac9c-aef145bbf4c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:23.230450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32dbd3e4-f1bb-4367-ac9c-aef145bbf4c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:23.230903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32dbd3e4-f1bb-4367-ac9c-aef145bbf4c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:23.231663 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32dbd3e4-f1bb-4367-ac9c-aef145bbf4c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:23.232100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32dbd3e4-f1bb-4367-ac9c-aef145bbf4c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:23.260226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-32dbd3e4-f1bb-4367-ac9c-aef145bbf4c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041517 Mar 08 04:27:23.260747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 608/1210] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:23.280406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-abf0f9ad-3072-4a92-a950-81c4aef144b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:23.281042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-abf0f9ad-3072-4a92-a950-81c4aef144b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:23.286998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-abf0f9ad-3072-4a92-a950-81c4aef144b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:23.287450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-abf0f9ad-3072-4a92-a950-81c4aef144b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:23.288217 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-abf0f9ad-3072-4a92-a950-81c4aef144b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:23.288655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-abf0f9ad-3072-4a92-a950-81c4aef144b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:23.418895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-abf0f9ad-3072-4a92-a950-81c4aef144b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:23.426822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-abf0f9ad-3072-4a92-a950-81c4aef144b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150255 Mar 08 04:27:23.427386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 603/1211] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:24.140562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a14d21a5-9947-4449-8d7b-2bf57c5e9d60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:24.141399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a14d21a5-9947-4449-8d7b-2bf57c5e9d60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:24.147204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a14d21a5-9947-4449-8d7b-2bf57c5e9d60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:24.147656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a14d21a5-9947-4449-8d7b-2bf57c5e9d60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:24.148420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a14d21a5-9947-4449-8d7b-2bf57c5e9d60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:24.148867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a14d21a5-9947-4449-8d7b-2bf57c5e9d60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:24.177009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a14d21a5-9947-4449-8d7b-2bf57c5e9d60 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040487 Mar 08 04:27:24.177541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 609/1212] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:24 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:24.277141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-178f570b-03c3-4506-8379-c959c9b37694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:24.278069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-178f570b-03c3-4506-8379-c959c9b37694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:24.284202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-178f570b-03c3-4506-8379-c959c9b37694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:24.285196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-178f570b-03c3-4506-8379-c959c9b37694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:24.285976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-178f570b-03c3-4506-8379-c959c9b37694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:24.286405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-178f570b-03c3-4506-8379-c959c9b37694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:24.313891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-178f570b-03c3-4506-8379-c959c9b37694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041040 Mar 08 04:27:24.314430 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 604/1213] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:24.444258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-56ad3e63-87c9-4ac2-a56b-0d30dd3684c6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:24.444882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-56ad3e63-87c9-4ac2-a56b-0d30dd3684c6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:24.451193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56ad3e63-87c9-4ac2-a56b-0d30dd3684c6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:24.451644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56ad3e63-87c9-4ac2-a56b-0d30dd3684c6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:24.452412 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56ad3e63-87c9-4ac2-a56b-0d30dd3684c6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:24.452847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56ad3e63-87c9-4ac2-a56b-0d30dd3684c6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:24.588137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-56ad3e63-87c9-4ac2-a56b-0d30dd3684c6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:24.595348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-56ad3e63-87c9-4ac2-a56b-0d30dd3684c6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155571 Mar 08 04:27:24.595904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 610/1214] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:24 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:25.188313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5e2c50f1-0c6c-4ace-8d30-e9386caa57da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:25.189210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5e2c50f1-0c6c-4ace-8d30-e9386caa57da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:25.195100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e2c50f1-0c6c-4ace-8d30-e9386caa57da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:25.195544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e2c50f1-0c6c-4ace-8d30-e9386caa57da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:25.196293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e2c50f1-0c6c-4ace-8d30-e9386caa57da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:25.196720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e2c50f1-0c6c-4ace-8d30-e9386caa57da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:25.224241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5e2c50f1-0c6c-4ace-8d30-e9386caa57da tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039834 Mar 08 04:27:25.224772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 605/1215] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:25 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:25.325913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fb448df1-b360-422f-a56e-e0b0603c655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:25.326853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fb448df1-b360-422f-a56e-e0b0603c655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:25.333237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb448df1-b360-422f-a56e-e0b0603c655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:25.333705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb448df1-b360-422f-a56e-e0b0603c655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:25.334472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb448df1-b360-422f-a56e-e0b0603c655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:25.334904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb448df1-b360-422f-a56e-e0b0603c655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:25.362664 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fb448df1-b360-422f-a56e-e0b0603c655d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040734 Mar 08 04:27:25.363285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 611/1216] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:25.612489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-37c84392-5d38-487b-bd69-a2b68c266b05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:25.613099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-37c84392-5d38-487b-bd69-a2b68c266b05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:25.619229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37c84392-5d38-487b-bd69-a2b68c266b05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:25.619650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37c84392-5d38-487b-bd69-a2b68c266b05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:25.620430 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37c84392-5d38-487b-bd69-a2b68c266b05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:25.620861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37c84392-5d38-487b-bd69-a2b68c266b05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:25.752171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-37c84392-5d38-487b-bd69-a2b68c266b05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:25.759971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-37c84392-5d38-487b-bd69-a2b68c266b05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151646 Mar 08 04:27:25.760521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 606/1217] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:26.235796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6db9e4af-1c33-415c-9e7f-0cd53ff7877e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:26.236708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6db9e4af-1c33-415c-9e7f-0cd53ff7877e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:26.243467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6db9e4af-1c33-415c-9e7f-0cd53ff7877e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:26.243915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6db9e4af-1c33-415c-9e7f-0cd53ff7877e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:26.244675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6db9e4af-1c33-415c-9e7f-0cd53ff7877e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:26.245109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6db9e4af-1c33-415c-9e7f-0cd53ff7877e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:26.273292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6db9e4af-1c33-415c-9e7f-0cd53ff7877e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041463 Mar 08 04:27:26.273851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 612/1218] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:26.374254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8428ca76-7726-4cab-a575-67e54546b8a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:26.375152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8428ca76-7726-4cab-a575-67e54546b8a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:26.382148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8428ca76-7726-4cab-a575-67e54546b8a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:26.382601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8428ca76-7726-4cab-a575-67e54546b8a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:26.383366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8428ca76-7726-4cab-a575-67e54546b8a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:26.383827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8428ca76-7726-4cab-a575-67e54546b8a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:26.411393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8428ca76-7726-4cab-a575-67e54546b8a3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041066 Mar 08 04:27:26.411923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 607/1219] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:26.777785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2a4ce3f3-1ee7-460e-a052-75fe1c31c159 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:26.778393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2a4ce3f3-1ee7-460e-a052-75fe1c31c159 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:26.784185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2a4ce3f3-1ee7-460e-a052-75fe1c31c159 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:26.785220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2a4ce3f3-1ee7-460e-a052-75fe1c31c159 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:26.786050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2a4ce3f3-1ee7-460e-a052-75fe1c31c159 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:26.786484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2a4ce3f3-1ee7-460e-a052-75fe1c31c159 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:26.920581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2a4ce3f3-1ee7-460e-a052-75fe1c31c159 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:26.928149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2a4ce3f3-1ee7-460e-a052-75fe1c31c159 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154649 Mar 08 04:27:26.928707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 613/1220] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:26 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:27.285503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-307ff103-f7df-41b1-8f24-3118fb5bafe2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:27.286457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-307ff103-f7df-41b1-8f24-3118fb5bafe2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:27.292641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-307ff103-f7df-41b1-8f24-3118fb5bafe2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:27.293085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-307ff103-f7df-41b1-8f24-3118fb5bafe2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:27.295148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-307ff103-f7df-41b1-8f24-3118fb5bafe2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:27.295588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-307ff103-f7df-41b1-8f24-3118fb5bafe2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:27.323296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-307ff103-f7df-41b1-8f24-3118fb5bafe2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042223 Mar 08 04:27:27.323829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 608/1221] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:27 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:27.422839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a86d10da-edfb-4f4f-9142-539f12e197af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:27.423760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a86d10da-edfb-4f4f-9142-539f12e197af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:27.430873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a86d10da-edfb-4f4f-9142-539f12e197af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:27.431326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a86d10da-edfb-4f4f-9142-539f12e197af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:27.432088 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a86d10da-edfb-4f4f-9142-539f12e197af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:27.432521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a86d10da-edfb-4f4f-9142-539f12e197af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:27.460155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a86d10da-edfb-4f4f-9142-539f12e197af tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041289 Mar 08 04:27:27.460691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 614/1222] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:27.946011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e73e651d-0123-475f-8833-8d9221ef2a02 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:27.946647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e73e651d-0123-475f-8833-8d9221ef2a02 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:27.952480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e73e651d-0123-475f-8833-8d9221ef2a02 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:27.952928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e73e651d-0123-475f-8833-8d9221ef2a02 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:27.953720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e73e651d-0123-475f-8833-8d9221ef2a02 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:27.954159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e73e651d-0123-475f-8833-8d9221ef2a02 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:28.083761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e73e651d-0123-475f-8833-8d9221ef2a02 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:28.091096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e73e651d-0123-475f-8833-8d9221ef2a02 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.148956 Mar 08 04:27:28.091650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 609/1223] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:27 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:28.334030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-947c7660-6b88-4fe2-aaee-890efc82465c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:28.334942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-947c7660-6b88-4fe2-aaee-890efc82465c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:28.340762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-947c7660-6b88-4fe2-aaee-890efc82465c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:28.341213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-947c7660-6b88-4fe2-aaee-890efc82465c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:28.342001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-947c7660-6b88-4fe2-aaee-890efc82465c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:28.342437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-947c7660-6b88-4fe2-aaee-890efc82465c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:28.369981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-947c7660-6b88-4fe2-aaee-890efc82465c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040021 Mar 08 04:27:28.370512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 615/1224] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:28.471361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-59c26581-a924-4e09-bdad-49da51dadecb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:28.472389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-59c26581-a924-4e09-bdad-49da51dadecb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:28.478617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59c26581-a924-4e09-bdad-49da51dadecb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:28.479059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59c26581-a924-4e09-bdad-49da51dadecb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:28.479810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59c26581-a924-4e09-bdad-49da51dadecb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:28.480239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59c26581-a924-4e09-bdad-49da51dadecb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:28.508377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-59c26581-a924-4e09-bdad-49da51dadecb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040880 Mar 08 04:27:28.508910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 610/1225] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:29.108257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-55f5c554-1989-4b10-b459-0249b086644d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:29.108790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-55f5c554-1989-4b10-b459-0249b086644d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:29.115626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55f5c554-1989-4b10-b459-0249b086644d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:29.116070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55f5c554-1989-4b10-b459-0249b086644d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:29.116826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55f5c554-1989-4b10-b459-0249b086644d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:29.117258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55f5c554-1989-4b10-b459-0249b086644d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:29.248860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-55f5c554-1989-4b10-b459-0249b086644d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:29.256822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-55f5c554-1989-4b10-b459-0249b086644d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152483 Mar 08 04:27:29.257373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 616/1226] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:29 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:29.381250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3f22987b-eefc-420f-8c6a-16ff39213d86 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:29.382186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3f22987b-eefc-420f-8c6a-16ff39213d86 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:29.387919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f22987b-eefc-420f-8c6a-16ff39213d86 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:29.388359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f22987b-eefc-420f-8c6a-16ff39213d86 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:29.389110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f22987b-eefc-420f-8c6a-16ff39213d86 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:29.389536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f22987b-eefc-420f-8c6a-16ff39213d86 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:29.416707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3f22987b-eefc-420f-8c6a-16ff39213d86 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040321 Mar 08 04:27:29.417266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 611/1227] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:29 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:29.520325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c5305e7c-40a1-4391-a14c-44cc74d6ef7a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:29.521241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c5305e7c-40a1-4391-a14c-44cc74d6ef7a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:29.527441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5305e7c-40a1-4391-a14c-44cc74d6ef7a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:29.527886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5305e7c-40a1-4391-a14c-44cc74d6ef7a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:29.528647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5305e7c-40a1-4391-a14c-44cc74d6ef7a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:29.529080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5305e7c-40a1-4391-a14c-44cc74d6ef7a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:29.557244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c5305e7c-40a1-4391-a14c-44cc74d6ef7a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Mar 08 04:27:29.557817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 617/1228] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:30.274276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0a86a6d0-fb52-42dc-b9d8-2aff6ea56950 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:30.274878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0a86a6d0-fb52-42dc-b9d8-2aff6ea56950 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:30.281433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a86a6d0-fb52-42dc-b9d8-2aff6ea56950 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:30.281907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a86a6d0-fb52-42dc-b9d8-2aff6ea56950 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:30.282661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a86a6d0-fb52-42dc-b9d8-2aff6ea56950 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:30.283092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a86a6d0-fb52-42dc-b9d8-2aff6ea56950 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:30.415949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0a86a6d0-fb52-42dc-b9d8-2aff6ea56950 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:30.423211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0a86a6d0-fb52-42dc-b9d8-2aff6ea56950 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152724 Mar 08 04:27:30.423764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 612/1229] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:30 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:30.428072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-937337f0-7fad-47e7-98a2-f1e10ca17d31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:30.429006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-937337f0-7fad-47e7-98a2-f1e10ca17d31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:30.435228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-937337f0-7fad-47e7-98a2-f1e10ca17d31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:30.435675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-937337f0-7fad-47e7-98a2-f1e10ca17d31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:30.436437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-937337f0-7fad-47e7-98a2-f1e10ca17d31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:30.436874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-937337f0-7fad-47e7-98a2-f1e10ca17d31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:30.465406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-937337f0-7fad-47e7-98a2-f1e10ca17d31 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Mar 08 04:27:30.465983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 618/1230] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:30 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:30.568947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3e693422-8b6a-4c4e-a108-633e34f8d84f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:30.569830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3e693422-8b6a-4c4e-a108-633e34f8d84f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:30.575632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e693422-8b6a-4c4e-a108-633e34f8d84f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:30.576081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e693422-8b6a-4c4e-a108-633e34f8d84f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:30.576841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e693422-8b6a-4c4e-a108-633e34f8d84f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:30.577279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e693422-8b6a-4c4e-a108-633e34f8d84f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:30.605182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3e693422-8b6a-4c4e-a108-633e34f8d84f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Mar 08 04:27:30.605735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 613/1231] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:31.440192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7df6072b-29d7-42d9-abc2-c7e72d781afc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:31.440896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7df6072b-29d7-42d9-abc2-c7e72d781afc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:31.447106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7df6072b-29d7-42d9-abc2-c7e72d781afc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:31.447549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7df6072b-29d7-42d9-abc2-c7e72d781afc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:31.448305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7df6072b-29d7-42d9-abc2-c7e72d781afc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:31.448743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7df6072b-29d7-42d9-abc2-c7e72d781afc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:31.477044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-21c40cb1-07d1-4b53-8cb5-086dd2c3ba41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:31.477998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-21c40cb1-07d1-4b53-8cb5-086dd2c3ba41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:31.484231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21c40cb1-07d1-4b53-8cb5-086dd2c3ba41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:31.484703 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21c40cb1-07d1-4b53-8cb5-086dd2c3ba41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:31.485478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21c40cb1-07d1-4b53-8cb5-086dd2c3ba41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:31.485949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21c40cb1-07d1-4b53-8cb5-086dd2c3ba41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:31.519399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-21c40cb1-07d1-4b53-8cb5-086dd2c3ba41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Mar 08 04:27:31.520138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 614/1232] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:31.581982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7df6072b-29d7-42d9-abc2-c7e72d781afc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:31.589108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7df6072b-29d7-42d9-abc2-c7e72d781afc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152750 Mar 08 04:27:31.589679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 619/1233] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:31 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:31.616235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c9f36bba-484a-4b72-9519-58487f5984a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:31.617165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c9f36bba-484a-4b72-9519-58487f5984a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:31.622950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9f36bba-484a-4b72-9519-58487f5984a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:31.623391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9f36bba-484a-4b72-9519-58487f5984a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:31.624139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9f36bba-484a-4b72-9519-58487f5984a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:31.624567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9f36bba-484a-4b72-9519-58487f5984a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:31.652898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c9f36bba-484a-4b72-9519-58487f5984a9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040577 Mar 08 04:27:31.653436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 615/1234] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:32.531248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0faccca0-2191-465a-9845-7eaf60449ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:32.532158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0faccca0-2191-465a-9845-7eaf60449ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:32.539035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0faccca0-2191-465a-9845-7eaf60449ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:32.539476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0faccca0-2191-465a-9845-7eaf60449ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:32.540233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0faccca0-2191-465a-9845-7eaf60449ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:32.540663 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0faccca0-2191-465a-9845-7eaf60449ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:32.568879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0faccca0-2191-465a-9845-7eaf60449ffc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041596 Mar 08 04:27:32.569406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 620/1235] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:32.606396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c0931ca4-5242-4165-a35c-22686d070b25 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:32.606995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c0931ca4-5242-4165-a35c-22686d070b25 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:32.613804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0931ca4-5242-4165-a35c-22686d070b25 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:32.614356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0931ca4-5242-4165-a35c-22686d070b25 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:32.615116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0931ca4-5242-4165-a35c-22686d070b25 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:32.615543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0931ca4-5242-4165-a35c-22686d070b25 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:32.665110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ef852bae-95e5-475a-87d9-685450deac11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:32.666061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ef852bae-95e5-475a-87d9-685450deac11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:32.671900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef852bae-95e5-475a-87d9-685450deac11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:32.672355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef852bae-95e5-475a-87d9-685450deac11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:32.673128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef852bae-95e5-475a-87d9-685450deac11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:32.673627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef852bae-95e5-475a-87d9-685450deac11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:32.702435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ef852bae-95e5-475a-87d9-685450deac11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041244 Mar 08 04:27:32.702990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 621/1236] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:32.750585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c0931ca4-5242-4165-a35c-22686d070b25 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:32.758910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c0931ca4-5242-4165-a35c-22686d070b25 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156433 Mar 08 04:27:32.759467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 616/1237] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:32 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:33.580282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-12a23543-670d-4b49-9188-7535fd3e7fa2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:33.581924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-12a23543-670d-4b49-9188-7535fd3e7fa2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:33.588090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12a23543-670d-4b49-9188-7535fd3e7fa2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:33.588538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12a23543-670d-4b49-9188-7535fd3e7fa2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:33.589300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12a23543-670d-4b49-9188-7535fd3e7fa2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:33.589770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12a23543-670d-4b49-9188-7535fd3e7fa2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:33.617517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-12a23543-670d-4b49-9188-7535fd3e7fa2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041240 Mar 08 04:27:33.618087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 622/1238] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:33.714032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b16cae53-91ec-4548-9b60-d8351bae9939 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:33.715046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b16cae53-91ec-4548-9b60-d8351bae9939 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:33.722444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b16cae53-91ec-4548-9b60-d8351bae9939 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:33.722912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b16cae53-91ec-4548-9b60-d8351bae9939 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:33.723739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b16cae53-91ec-4548-9b60-d8351bae9939 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:33.724245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b16cae53-91ec-4548-9b60-d8351bae9939 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:33.752306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b16cae53-91ec-4548-9b60-d8351bae9939 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042353 Mar 08 04:27:33.753498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 617/1239] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:33.774702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1135e03f-1fa7-4f15-a4c1-08e626e33f6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:33.775312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1135e03f-1fa7-4f15-a4c1-08e626e33f6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:33.781409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1135e03f-1fa7-4f15-a4c1-08e626e33f6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:33.781899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1135e03f-1fa7-4f15-a4c1-08e626e33f6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:33.782661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1135e03f-1fa7-4f15-a4c1-08e626e33f6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:33.783098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1135e03f-1fa7-4f15-a4c1-08e626e33f6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:33.914881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1135e03f-1fa7-4f15-a4c1-08e626e33f6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:33.922063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1135e03f-1fa7-4f15-a4c1-08e626e33f6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151195 Mar 08 04:27:33.922616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 623/1240] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:33 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:34.628515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e7cfa4d2-8b1e-4dc1-92f9-1e7f4362e542 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:34.629449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e7cfa4d2-8b1e-4dc1-92f9-1e7f4362e542 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:34.635380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7cfa4d2-8b1e-4dc1-92f9-1e7f4362e542 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:34.635829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7cfa4d2-8b1e-4dc1-92f9-1e7f4362e542 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:34.636594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7cfa4d2-8b1e-4dc1-92f9-1e7f4362e542 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:34.637027 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e7cfa4d2-8b1e-4dc1-92f9-1e7f4362e542 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:34.665585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e7cfa4d2-8b1e-4dc1-92f9-1e7f4362e542 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041089 Mar 08 04:27:34.666159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 618/1241] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:34 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:34.764179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-18b811a2-fe33-43fc-8d22-b9b6f8ac0e84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:34.765085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-18b811a2-fe33-43fc-8d22-b9b6f8ac0e84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:34.772076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18b811a2-fe33-43fc-8d22-b9b6f8ac0e84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:34.772522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18b811a2-fe33-43fc-8d22-b9b6f8ac0e84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:34.773278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18b811a2-fe33-43fc-8d22-b9b6f8ac0e84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:34.773732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18b811a2-fe33-43fc-8d22-b9b6f8ac0e84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:34.801288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-18b811a2-fe33-43fc-8d22-b9b6f8ac0e84 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041033 Mar 08 04:27:34.801845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 624/1242] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:34.939405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-248cb0dc-ea23-4cbe-b3d5-7c1b9222a8ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:34.940003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-248cb0dc-ea23-4cbe-b3d5-7c1b9222a8ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:34.946790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-248cb0dc-ea23-4cbe-b3d5-7c1b9222a8ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:34.947235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-248cb0dc-ea23-4cbe-b3d5-7c1b9222a8ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:34.947989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-248cb0dc-ea23-4cbe-b3d5-7c1b9222a8ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:34.948418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-248cb0dc-ea23-4cbe-b3d5-7c1b9222a8ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:35.082667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-248cb0dc-ea23-4cbe-b3d5-7c1b9222a8ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:35.089867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-248cb0dc-ea23-4cbe-b3d5-7c1b9222a8ae tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154243 Mar 08 04:27:35.090416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 619/1243] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:34 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:35.677238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-41652be8-558b-4471-83f0-3f57d855df95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:35.678205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-41652be8-558b-4471-83f0-3f57d855df95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:35.684298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41652be8-558b-4471-83f0-3f57d855df95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:35.684748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41652be8-558b-4471-83f0-3f57d855df95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:35.685518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41652be8-558b-4471-83f0-3f57d855df95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:35.685984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41652be8-558b-4471-83f0-3f57d855df95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:35.715252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-41652be8-558b-4471-83f0-3f57d855df95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Mar 08 04:27:35.715809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 625/1244] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:35.812956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-225f27d0-ae0b-4f9d-93cc-01d3ed797d55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:35.813919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-225f27d0-ae0b-4f9d-93cc-01d3ed797d55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:35.821618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-225f27d0-ae0b-4f9d-93cc-01d3ed797d55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:35.822422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-225f27d0-ae0b-4f9d-93cc-01d3ed797d55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:35.823489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-225f27d0-ae0b-4f9d-93cc-01d3ed797d55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:35.823933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-225f27d0-ae0b-4f9d-93cc-01d3ed797d55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:35.856639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-225f27d0-ae0b-4f9d-93cc-01d3ed797d55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047610 Mar 08 04:27:35.857227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 620/1245] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:36.107297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cbd3ebbf-b90e-4be9-947d-d760f36a2160 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:36.107840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cbd3ebbf-b90e-4be9-947d-d760f36a2160 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:36.113963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbd3ebbf-b90e-4be9-947d-d760f36a2160 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:36.114415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbd3ebbf-b90e-4be9-947d-d760f36a2160 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:36.115187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbd3ebbf-b90e-4be9-947d-d760f36a2160 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:36.115630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbd3ebbf-b90e-4be9-947d-d760f36a2160 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:36.247994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cbd3ebbf-b90e-4be9-947d-d760f36a2160 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:36.255788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cbd3ebbf-b90e-4be9-947d-d760f36a2160 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152482 Mar 08 04:27:36.256348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 626/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:36 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:36.727169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2ccb15ea-772d-4dc3-8cbd-5aba4f309dc5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:36.728068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2ccb15ea-772d-4dc3-8cbd-5aba4f309dc5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:36.734284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ccb15ea-772d-4dc3-8cbd-5aba4f309dc5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:36.734726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ccb15ea-772d-4dc3-8cbd-5aba4f309dc5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:36.735479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ccb15ea-772d-4dc3-8cbd-5aba4f309dc5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:36.735907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ccb15ea-772d-4dc3-8cbd-5aba4f309dc5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:36.764169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2ccb15ea-772d-4dc3-8cbd-5aba4f309dc5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040927 Mar 08 04:27:36.764711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 621/1247] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:36.868773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-07e4ddbc-3fd5-4f95-b781-96f5bd74a8ba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:36.869757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-07e4ddbc-3fd5-4f95-b781-96f5bd74a8ba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:36.875992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07e4ddbc-3fd5-4f95-b781-96f5bd74a8ba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:36.876444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07e4ddbc-3fd5-4f95-b781-96f5bd74a8ba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:36.877210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07e4ddbc-3fd5-4f95-b781-96f5bd74a8ba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:36.877682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07e4ddbc-3fd5-4f95-b781-96f5bd74a8ba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:36.909766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-07e4ddbc-3fd5-4f95-b781-96f5bd74a8ba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Mar 08 04:27:36.910324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 627/1248] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:37.272759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-67cfa5d0-54bc-4294-a57d-7d395aa8d713 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:37.273385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-67cfa5d0-54bc-4294-a57d-7d395aa8d713 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:37.279476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67cfa5d0-54bc-4294-a57d-7d395aa8d713 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:37.279918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67cfa5d0-54bc-4294-a57d-7d395aa8d713 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:37.280673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67cfa5d0-54bc-4294-a57d-7d395aa8d713 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:37.281104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67cfa5d0-54bc-4294-a57d-7d395aa8d713 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:37.412225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-67cfa5d0-54bc-4294-a57d-7d395aa8d713 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:37.419595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-67cfa5d0-54bc-4294-a57d-7d395aa8d713 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150688 Mar 08 04:27:37.420162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 622/1249] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:37 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:37.776223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-076dc8d1-0755-4b0e-a99a-a2b62b0ea37a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:37.777128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-076dc8d1-0755-4b0e-a99a-a2b62b0ea37a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:37.783012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-076dc8d1-0755-4b0e-a99a-a2b62b0ea37a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:37.783459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-076dc8d1-0755-4b0e-a99a-a2b62b0ea37a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:37.784213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-076dc8d1-0755-4b0e-a99a-a2b62b0ea37a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:37.784640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-076dc8d1-0755-4b0e-a99a-a2b62b0ea37a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:37.811653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-076dc8d1-0755-4b0e-a99a-a2b62b0ea37a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039653 Mar 08 04:27:37.812186 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 628/1250] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:37.920505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2ecf2941-b002-4628-adc7-e0662c0e9e91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:37.921414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2ecf2941-b002-4628-adc7-e0662c0e9e91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:37.927724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ecf2941-b002-4628-adc7-e0662c0e9e91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:37.928176 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ecf2941-b002-4628-adc7-e0662c0e9e91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:37.928941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ecf2941-b002-4628-adc7-e0662c0e9e91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:37.929378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ecf2941-b002-4628-adc7-e0662c0e9e91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:37.957575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2ecf2941-b002-4628-adc7-e0662c0e9e91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041090 Mar 08 04:27:37.958149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 623/1251] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:38.436289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4924a718-ba52-4574-9ece-cece5a79e9b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:38.436900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4924a718-ba52-4574-9ece-cece5a79e9b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:38.443710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4924a718-ba52-4574-9ece-cece5a79e9b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:38.444166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4924a718-ba52-4574-9ece-cece5a79e9b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:38.444934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4924a718-ba52-4574-9ece-cece5a79e9b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:38.445375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4924a718-ba52-4574-9ece-cece5a79e9b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:38.583457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4924a718-ba52-4574-9ece-cece5a79e9b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:38.590837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4924a718-ba52-4574-9ece-cece5a79e9b5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.158469 Mar 08 04:27:38.591397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 629/1252] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:38 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:38.675673 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:27:38.675983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:27:38.823427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e6e41d66-f176-4327-888a-e49880399755 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:38.824327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e6e41d66-f176-4327-888a-e49880399755 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:38.830138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6e41d66-f176-4327-888a-e49880399755 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:38.830580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6e41d66-f176-4327-888a-e49880399755 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:38.831878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6e41d66-f176-4327-888a-e49880399755 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:38.832312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6e41d66-f176-4327-888a-e49880399755 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:38.860435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e6e41d66-f176-4327-888a-e49880399755 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040854 Mar 08 04:27:38.860976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 624/1253] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:38 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:38.968901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e9cbbbca-53ca-4330-85bd-c05ba13d77c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:38.969845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e9cbbbca-53ca-4330-85bd-c05ba13d77c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:38.976265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9cbbbca-53ca-4330-85bd-c05ba13d77c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:38.976710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9cbbbca-53ca-4330-85bd-c05ba13d77c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:38.977464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9cbbbca-53ca-4330-85bd-c05ba13d77c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:38.977921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9cbbbca-53ca-4330-85bd-c05ba13d77c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:39.004552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e9cbbbca-53ca-4330-85bd-c05ba13d77c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039620 Mar 08 04:27:39.005075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 630/1254] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:39.607515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3983ff84-0bc9-4363-b627-9f059b59cd0b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:39.608036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3983ff84-0bc9-4363-b627-9f059b59cd0b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:39.615081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3983ff84-0bc9-4363-b627-9f059b59cd0b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:39.615536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3983ff84-0bc9-4363-b627-9f059b59cd0b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:39.616333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3983ff84-0bc9-4363-b627-9f059b59cd0b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:39.616775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3983ff84-0bc9-4363-b627-9f059b59cd0b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:39.747431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3983ff84-0bc9-4363-b627-9f059b59cd0b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:39.755718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3983ff84-0bc9-4363-b627-9f059b59cd0b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152080 Mar 08 04:27:39.756276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 625/1255] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:39 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:39.871906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-021223fe-ec65-4ec4-a620-6d6464b407b5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:39.872757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-021223fe-ec65-4ec4-a620-6d6464b407b5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:39.879916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021223fe-ec65-4ec4-a620-6d6464b407b5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:39.880356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021223fe-ec65-4ec4-a620-6d6464b407b5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:39.881198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021223fe-ec65-4ec4-a620-6d6464b407b5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:39.881639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-021223fe-ec65-4ec4-a620-6d6464b407b5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:39.909392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-021223fe-ec65-4ec4-a620-6d6464b407b5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041465 Mar 08 04:27:39.909962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 631/1256] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:40.016138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-651d5a4d-e36e-45cc-bd5a-2a7511f87e03 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:40.017047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-651d5a4d-e36e-45cc-bd5a-2a7511f87e03 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:40.023028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-651d5a4d-e36e-45cc-bd5a-2a7511f87e03 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:40.023473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-651d5a4d-e36e-45cc-bd5a-2a7511f87e03 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:40.024233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-651d5a4d-e36e-45cc-bd5a-2a7511f87e03 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:40.024672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-651d5a4d-e36e-45cc-bd5a-2a7511f87e03 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:40.052700 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-651d5a4d-e36e-45cc-bd5a-2a7511f87e03 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040496 Mar 08 04:27:40.053236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 626/1257] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:40.772862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9c43bc57-597f-4574-995a-a159090b2fd6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:40.773504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9c43bc57-597f-4574-995a-a159090b2fd6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:40.779643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c43bc57-597f-4574-995a-a159090b2fd6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:40.780106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c43bc57-597f-4574-995a-a159090b2fd6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:40.780879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c43bc57-597f-4574-995a-a159090b2fd6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:40.781318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c43bc57-597f-4574-995a-a159090b2fd6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:40.915318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9c43bc57-597f-4574-995a-a159090b2fd6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:40.920224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0c2778d2-47e9-42f1-9847-3a05e35cb0a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:40.921123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0c2778d2-47e9-42f1-9847-3a05e35cb0a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:40.922746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9c43bc57-597f-4574-995a-a159090b2fd6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154301 Mar 08 04:27:40.923310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 632/1258] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:40 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:40.927401 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c2778d2-47e9-42f1-9847-3a05e35cb0a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:40.927846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c2778d2-47e9-42f1-9847-3a05e35cb0a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:40.928613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c2778d2-47e9-42f1-9847-3a05e35cb0a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:40.929354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0c2778d2-47e9-42f1-9847-3a05e35cb0a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:40.957967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0c2778d2-47e9-42f1-9847-3a05e35cb0a9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041532 Mar 08 04:27:40.958518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 627/1259] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:41.064083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-563b7b93-d59d-4799-b437-19d85030ec65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:41.064984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-563b7b93-d59d-4799-b437-19d85030ec65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:41.071326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-563b7b93-d59d-4799-b437-19d85030ec65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:41.071784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-563b7b93-d59d-4799-b437-19d85030ec65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:41.072547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-563b7b93-d59d-4799-b437-19d85030ec65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:41.072984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-563b7b93-d59d-4799-b437-19d85030ec65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:41.100506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-563b7b93-d59d-4799-b437-19d85030ec65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040374 Mar 08 04:27:41.103591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 633/1260] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:41.939709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-14fb2227-3a01-4697-9f1d-e52cb7d4eefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:41.940675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-14fb2227-3a01-4697-9f1d-e52cb7d4eefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:41.946869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14fb2227-3a01-4697-9f1d-e52cb7d4eefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:41.947309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14fb2227-3a01-4697-9f1d-e52cb7d4eefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:41.948056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14fb2227-3a01-4697-9f1d-e52cb7d4eefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:41.948491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14fb2227-3a01-4697-9f1d-e52cb7d4eefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:41.968417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7de19416-febf-43e9-91dc-5c145b36b808 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:41.969331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7de19416-febf-43e9-91dc-5c145b36b808 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:41.976250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7de19416-febf-43e9-91dc-5c145b36b808 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:41.976763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7de19416-febf-43e9-91dc-5c145b36b808 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:41.977539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7de19416-febf-43e9-91dc-5c145b36b808 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:41.977998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7de19416-febf-43e9-91dc-5c145b36b808 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:42.005788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7de19416-febf-43e9-91dc-5c145b36b808 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041229 Mar 08 04:27:42.006586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 634/1261] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:42.079097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-14fb2227-3a01-4697-9f1d-e52cb7d4eefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:42.086911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-14fb2227-3a01-4697-9f1d-e52cb7d4eefa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151016 Mar 08 04:27:42.087466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 628/1262] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:41 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:42.111628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-518e06d4-7803-417a-848c-0a628d19b6c9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:42.112798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-518e06d4-7803-417a-848c-0a628d19b6c9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:42.118713 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-518e06d4-7803-417a-848c-0a628d19b6c9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:42.119169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-518e06d4-7803-417a-848c-0a628d19b6c9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:42.119935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-518e06d4-7803-417a-848c-0a628d19b6c9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:42.120375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-518e06d4-7803-417a-848c-0a628d19b6c9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:42.148287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-518e06d4-7803-417a-848c-0a628d19b6c9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 Mar 08 04:27:42.148832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 635/1263] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:43.017266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c678597c-08eb-4d01-8659-64e4dbadc66a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:43.018207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c678597c-08eb-4d01-8659-64e4dbadc66a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:43.024737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c678597c-08eb-4d01-8659-64e4dbadc66a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:43.025188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c678597c-08eb-4d01-8659-64e4dbadc66a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:43.026395 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c678597c-08eb-4d01-8659-64e4dbadc66a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:43.026839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c678597c-08eb-4d01-8659-64e4dbadc66a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:43.055253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c678597c-08eb-4d01-8659-64e4dbadc66a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041947 Mar 08 04:27:43.055799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 629/1264] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:43.104262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b46f680c-fda0-467c-bf18-e39a6ae32d11 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:43.104816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b46f680c-fda0-467c-bf18-e39a6ae32d11 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:43.111122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b46f680c-fda0-467c-bf18-e39a6ae32d11 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:43.111576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b46f680c-fda0-467c-bf18-e39a6ae32d11 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:43.112345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b46f680c-fda0-467c-bf18-e39a6ae32d11 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:43.112785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b46f680c-fda0-467c-bf18-e39a6ae32d11 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:43.159408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c6325d04-2492-44f2-9c45-e653f46f7037 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:43.161127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c6325d04-2492-44f2-9c45-e653f46f7037 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:43.167066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6325d04-2492-44f2-9c45-e653f46f7037 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:43.167519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6325d04-2492-44f2-9c45-e653f46f7037 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:43.168286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6325d04-2492-44f2-9c45-e653f46f7037 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:43.168721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6325d04-2492-44f2-9c45-e653f46f7037 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:43.198084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c6325d04-2492-44f2-9c45-e653f46f7037 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Mar 08 04:27:43.199417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 630/1265] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:43.244637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b46f680c-fda0-467c-bf18-e39a6ae32d11 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:43.251863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b46f680c-fda0-467c-bf18-e39a6ae32d11 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151609 Mar 08 04:27:43.252416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 636/1266] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:43 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:44.065798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-330cd2d9-3c52-4384-9ce9-b808b2ec7fec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:44.066832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-330cd2d9-3c52-4384-9ce9-b808b2ec7fec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:44.073027 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-330cd2d9-3c52-4384-9ce9-b808b2ec7fec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:44.073478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-330cd2d9-3c52-4384-9ce9-b808b2ec7fec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:44.074292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-330cd2d9-3c52-4384-9ce9-b808b2ec7fec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:44.074717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-330cd2d9-3c52-4384-9ce9-b808b2ec7fec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:44.105883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-330cd2d9-3c52-4384-9ce9-b808b2ec7fec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043910 Mar 08 04:27:44.106361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 631/1267] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:44.210751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-194feb80-66fc-4b1f-8e47-213659ed127d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:44.211701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-194feb80-66fc-4b1f-8e47-213659ed127d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:44.217965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-194feb80-66fc-4b1f-8e47-213659ed127d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:44.218417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-194feb80-66fc-4b1f-8e47-213659ed127d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:44.219179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-194feb80-66fc-4b1f-8e47-213659ed127d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:44.219614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-194feb80-66fc-4b1f-8e47-213659ed127d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:44.247679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-194feb80-66fc-4b1f-8e47-213659ed127d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041382 Mar 08 04:27:44.248221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 637/1268] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:44.272406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9b9c5044-6b36-4a16-aa82-85dab8e030fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:44.273008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9b9c5044-6b36-4a16-aa82-85dab8e030fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:44.279055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b9c5044-6b36-4a16-aa82-85dab8e030fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:44.279497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b9c5044-6b36-4a16-aa82-85dab8e030fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:44.280253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b9c5044-6b36-4a16-aa82-85dab8e030fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:44.280679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b9c5044-6b36-4a16-aa82-85dab8e030fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:44.416615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9b9c5044-6b36-4a16-aa82-85dab8e030fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:44.423871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9b9c5044-6b36-4a16-aa82-85dab8e030fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155875 Mar 08 04:27:44.424422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 632/1269] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:44 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:45.117876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bb20507f-7bcd-4be3-b2c8-6c19ec641281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:45.118724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bb20507f-7bcd-4be3-b2c8-6c19ec641281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:45.124561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb20507f-7bcd-4be3-b2c8-6c19ec641281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:45.125011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb20507f-7bcd-4be3-b2c8-6c19ec641281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:45.125803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb20507f-7bcd-4be3-b2c8-6c19ec641281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:45.126243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb20507f-7bcd-4be3-b2c8-6c19ec641281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:45.154464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bb20507f-7bcd-4be3-b2c8-6c19ec641281 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040726 Mar 08 04:27:45.155005 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 638/1270] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:45.259018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6f033267-ad82-4a68-a7e5-2deb5264f07f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:45.259925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6f033267-ad82-4a68-a7e5-2deb5264f07f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:45.266086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f033267-ad82-4a68-a7e5-2deb5264f07f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:45.266530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f033267-ad82-4a68-a7e5-2deb5264f07f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:45.267287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f033267-ad82-4a68-a7e5-2deb5264f07f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:45.267714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f033267-ad82-4a68-a7e5-2deb5264f07f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:45.298531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6f033267-ad82-4a68-a7e5-2deb5264f07f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Mar 08 04:27:45.299069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 633/1271] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:45.442487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8df315e1-532b-459e-ba80-b17b6d085a21 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:45.443101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8df315e1-532b-459e-ba80-b17b6d085a21 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:45.449322 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8df315e1-532b-459e-ba80-b17b6d085a21 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:45.449810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8df315e1-532b-459e-ba80-b17b6d085a21 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:45.450597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8df315e1-532b-459e-ba80-b17b6d085a21 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:45.451019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8df315e1-532b-459e-ba80-b17b6d085a21 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:45.582177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8df315e1-532b-459e-ba80-b17b6d085a21 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:45.589559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8df315e1-532b-459e-ba80-b17b6d085a21 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152415 Mar 08 04:27:45.590153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 639/1272] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:45 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:46.165979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-391ada9f-20a4-4534-81c7-a51080236643 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:46.166886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-391ada9f-20a4-4534-81c7-a51080236643 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:46.172652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-391ada9f-20a4-4534-81c7-a51080236643 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:46.173108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-391ada9f-20a4-4534-81c7-a51080236643 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:46.173897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-391ada9f-20a4-4534-81c7-a51080236643 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:46.174336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-391ada9f-20a4-4534-81c7-a51080236643 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:46.201476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-391ada9f-20a4-4534-81c7-a51080236643 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039519 Mar 08 04:27:46.202041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 634/1273] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:46.310754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-627edc2a-06ba-4fb8-af50-e7efc779df91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:46.311673 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-627edc2a-06ba-4fb8-af50-e7efc779df91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:46.318466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-627edc2a-06ba-4fb8-af50-e7efc779df91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:46.318921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-627edc2a-06ba-4fb8-af50-e7efc779df91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:46.319694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-627edc2a-06ba-4fb8-af50-e7efc779df91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:46.320135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-627edc2a-06ba-4fb8-af50-e7efc779df91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:46.347766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-627edc2a-06ba-4fb8-af50-e7efc779df91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040935 Mar 08 04:27:46.348314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 640/1274] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:46.609575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bf74413d-cf92-4227-8292-09215163b6d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:46.610653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bf74413d-cf92-4227-8292-09215163b6d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:46.617238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf74413d-cf92-4227-8292-09215163b6d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:46.617715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf74413d-cf92-4227-8292-09215163b6d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:46.618496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf74413d-cf92-4227-8292-09215163b6d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:46.618939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf74413d-cf92-4227-8292-09215163b6d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:46.752501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bf74413d-cf92-4227-8292-09215163b6d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:46.760420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bf74413d-cf92-4227-8292-09215163b6d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156422 Mar 08 04:27:46.761021 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 635/1275] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:46 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:27:47.213261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e721ad37-a5bf-4889-a413-978d0927038d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:47.214134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e721ad37-a5bf-4889-a413-978d0927038d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:47.220320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e721ad37-a5bf-4889-a413-978d0927038d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:47.220773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e721ad37-a5bf-4889-a413-978d0927038d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:47.221545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e721ad37-a5bf-4889-a413-978d0927038d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:47.222107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e721ad37-a5bf-4889-a413-978d0927038d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:47.251480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e721ad37-a5bf-4889-a413-978d0927038d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 Mar 08 04:27:47.252226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 641/1276] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:47.358919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0aaa1134-11f6-4ce3-8f2a-a5575d50599f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:47.359819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0aaa1134-11f6-4ce3-8f2a-a5575d50599f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:47.366195 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aaa1134-11f6-4ce3-8f2a-a5575d50599f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:47.366634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aaa1134-11f6-4ce3-8f2a-a5575d50599f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:47.367388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aaa1134-11f6-4ce3-8f2a-a5575d50599f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:47.367817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aaa1134-11f6-4ce3-8f2a-a5575d50599f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:47.395120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0aaa1134-11f6-4ce3-8f2a-a5575d50599f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040187 Mar 08 04:27:47.395648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 636/1277] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:47.778760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9f0bb9bd-3bc4-4639-a1a1-d94aab1f4dec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:47.779372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9f0bb9bd-3bc4-4639-a1a1-d94aab1f4dec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:47.786024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f0bb9bd-3bc4-4639-a1a1-d94aab1f4dec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:47.786473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f0bb9bd-3bc4-4639-a1a1-d94aab1f4dec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:47.787235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f0bb9bd-3bc4-4639-a1a1-d94aab1f4dec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:47.787673 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f0bb9bd-3bc4-4639-a1a1-d94aab1f4dec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:47.922299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9f0bb9bd-3bc4-4639-a1a1-d94aab1f4dec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:47.929709 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9f0bb9bd-3bc4-4639-a1a1-d94aab1f4dec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155101 Mar 08 04:27:47.930262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 642/1278] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:47 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:48.263716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ed21eb47-486c-445f-9e28-813fb163a656 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:48.264611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ed21eb47-486c-445f-9e28-813fb163a656 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:48.271105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed21eb47-486c-445f-9e28-813fb163a656 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:48.271546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed21eb47-486c-445f-9e28-813fb163a656 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:48.272302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed21eb47-486c-445f-9e28-813fb163a656 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:48.272733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed21eb47-486c-445f-9e28-813fb163a656 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:48.300334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ed21eb47-486c-445f-9e28-813fb163a656 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040620 Mar 08 04:27:48.300819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 637/1279] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:48.406340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c3db0ec5-3beb-493f-a0a1-589a0c03fd2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:48.407264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c3db0ec5-3beb-493f-a0a1-589a0c03fd2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:48.413947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3db0ec5-3beb-493f-a0a1-589a0c03fd2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:48.414401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3db0ec5-3beb-493f-a0a1-589a0c03fd2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:48.415169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3db0ec5-3beb-493f-a0a1-589a0c03fd2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:48.415606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3db0ec5-3beb-493f-a0a1-589a0c03fd2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:48.443545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c3db0ec5-3beb-493f-a0a1-589a0c03fd2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041222 Mar 08 04:27:48.444080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 643/1280] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:48.946438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8f09694e-f080-4393-8b2e-1e41c3951b82 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:48.947037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8f09694e-f080-4393-8b2e-1e41c3951b82 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:48.952856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8f09694e-f080-4393-8b2e-1e41c3951b82 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:48.953300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8f09694e-f080-4393-8b2e-1e41c3951b82 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:48.954086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8f09694e-f080-4393-8b2e-1e41c3951b82 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:48.954515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8f09694e-f080-4393-8b2e-1e41c3951b82 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:49.085313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8f09694e-f080-4393-8b2e-1e41c3951b82 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:49.092518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8f09694e-f080-4393-8b2e-1e41c3951b82 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149884 Mar 08 04:27:49.093087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 638/1281] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:48 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:49.312081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1936a0f5-05e2-4ad2-bce4-6e62e8672d03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:49.312990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1936a0f5-05e2-4ad2-bce4-6e62e8672d03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:49.318982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1936a0f5-05e2-4ad2-bce4-6e62e8672d03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:49.319432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1936a0f5-05e2-4ad2-bce4-6e62e8672d03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:49.320256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1936a0f5-05e2-4ad2-bce4-6e62e8672d03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:49.320691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1936a0f5-05e2-4ad2-bce4-6e62e8672d03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:49.349212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1936a0f5-05e2-4ad2-bce4-6e62e8672d03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041264 Mar 08 04:27:49.349765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 644/1282] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:49.455089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-16b426d4-21b9-4e3d-a39b-ccde021dafdf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:49.455993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-16b426d4-21b9-4e3d-a39b-ccde021dafdf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:49.462762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16b426d4-21b9-4e3d-a39b-ccde021dafdf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:49.463211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16b426d4-21b9-4e3d-a39b-ccde021dafdf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:49.463968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16b426d4-21b9-4e3d-a39b-ccde021dafdf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:49.464405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16b426d4-21b9-4e3d-a39b-ccde021dafdf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:49.493244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-16b426d4-21b9-4e3d-a39b-ccde021dafdf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042122 Mar 08 04:27:49.493815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 639/1283] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:50.110032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e3a40f41-aa32-4a12-8e49-8742dc96efcc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:50.110581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e3a40f41-aa32-4a12-8e49-8742dc96efcc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:50.117390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e3a40f41-aa32-4a12-8e49-8742dc96efcc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:50.117873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e3a40f41-aa32-4a12-8e49-8742dc96efcc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:50.118665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e3a40f41-aa32-4a12-8e49-8742dc96efcc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:50.119100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e3a40f41-aa32-4a12-8e49-8742dc96efcc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:50.252128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e3a40f41-aa32-4a12-8e49-8742dc96efcc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:50.260203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e3a40f41-aa32-4a12-8e49-8742dc96efcc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154211 Mar 08 04:27:50.260756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 645/1284] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:50 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:50.360536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-48838e46-ba1e-4db3-9dde-731f16f90818 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:50.361389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-48838e46-ba1e-4db3-9dde-731f16f90818 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:50.367779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48838e46-ba1e-4db3-9dde-731f16f90818 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:50.368233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48838e46-ba1e-4db3-9dde-731f16f90818 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:50.369002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48838e46-ba1e-4db3-9dde-731f16f90818 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:50.369440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48838e46-ba1e-4db3-9dde-731f16f90818 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:50.397905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-48838e46-ba1e-4db3-9dde-731f16f90818 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041327 Mar 08 04:27:50.398460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 640/1285] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:50 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:50.504892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d63c6b20-307c-45a6-94cc-0ab07e22a38e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:50.505856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d63c6b20-307c-45a6-94cc-0ab07e22a38e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:50.511784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d63c6b20-307c-45a6-94cc-0ab07e22a38e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:50.512232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d63c6b20-307c-45a6-94cc-0ab07e22a38e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:50.512991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d63c6b20-307c-45a6-94cc-0ab07e22a38e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:50.513426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d63c6b20-307c-45a6-94cc-0ab07e22a38e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:50.541550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d63c6b20-307c-45a6-94cc-0ab07e22a38e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040831 Mar 08 04:27:50.542115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 646/1286] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:50 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:51.277432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3d3f368f-c847-4a1a-b8ce-ab9edb701844 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:51.278069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3d3f368f-c847-4a1a-b8ce-ab9edb701844 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:51.284372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d3f368f-c847-4a1a-b8ce-ab9edb701844 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:51.285051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d3f368f-c847-4a1a-b8ce-ab9edb701844 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:51.286372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d3f368f-c847-4a1a-b8ce-ab9edb701844 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:51.287152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d3f368f-c847-4a1a-b8ce-ab9edb701844 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:51.408916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-98fd8fea-f583-40ce-adeb-6c137776a937 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:51.410238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-98fd8fea-f583-40ce-adeb-6c137776a937 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:51.416401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98fd8fea-f583-40ce-adeb-6c137776a937 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:51.416860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98fd8fea-f583-40ce-adeb-6c137776a937 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:51.417648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98fd8fea-f583-40ce-adeb-6c137776a937 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:51.418111 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98fd8fea-f583-40ce-adeb-6c137776a937 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:51.422983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3d3f368f-c847-4a1a-b8ce-ab9edb701844 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:51.430421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3d3f368f-c847-4a1a-b8ce-ab9edb701844 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157098 Mar 08 04:27:51.430985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 641/1287] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:51 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:51.447250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-98fd8fea-f583-40ce-adeb-6c137776a937 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042255 Mar 08 04:27:51.447801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 647/1288] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:51.552986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-50362245-7fc9-4cf0-a566-0fc7ff33b3aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:51.553859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-50362245-7fc9-4cf0-a566-0fc7ff33b3aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:51.559686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50362245-7fc9-4cf0-a566-0fc7ff33b3aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:51.560134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50362245-7fc9-4cf0-a566-0fc7ff33b3aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:51.560904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50362245-7fc9-4cf0-a566-0fc7ff33b3aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:51.561342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50362245-7fc9-4cf0-a566-0fc7ff33b3aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:51.589597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-50362245-7fc9-4cf0-a566-0fc7ff33b3aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041202 Mar 08 04:27:51.590157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 642/1289] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:52.446857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f9f41147-3185-4aef-a9e7-6a4e03a48581 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:52.447439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f9f41147-3185-4aef-a9e7-6a4e03a48581 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:52.453722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9f41147-3185-4aef-a9e7-6a4e03a48581 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:52.454176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9f41147-3185-4aef-a9e7-6a4e03a48581 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:52.454929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9f41147-3185-4aef-a9e7-6a4e03a48581 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:52.455361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9f41147-3185-4aef-a9e7-6a4e03a48581 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:52.459138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c5379a2c-305e-407c-b15a-c6a3e6a7e49f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:52.460038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c5379a2c-305e-407c-b15a-c6a3e6a7e49f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:52.466150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5379a2c-305e-407c-b15a-c6a3e6a7e49f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:52.466596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5379a2c-305e-407c-b15a-c6a3e6a7e49f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:52.467358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5379a2c-305e-407c-b15a-c6a3e6a7e49f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:52.467787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5379a2c-305e-407c-b15a-c6a3e6a7e49f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:52.495831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c5379a2c-305e-407c-b15a-c6a3e6a7e49f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041195 Mar 08 04:27:52.496390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 643/1290] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:52.596029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f9f41147-3185-4aef-a9e7-6a4e03a48581 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:52.601088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dcb7de7a-681f-44a5-85bf-fb2b2bfafba8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:52.602024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dcb7de7a-681f-44a5-85bf-fb2b2bfafba8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:52.604278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f9f41147-3185-4aef-a9e7-6a4e03a48581 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.161251 Mar 08 04:27:52.604847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 648/1291] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:52 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:52.607910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dcb7de7a-681f-44a5-85bf-fb2b2bfafba8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:52.608364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dcb7de7a-681f-44a5-85bf-fb2b2bfafba8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:52.609131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dcb7de7a-681f-44a5-85bf-fb2b2bfafba8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:52.609585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dcb7de7a-681f-44a5-85bf-fb2b2bfafba8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:52.636586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dcb7de7a-681f-44a5-85bf-fb2b2bfafba8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040146 Mar 08 04:27:52.637129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 644/1292] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:53.507549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-64055953-600e-4a91-be33-9e80bf53ab1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:53.508460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-64055953-600e-4a91-be33-9e80bf53ab1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:53.514915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64055953-600e-4a91-be33-9e80bf53ab1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:53.515373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64055953-600e-4a91-be33-9e80bf53ab1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:53.516148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64055953-600e-4a91-be33-9e80bf53ab1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:53.516592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64055953-600e-4a91-be33-9e80bf53ab1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:53.544669 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-64055953-600e-4a91-be33-9e80bf53ab1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041104 Mar 08 04:27:53.545219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 649/1293] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:53.621233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4c81c267-5e6a-4879-9b59-ca49f2e91437 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:53.621859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4c81c267-5e6a-4879-9b59-ca49f2e91437 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:53.628140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c81c267-5e6a-4879-9b59-ca49f2e91437 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:53.628632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c81c267-5e6a-4879-9b59-ca49f2e91437 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:53.629374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c81c267-5e6a-4879-9b59-ca49f2e91437 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:53.629852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c81c267-5e6a-4879-9b59-ca49f2e91437 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:53.648060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-525b7d19-c01a-461a-8977-fdf38da20339 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:53.648967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-525b7d19-c01a-461a-8977-fdf38da20339 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:53.654959 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-525b7d19-c01a-461a-8977-fdf38da20339 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:53.655412 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-525b7d19-c01a-461a-8977-fdf38da20339 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:53.656178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-525b7d19-c01a-461a-8977-fdf38da20339 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:53.656616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-525b7d19-c01a-461a-8977-fdf38da20339 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:53.687167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-525b7d19-c01a-461a-8977-fdf38da20339 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 Mar 08 04:27:53.687728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 650/1294] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:27:53.762931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4c81c267-5e6a-4879-9b59-ca49f2e91437 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:53.770866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4c81c267-5e6a-4879-9b59-ca49f2e91437 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153442 Mar 08 04:27:53.771423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 645/1295] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:53 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:54.556223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b330c16f-b2d5-46bc-809a-643c56331299 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:54.557127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b330c16f-b2d5-46bc-809a-643c56331299 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:54.563480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b330c16f-b2d5-46bc-809a-643c56331299 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:54.563931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b330c16f-b2d5-46bc-809a-643c56331299 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:54.564707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b330c16f-b2d5-46bc-809a-643c56331299 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:54.565141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b330c16f-b2d5-46bc-809a-643c56331299 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:54.593774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b330c16f-b2d5-46bc-809a-643c56331299 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Mar 08 04:27:54.594305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 651/1296] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:54 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:54.698788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e2b81e9b-3dd1-4274-ac83-1894f80031d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:54.700134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e2b81e9b-3dd1-4274-ac83-1894f80031d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:54.708733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2b81e9b-3dd1-4274-ac83-1894f80031d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:54.709190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2b81e9b-3dd1-4274-ac83-1894f80031d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:54.709989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2b81e9b-3dd1-4274-ac83-1894f80031d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:54.710483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2b81e9b-3dd1-4274-ac83-1894f80031d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:54.740149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e2b81e9b-3dd1-4274-ac83-1894f80031d7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Mar 08 04:27:54.740738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 646/1297] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:54.788075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-78e238b4-aef5-4581-8139-f9b8b55f3818 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:54.788713 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-78e238b4-aef5-4581-8139-f9b8b55f3818 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:54.794628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78e238b4-aef5-4581-8139-f9b8b55f3818 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:54.795082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78e238b4-aef5-4581-8139-f9b8b55f3818 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:54.795846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78e238b4-aef5-4581-8139-f9b8b55f3818 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:54.796287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78e238b4-aef5-4581-8139-f9b8b55f3818 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:54.930768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-78e238b4-aef5-4581-8139-f9b8b55f3818 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:54.938203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-78e238b4-aef5-4581-8139-f9b8b55f3818 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154665 Mar 08 04:27:54.938768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 652/1298] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:54 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:55.606770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-52795a50-45e7-4979-a67b-fb3cf6a0b633 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:55.607681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-52795a50-45e7-4979-a67b-fb3cf6a0b633 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:55.614612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52795a50-45e7-4979-a67b-fb3cf6a0b633 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:55.615126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52795a50-45e7-4979-a67b-fb3cf6a0b633 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:55.615966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52795a50-45e7-4979-a67b-fb3cf6a0b633 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:55.616402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-52795a50-45e7-4979-a67b-fb3cf6a0b633 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:55.645691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-52795a50-45e7-4979-a67b-fb3cf6a0b633 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Mar 08 04:27:55.646861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 647/1299] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:55.752335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-303c8af4-e1eb-44cd-a542-7b4c23fb3f7b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:55.753346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-303c8af4-e1eb-44cd-a542-7b4c23fb3f7b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:55.759512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-303c8af4-e1eb-44cd-a542-7b4c23fb3f7b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:55.759956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-303c8af4-e1eb-44cd-a542-7b4c23fb3f7b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:55.760708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-303c8af4-e1eb-44cd-a542-7b4c23fb3f7b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:55.761140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-303c8af4-e1eb-44cd-a542-7b4c23fb3f7b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:55.789079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-303c8af4-e1eb-44cd-a542-7b4c23fb3f7b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041059 Mar 08 04:27:55.789675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 653/1300] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:55.955668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c09938f8-0efc-400d-a3c7-15b24aa29782 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:55.956269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c09938f8-0efc-400d-a3c7-15b24aa29782 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:55.962426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c09938f8-0efc-400d-a3c7-15b24aa29782 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:55.962865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c09938f8-0efc-400d-a3c7-15b24aa29782 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:55.963615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c09938f8-0efc-400d-a3c7-15b24aa29782 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:55.964044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c09938f8-0efc-400d-a3c7-15b24aa29782 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:56.094374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c09938f8-0efc-400d-a3c7-15b24aa29782 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:56.102197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c09938f8-0efc-400d-a3c7-15b24aa29782 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150354 Mar 08 04:27:56.102751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 648/1301] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:55 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:56.657211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-464adf11-2395-49e6-94e7-7a0fdabe96ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:56.658141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-464adf11-2395-49e6-94e7-7a0fdabe96ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:56.664362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-464adf11-2395-49e6-94e7-7a0fdabe96ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:56.664808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-464adf11-2395-49e6-94e7-7a0fdabe96ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:56.665560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-464adf11-2395-49e6-94e7-7a0fdabe96ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:56.666020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-464adf11-2395-49e6-94e7-7a0fdabe96ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:56.693445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-464adf11-2395-49e6-94e7-7a0fdabe96ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040201 Mar 08 04:27:56.694006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 654/1302] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:56.800906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e416d46e-78f4-46e7-951b-ab8de74dc4ae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:56.801840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e416d46e-78f4-46e7-951b-ab8de74dc4ae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:56.807613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e416d46e-78f4-46e7-951b-ab8de74dc4ae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:56.808054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e416d46e-78f4-46e7-951b-ab8de74dc4ae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:56.808805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e416d46e-78f4-46e7-951b-ab8de74dc4ae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:56.809234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e416d46e-78f4-46e7-951b-ab8de74dc4ae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:56.836812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e416d46e-78f4-46e7-951b-ab8de74dc4ae tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040100 Mar 08 04:27:56.837346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 649/1303] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:57.119209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6557d84b-3efd-44fd-8d69-18287d871a72 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:57.119821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6557d84b-3efd-44fd-8d69-18287d871a72 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:57.126121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6557d84b-3efd-44fd-8d69-18287d871a72 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:57.126576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6557d84b-3efd-44fd-8d69-18287d871a72 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:57.127342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6557d84b-3efd-44fd-8d69-18287d871a72 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:57.127816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6557d84b-3efd-44fd-8d69-18287d871a72 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:57.257273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6557d84b-3efd-44fd-8d69-18287d871a72 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:57.264640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6557d84b-3efd-44fd-8d69-18287d871a72 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149387 Mar 08 04:27:57.265196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 655/1304] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:57 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:57.705334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6488b6b4-62a6-46f6-a7aa-0d2154d59fa7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:57.706415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6488b6b4-62a6-46f6-a7aa-0d2154d59fa7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:57.713424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6488b6b4-62a6-46f6-a7aa-0d2154d59fa7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:57.713917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6488b6b4-62a6-46f6-a7aa-0d2154d59fa7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:57.714683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6488b6b4-62a6-46f6-a7aa-0d2154d59fa7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:57.715117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6488b6b4-62a6-46f6-a7aa-0d2154d59fa7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:57.742853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6488b6b4-62a6-46f6-a7aa-0d2154d59fa7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041761 Mar 08 04:27:57.743393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 650/1305] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:57.847442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-719d2406-4e50-41ec-879e-51d677db64a5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:57.848355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-719d2406-4e50-41ec-879e-51d677db64a5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:57.854272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-719d2406-4e50-41ec-879e-51d677db64a5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:57.854721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-719d2406-4e50-41ec-879e-51d677db64a5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:57.855514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-719d2406-4e50-41ec-879e-51d677db64a5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:57.855953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-719d2406-4e50-41ec-879e-51d677db64a5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:57.884483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-719d2406-4e50-41ec-879e-51d677db64a5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041031 Mar 08 04:27:57.885018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 656/1306] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:58.282295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-20486b3d-4c25-470f-a35a-c594e4082262 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:58.282906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-20486b3d-4c25-470f-a35a-c594e4082262 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:58.288840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20486b3d-4c25-470f-a35a-c594e4082262 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:58.289292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20486b3d-4c25-470f-a35a-c594e4082262 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:58.290086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20486b3d-4c25-470f-a35a-c594e4082262 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:58.290523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20486b3d-4c25-470f-a35a-c594e4082262 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:58.426959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-20486b3d-4c25-470f-a35a-c594e4082262 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:58.434147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-20486b3d-4c25-470f-a35a-c594e4082262 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155785 Mar 08 04:27:58.434710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 651/1307] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:58 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:58.754365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d81be696-1f2b-469f-a46a-1d449f4a0b3a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:58.755302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d81be696-1f2b-469f-a46a-1d449f4a0b3a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:58.761528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d81be696-1f2b-469f-a46a-1d449f4a0b3a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:58.762004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d81be696-1f2b-469f-a46a-1d449f4a0b3a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:58.762766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d81be696-1f2b-469f-a46a-1d449f4a0b3a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:58.763196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d81be696-1f2b-469f-a46a-1d449f4a0b3a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:58.791367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d81be696-1f2b-469f-a46a-1d449f4a0b3a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040989 Mar 08 04:27:58.791902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 657/1308] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:58.896695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b5ac3de4-e503-4977-8cd7-f68f3341a6f4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:58.897821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b5ac3de4-e503-4977-8cd7-f68f3341a6f4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:58.905151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5ac3de4-e503-4977-8cd7-f68f3341a6f4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:58.905916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5ac3de4-e503-4977-8cd7-f68f3341a6f4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:58.906699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5ac3de4-e503-4977-8cd7-f68f3341a6f4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:58.907038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5ac3de4-e503-4977-8cd7-f68f3341a6f4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:58.938664 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b5ac3de4-e503-4977-8cd7-f68f3341a6f4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046567 Mar 08 04:27:58.939629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 652/1309] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:59.451732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7ef0c64b-6aea-4b46-b439-9e2eb15e02cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:59.452277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7ef0c64b-6aea-4b46-b439-9e2eb15e02cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:59.458866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ef0c64b-6aea-4b46-b439-9e2eb15e02cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:59.459310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ef0c64b-6aea-4b46-b439-9e2eb15e02cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:59.460061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ef0c64b-6aea-4b46-b439-9e2eb15e02cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:59.460493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ef0c64b-6aea-4b46-b439-9e2eb15e02cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:59.595466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7ef0c64b-6aea-4b46-b439-9e2eb15e02cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:27:59.602623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7ef0c64b-6aea-4b46-b439-9e2eb15e02cc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154842 Mar 08 04:27:59.603171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 658/1310] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:27:59 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:27:59.803465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4366507d-0172-438a-867c-39c245a01f3b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:59.804290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4366507d-0172-438a-867c-39c245a01f3b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:59.810049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4366507d-0172-438a-867c-39c245a01f3b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:59.810495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4366507d-0172-438a-867c-39c245a01f3b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:59.811243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4366507d-0172-438a-867c-39c245a01f3b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:59.811667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4366507d-0172-438a-867c-39c245a01f3b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:59.839653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4366507d-0172-438a-867c-39c245a01f3b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040917 Mar 08 04:27:59.840193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 653/1311] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:27:59.950349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ef430bea-1eef-4e19-9f51-94834c62946c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:27:59.951264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ef430bea-1eef-4e19-9f51-94834c62946c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:27:59.957563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef430bea-1eef-4e19-9f51-94834c62946c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:59.958040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef430bea-1eef-4e19-9f51-94834c62946c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:59.958794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef430bea-1eef-4e19-9f51-94834c62946c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:27:59.959223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef430bea-1eef-4e19-9f51-94834c62946c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:27:59.986201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ef430bea-1eef-4e19-9f51-94834c62946c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039820 Mar 08 04:27:59.986732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 659/1312] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:27:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:00.619583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bc9ec3ef-a523-496c-8079-0c0194da949e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:00.620191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bc9ec3ef-a523-496c-8079-0c0194da949e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:00.626448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bc9ec3ef-a523-496c-8079-0c0194da949e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:00.626892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bc9ec3ef-a523-496c-8079-0c0194da949e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:00.627721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bc9ec3ef-a523-496c-8079-0c0194da949e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:00.628101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bc9ec3ef-a523-496c-8079-0c0194da949e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:00.763000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bc9ec3ef-a523-496c-8079-0c0194da949e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:00.770772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bc9ec3ef-a523-496c-8079-0c0194da949e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155198 Mar 08 04:28:00.771328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 654/1313] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:00 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:00.851501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-aebb23b7-8a3e-472c-8a22-2cd04b0f2a5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:00.852440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-aebb23b7-8a3e-472c-8a22-2cd04b0f2a5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:00.858245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aebb23b7-8a3e-472c-8a22-2cd04b0f2a5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:00.858692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aebb23b7-8a3e-472c-8a22-2cd04b0f2a5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:00.859450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aebb23b7-8a3e-472c-8a22-2cd04b0f2a5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:00.859880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aebb23b7-8a3e-472c-8a22-2cd04b0f2a5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:00.889277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-aebb23b7-8a3e-472c-8a22-2cd04b0f2a5d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 Mar 08 04:28:00.889820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 660/1314] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:00.998537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ae415f98-39e0-4f66-9aa3-e358647c88cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:00.999470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ae415f98-39e0-4f66-9aa3-e358647c88cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:01.005824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae415f98-39e0-4f66-9aa3-e358647c88cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:01.006267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae415f98-39e0-4f66-9aa3-e358647c88cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:01.007024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae415f98-39e0-4f66-9aa3-e358647c88cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:01.007456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae415f98-39e0-4f66-9aa3-e358647c88cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:01.034977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ae415f98-39e0-4f66-9aa3-e358647c88cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040648 Mar 08 04:28:01.035507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 655/1315] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:01.787631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ad0417f0-92dc-4f14-93fa-38ee4d38be7e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:01.788233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ad0417f0-92dc-4f14-93fa-38ee4d38be7e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:01.794772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad0417f0-92dc-4f14-93fa-38ee4d38be7e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:01.795374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad0417f0-92dc-4f14-93fa-38ee4d38be7e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:01.796033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad0417f0-92dc-4f14-93fa-38ee4d38be7e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:01.796495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad0417f0-92dc-4f14-93fa-38ee4d38be7e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:01.900601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-61a8299a-b115-4fff-9d14-99f32088c0a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:01.901498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-61a8299a-b115-4fff-9d14-99f32088c0a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:01.907861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61a8299a-b115-4fff-9d14-99f32088c0a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:01.908303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61a8299a-b115-4fff-9d14-99f32088c0a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:01.913311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61a8299a-b115-4fff-9d14-99f32088c0a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:01.913311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61a8299a-b115-4fff-9d14-99f32088c0a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:01.929854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ad0417f0-92dc-4f14-93fa-38ee4d38be7e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:01.937147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ad0417f0-92dc-4f14-93fa-38ee4d38be7e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153895 Mar 08 04:28:01.937716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 661/1316] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:01 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:01.939246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-61a8299a-b115-4fff-9d14-99f32088c0a5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042761 Mar 08 04:28:01.939792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 656/1317] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:02.046934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-335c1e9d-5595-47f5-894d-6b9f6c7bd8ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:02.047806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-335c1e9d-5595-47f5-894d-6b9f6c7bd8ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:02.053924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-335c1e9d-5595-47f5-894d-6b9f6c7bd8ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:02.054378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-335c1e9d-5595-47f5-894d-6b9f6c7bd8ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:02.055160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-335c1e9d-5595-47f5-894d-6b9f6c7bd8ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:02.055597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-335c1e9d-5595-47f5-894d-6b9f6c7bd8ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:02.084181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-335c1e9d-5595-47f5-894d-6b9f6c7bd8ca tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041251 Mar 08 04:28:02.084730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 662/1318] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:02.950922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6f597cce-1faa-40d7-b762-756d5532f0a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:02.951839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6f597cce-1faa-40d7-b762-756d5532f0a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:02.954941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d458e847-f246-4406-b628-e0bdeddb1e57 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:02.955553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d458e847-f246-4406-b628-e0bdeddb1e57 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:02.958244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f597cce-1faa-40d7-b762-756d5532f0a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:02.958703 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f597cce-1faa-40d7-b762-756d5532f0a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:02.959475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f597cce-1faa-40d7-b762-756d5532f0a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:02.959916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f597cce-1faa-40d7-b762-756d5532f0a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:02.961972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d458e847-f246-4406-b628-e0bdeddb1e57 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:02.962425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d458e847-f246-4406-b628-e0bdeddb1e57 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:02.963188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d458e847-f246-4406-b628-e0bdeddb1e57 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:02.963623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d458e847-f246-4406-b628-e0bdeddb1e57 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:02.988546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6f597cce-1faa-40d7-b762-756d5532f0a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041496 Mar 08 04:28:02.989098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 657/1319] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:03.095846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f4ef25e2-53fd-4bec-b148-bc5a2b9c15a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:03.096784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f4ef25e2-53fd-4bec-b148-bc5a2b9c15a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:03.097728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d458e847-f246-4406-b628-e0bdeddb1e57 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:03.102826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4ef25e2-53fd-4bec-b148-bc5a2b9c15a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:03.103282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4ef25e2-53fd-4bec-b148-bc5a2b9c15a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:03.104109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4ef25e2-53fd-4bec-b148-bc5a2b9c15a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:03.104502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4ef25e2-53fd-4bec-b148-bc5a2b9c15a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:03.105119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d458e847-f246-4406-b628-e0bdeddb1e57 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154045 Mar 08 04:28:03.105708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 663/1320] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:02 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:28:03.133981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f4ef25e2-53fd-4bec-b148-bc5a2b9c15a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042055 Mar 08 04:28:03.134524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 658/1321] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:04.000526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a054fb84-2d08-49c8-8ab1-fe47c3ea04a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:04.001434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a054fb84-2d08-49c8-8ab1-fe47c3ea04a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:04.008321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a054fb84-2d08-49c8-8ab1-fe47c3ea04a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:04.008765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a054fb84-2d08-49c8-8ab1-fe47c3ea04a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:04.009522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a054fb84-2d08-49c8-8ab1-fe47c3ea04a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:04.009976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a054fb84-2d08-49c8-8ab1-fe47c3ea04a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:04.037482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a054fb84-2d08-49c8-8ab1-fe47c3ea04a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040917 Mar 08 04:28:04.038059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 664/1322] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:04.123235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bffcfe11-50d5-4796-a8a6-82e326704ba9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:04.123743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bffcfe11-50d5-4796-a8a6-82e326704ba9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:04.131321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bffcfe11-50d5-4796-a8a6-82e326704ba9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:04.131827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bffcfe11-50d5-4796-a8a6-82e326704ba9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:04.132591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bffcfe11-50d5-4796-a8a6-82e326704ba9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:04.133026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bffcfe11-50d5-4796-a8a6-82e326704ba9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:04.145166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2934a505-6449-49fc-8daa-e04ca3793ab3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:04.146119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2934a505-6449-49fc-8daa-e04ca3793ab3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:04.152223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2934a505-6449-49fc-8daa-e04ca3793ab3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:04.152676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2934a505-6449-49fc-8daa-e04ca3793ab3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:04.153444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2934a505-6449-49fc-8daa-e04ca3793ab3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:04.153912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2934a505-6449-49fc-8daa-e04ca3793ab3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:04.182504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2934a505-6449-49fc-8daa-e04ca3793ab3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041971 Mar 08 04:28:04.183244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 665/1323] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:04.273812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bffcfe11-50d5-4796-a8a6-82e326704ba9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:04.281374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bffcfe11-50d5-4796-a8a6-82e326704ba9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.162555 Mar 08 04:28:04.281965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 659/1324] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:04 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:05.049745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dd7b3309-b45a-4119-9ec8-27f991808ae6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:05.050971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dd7b3309-b45a-4119-9ec8-27f991808ae6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:05.057551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd7b3309-b45a-4119-9ec8-27f991808ae6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:05.058161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd7b3309-b45a-4119-9ec8-27f991808ae6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:05.058950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd7b3309-b45a-4119-9ec8-27f991808ae6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:05.059396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd7b3309-b45a-4119-9ec8-27f991808ae6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:05.088483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dd7b3309-b45a-4119-9ec8-27f991808ae6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Mar 08 04:28:05.089037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 666/1325] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:05.194766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ebb2fb4d-1189-4faf-ba31-3f5a78a2326c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:05.195671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ebb2fb4d-1189-4faf-ba31-3f5a78a2326c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:05.201930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ebb2fb4d-1189-4faf-ba31-3f5a78a2326c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:05.202381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ebb2fb4d-1189-4faf-ba31-3f5a78a2326c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:05.203147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ebb2fb4d-1189-4faf-ba31-3f5a78a2326c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:05.203586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ebb2fb4d-1189-4faf-ba31-3f5a78a2326c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:05.231513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ebb2fb4d-1189-4faf-ba31-3f5a78a2326c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041472 Mar 08 04:28:05.232066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 660/1326] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:05.298862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-98b97edc-a2a6-4653-9e64-2c165b4650d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:05.300049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-98b97edc-a2a6-4653-9e64-2c165b4650d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:05.305825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98b97edc-a2a6-4653-9e64-2c165b4650d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:05.306281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98b97edc-a2a6-4653-9e64-2c165b4650d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:05.307060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98b97edc-a2a6-4653-9e64-2c165b4650d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:05.307497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98b97edc-a2a6-4653-9e64-2c165b4650d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:05.444054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-98b97edc-a2a6-4653-9e64-2c165b4650d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:05.451369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-98b97edc-a2a6-4653-9e64-2c165b4650d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156333 Mar 08 04:28:05.451937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 667/1327] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:06.100854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-493bd97f-a499-4250-9f06-f79888a31fb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:06.101799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-493bd97f-a499-4250-9f06-f79888a31fb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:06.107685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-493bd97f-a499-4250-9f06-f79888a31fb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:06.108087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-493bd97f-a499-4250-9f06-f79888a31fb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:06.108890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-493bd97f-a499-4250-9f06-f79888a31fb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:06.109291 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-493bd97f-a499-4250-9f06-f79888a31fb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:06.136201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-493bd97f-a499-4250-9f06-f79888a31fb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040074 Mar 08 04:28:06.136743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 661/1328] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:06.242705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-73105421-1aa2-488d-8c9e-cc0f72f22ad8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:06.243624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-73105421-1aa2-488d-8c9e-cc0f72f22ad8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:06.249508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-73105421-1aa2-488d-8c9e-cc0f72f22ad8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:06.249984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-73105421-1aa2-488d-8c9e-cc0f72f22ad8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:06.250744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-73105421-1aa2-488d-8c9e-cc0f72f22ad8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:06.251174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-73105421-1aa2-488d-8c9e-cc0f72f22ad8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:06.281703 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-73105421-1aa2-488d-8c9e-cc0f72f22ad8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042736 Mar 08 04:28:06.282743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 668/1329] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:06.469684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cd830f98-d327-414b-81ef-9b69d93c2867 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:06.470298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cd830f98-d327-414b-81ef-9b69d93c2867 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:06.476477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd830f98-d327-414b-81ef-9b69d93c2867 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:06.476926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd830f98-d327-414b-81ef-9b69d93c2867 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:06.477707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd830f98-d327-414b-81ef-9b69d93c2867 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:06.478143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd830f98-d327-414b-81ef-9b69d93c2867 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:06.613588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cd830f98-d327-414b-81ef-9b69d93c2867 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:06.621295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cd830f98-d327-414b-81ef-9b69d93c2867 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155389 Mar 08 04:28:06.621973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 662/1330] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:07.148103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f3cceb40-1109-4b6a-9d83-7c427154c04c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:07.148932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f3cceb40-1109-4b6a-9d83-7c427154c04c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:07.156908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f3cceb40-1109-4b6a-9d83-7c427154c04c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:07.157356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f3cceb40-1109-4b6a-9d83-7c427154c04c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:07.158142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f3cceb40-1109-4b6a-9d83-7c427154c04c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:07.159171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f3cceb40-1109-4b6a-9d83-7c427154c04c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:07.186787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f3cceb40-1109-4b6a-9d83-7c427154c04c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Mar 08 04:28:07.187326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 669/1331] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:07.293821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-96707a13-3e2f-4e80-832a-6b286fa51402 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:07.294737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-96707a13-3e2f-4e80-832a-6b286fa51402 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:07.301037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96707a13-3e2f-4e80-832a-6b286fa51402 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:07.301528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96707a13-3e2f-4e80-832a-6b286fa51402 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:07.302317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96707a13-3e2f-4e80-832a-6b286fa51402 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:07.302752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96707a13-3e2f-4e80-832a-6b286fa51402 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:07.478573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-96707a13-3e2f-4e80-832a-6b286fa51402 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188661 Mar 08 04:28:07.479237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 663/1332] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:07.640878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-03d3df7f-d082-4d7b-9564-f1031bc619b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:07.641488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-03d3df7f-d082-4d7b-9564-f1031bc619b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:07.647941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-03d3df7f-d082-4d7b-9564-f1031bc619b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:07.648389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-03d3df7f-d082-4d7b-9564-f1031bc619b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:07.649153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-03d3df7f-d082-4d7b-9564-f1031bc619b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:07.649592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-03d3df7f-d082-4d7b-9564-f1031bc619b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:07.780444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-03d3df7f-d082-4d7b-9564-f1031bc619b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:07.787828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-03d3df7f-d082-4d7b-9564-f1031bc619b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150943 Mar 08 04:28:07.788391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 670/1333] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:08.198774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fb62a369-13c8-430c-9f1c-6e4c41add0c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:08.199715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fb62a369-13c8-430c-9f1c-6e4c41add0c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:08.206229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb62a369-13c8-430c-9f1c-6e4c41add0c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:08.206742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb62a369-13c8-430c-9f1c-6e4c41add0c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:08.207601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb62a369-13c8-430c-9f1c-6e4c41add0c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:08.208076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb62a369-13c8-430c-9f1c-6e4c41add0c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:08.236173 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fb62a369-13c8-430c-9f1c-6e4c41add0c7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041664 Mar 08 04:28:08.237258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 664/1334] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:08.490736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-32e14e11-25df-45f2-a90d-f006390111c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:08.491564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-32e14e11-25df-45f2-a90d-f006390111c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:08.497943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32e14e11-25df-45f2-a90d-f006390111c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:08.498386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32e14e11-25df-45f2-a90d-f006390111c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:08.499152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32e14e11-25df-45f2-a90d-f006390111c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:08.499578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32e14e11-25df-45f2-a90d-f006390111c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:08.526942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-32e14e11-25df-45f2-a90d-f006390111c1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040934 Mar 08 04:28:08.527474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 671/1335] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:08.805419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3c6d26c1-2f58-46af-b4a3-9ece9ce1077c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:08.806054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3c6d26c1-2f58-46af-b4a3-9ece9ce1077c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:08.812333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c6d26c1-2f58-46af-b4a3-9ece9ce1077c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:08.812775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c6d26c1-2f58-46af-b4a3-9ece9ce1077c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:08.813534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c6d26c1-2f58-46af-b4a3-9ece9ce1077c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:08.813987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c6d26c1-2f58-46af-b4a3-9ece9ce1077c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:08.949953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3c6d26c1-2f58-46af-b4a3-9ece9ce1077c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:08.957101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3c6d26c1-2f58-46af-b4a3-9ece9ce1077c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155715 Mar 08 04:28:08.957640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 665/1336] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:08 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:09.248322 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f2105bc9-82ab-4c36-ba77-31a3e9d15150 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:09.249266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f2105bc9-82ab-4c36-ba77-31a3e9d15150 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:09.255374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2105bc9-82ab-4c36-ba77-31a3e9d15150 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:09.255816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2105bc9-82ab-4c36-ba77-31a3e9d15150 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:09.256570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2105bc9-82ab-4c36-ba77-31a3e9d15150 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:09.257001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2105bc9-82ab-4c36-ba77-31a3e9d15150 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:09.289737 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f2105bc9-82ab-4c36-ba77-31a3e9d15150 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045319 Mar 08 04:28:09.290284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 672/1337] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:09 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:09.538788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ed542c8c-10b9-4a4c-bce7-aca820d72ae9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:09.539619 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ed542c8c-10b9-4a4c-bce7-aca820d72ae9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:09.545569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed542c8c-10b9-4a4c-bce7-aca820d72ae9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:09.546066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed542c8c-10b9-4a4c-bce7-aca820d72ae9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:09.546837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed542c8c-10b9-4a4c-bce7-aca820d72ae9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:09.547271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed542c8c-10b9-4a4c-bce7-aca820d72ae9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:09.574773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ed542c8c-10b9-4a4c-bce7-aca820d72ae9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040080 Mar 08 04:28:09.575318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 666/1338] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:09.973935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f1e5f178-6438-4162-a645-1ef0c2e44f95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:09.974537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f1e5f178-6438-4162-a645-1ef0c2e44f95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:09.980718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1e5f178-6438-4162-a645-1ef0c2e44f95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:09.981161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1e5f178-6438-4162-a645-1ef0c2e44f95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:09.981949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1e5f178-6438-4162-a645-1ef0c2e44f95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:09.982382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1e5f178-6438-4162-a645-1ef0c2e44f95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:10.111842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f1e5f178-6438-4162-a645-1ef0c2e44f95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:10.119646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f1e5f178-6438-4162-a645-1ef0c2e44f95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149665 Mar 08 04:28:10.120196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 673/1339] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:10.301785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f8e6401a-c9f0-422a-8277-6433f7d4945c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:10.302692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f8e6401a-c9f0-422a-8277-6433f7d4945c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:10.308880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8e6401a-c9f0-422a-8277-6433f7d4945c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:10.309331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8e6401a-c9f0-422a-8277-6433f7d4945c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:10.310120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8e6401a-c9f0-422a-8277-6433f7d4945c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:10.310552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8e6401a-c9f0-422a-8277-6433f7d4945c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:10.338294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f8e6401a-c9f0-422a-8277-6433f7d4945c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041243 Mar 08 04:28:10.338826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 667/1340] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:10.586675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e9f6ebb5-079d-408c-9c0d-21cc0c2bf45b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:10.587579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e9f6ebb5-079d-408c-9c0d-21cc0c2bf45b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:10.593600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9f6ebb5-079d-408c-9c0d-21cc0c2bf45b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:10.594071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9f6ebb5-079d-408c-9c0d-21cc0c2bf45b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:10.594827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9f6ebb5-079d-408c-9c0d-21cc0c2bf45b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:10.595259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e9f6ebb5-079d-408c-9c0d-21cc0c2bf45b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:10.622892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e9f6ebb5-079d-408c-9c0d-21cc0c2bf45b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040188 Mar 08 04:28:10.623430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 674/1341] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:11.136313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-89b63471-cb79-4f65-8d1f-cc44082cdd1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:11.136842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-89b63471-cb79-4f65-8d1f-cc44082cdd1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:11.142652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89b63471-cb79-4f65-8d1f-cc44082cdd1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:11.143099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89b63471-cb79-4f65-8d1f-cc44082cdd1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:11.143950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89b63471-cb79-4f65-8d1f-cc44082cdd1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:11.144392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89b63471-cb79-4f65-8d1f-cc44082cdd1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:11.274081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-89b63471-cb79-4f65-8d1f-cc44082cdd1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:11.281743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-89b63471-cb79-4f65-8d1f-cc44082cdd1b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149324 Mar 08 04:28:11.282297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 668/1342] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:11 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:11.349726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-577caa27-ed66-4157-9cac-efd1b9e85d1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:11.350725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-577caa27-ed66-4157-9cac-efd1b9e85d1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:11.356842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-577caa27-ed66-4157-9cac-efd1b9e85d1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:11.357288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-577caa27-ed66-4157-9cac-efd1b9e85d1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:11.358083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-577caa27-ed66-4157-9cac-efd1b9e85d1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:11.358520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-577caa27-ed66-4157-9cac-efd1b9e85d1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:11.395593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-577caa27-ed66-4157-9cac-efd1b9e85d1b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049650 Mar 08 04:28:11.396317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 675/1343] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:11.634465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-25e5c796-5543-4a20-b753-13c36c3c7b55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:11.635374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-25e5c796-5543-4a20-b753-13c36c3c7b55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:11.641538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25e5c796-5543-4a20-b753-13c36c3c7b55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:11.642006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25e5c796-5543-4a20-b753-13c36c3c7b55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:11.642783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25e5c796-5543-4a20-b753-13c36c3c7b55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:11.643204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25e5c796-5543-4a20-b753-13c36c3c7b55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:11.671433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-25e5c796-5543-4a20-b753-13c36c3c7b55 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040988 Mar 08 04:28:11.671973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 669/1344] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:12.298737 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b8d083d8-5e11-4029-93d9-395fa5c2e3a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:12.299369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b8d083d8-5e11-4029-93d9-395fa5c2e3a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:12.305827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8d083d8-5e11-4029-93d9-395fa5c2e3a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:12.306329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8d083d8-5e11-4029-93d9-395fa5c2e3a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:12.307218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8d083d8-5e11-4029-93d9-395fa5c2e3a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:12.307739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8d083d8-5e11-4029-93d9-395fa5c2e3a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:12.407296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e670fc08-1c31-4ebd-8dab-bb4337550674 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:12.408203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e670fc08-1c31-4ebd-8dab-bb4337550674 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:12.413978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e670fc08-1c31-4ebd-8dab-bb4337550674 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:12.414428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e670fc08-1c31-4ebd-8dab-bb4337550674 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:12.415199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e670fc08-1c31-4ebd-8dab-bb4337550674 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:12.415642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e670fc08-1c31-4ebd-8dab-bb4337550674 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:12.443010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b8d083d8-5e11-4029-93d9-395fa5c2e3a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:12.444092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e670fc08-1c31-4ebd-8dab-bb4337550674 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040673 Mar 08 04:28:12.444661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 670/1345] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:12.450486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b8d083d8-5e11-4029-93d9-395fa5c2e3a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155560 Mar 08 04:28:12.451025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 676/1346] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:12 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:12.683497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8765d024-10ab-49f1-86bf-1e78c93633cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:12.684443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8765d024-10ab-49f1-86bf-1e78c93633cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:12.691313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8765d024-10ab-49f1-86bf-1e78c93633cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:12.691772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8765d024-10ab-49f1-86bf-1e78c93633cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:12.692540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8765d024-10ab-49f1-86bf-1e78c93633cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:12.692977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8765d024-10ab-49f1-86bf-1e78c93633cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:12.720532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8765d024-10ab-49f1-86bf-1e78c93633cd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040980 Mar 08 04:28:12.721068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 671/1347] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:13.455904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a49ccf64-01a6-4410-b3fa-4d83ca51cab7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:13.456988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a49ccf64-01a6-4410-b3fa-4d83ca51cab7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:13.464434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a49ccf64-01a6-4410-b3fa-4d83ca51cab7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:13.464893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a49ccf64-01a6-4410-b3fa-4d83ca51cab7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:13.465687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a49ccf64-01a6-4410-b3fa-4d83ca51cab7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:13.466148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a49ccf64-01a6-4410-b3fa-4d83ca51cab7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:13.467744 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-93918d9b-29fd-47b8-99fc-9325408962ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:13.468351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-93918d9b-29fd-47b8-99fc-9325408962ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:13.474656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93918d9b-29fd-47b8-99fc-9325408962ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:13.475098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93918d9b-29fd-47b8-99fc-9325408962ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:13.475858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93918d9b-29fd-47b8-99fc-9325408962ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:13.476290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93918d9b-29fd-47b8-99fc-9325408962ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:13.494985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a49ccf64-01a6-4410-b3fa-4d83ca51cab7 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 Mar 08 04:28:13.495752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 677/1348] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:13.611225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-93918d9b-29fd-47b8-99fc-9325408962ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:13.619023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-93918d9b-29fd-47b8-99fc-9325408962ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155014 Mar 08 04:28:13.619592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 672/1349] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:13 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:28:13.731979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fbba18dd-f722-4be8-80d2-dcc3380f3b68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:13.732815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fbba18dd-f722-4be8-80d2-dcc3380f3b68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:13.738628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fbba18dd-f722-4be8-80d2-dcc3380f3b68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:13.739078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fbba18dd-f722-4be8-80d2-dcc3380f3b68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:13.739831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fbba18dd-f722-4be8-80d2-dcc3380f3b68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:13.740263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fbba18dd-f722-4be8-80d2-dcc3380f3b68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:13.768324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fbba18dd-f722-4be8-80d2-dcc3380f3b68 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040267 Mar 08 04:28:13.768917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 678/1350] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:14.507491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bb68a7a0-4a2d-49ea-b50a-bebf1916afe9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:14.508389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bb68a7a0-4a2d-49ea-b50a-bebf1916afe9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:14.514638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb68a7a0-4a2d-49ea-b50a-bebf1916afe9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:14.515081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb68a7a0-4a2d-49ea-b50a-bebf1916afe9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:14.515864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb68a7a0-4a2d-49ea-b50a-bebf1916afe9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:14.516308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb68a7a0-4a2d-49ea-b50a-bebf1916afe9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:14.544474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bb68a7a0-4a2d-49ea-b50a-bebf1916afe9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041575 Mar 08 04:28:14.545363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 673/1351] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:14.636059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-12f1afa8-3255-4268-8348-7dd44e8c40ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:14.636688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-12f1afa8-3255-4268-8348-7dd44e8c40ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:14.642853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12f1afa8-3255-4268-8348-7dd44e8c40ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:14.643301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12f1afa8-3255-4268-8348-7dd44e8c40ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:14.644057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12f1afa8-3255-4268-8348-7dd44e8c40ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:14.644487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12f1afa8-3255-4268-8348-7dd44e8c40ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:14.779765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-12f1afa8-3255-4268-8348-7dd44e8c40ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:14.780317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9dffa182-a87c-4b56-bde4-d83fad73c099 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:14.781296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9dffa182-a87c-4b56-bde4-d83fad73c099 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:14.787252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-12f1afa8-3255-4268-8348-7dd44e8c40ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154988 Mar 08 04:28:14.787408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9dffa182-a87c-4b56-bde4-d83fad73c099 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:14.787814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 679/1352] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:14 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:14.787937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9dffa182-a87c-4b56-bde4-d83fad73c099 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:14.788828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9dffa182-a87c-4b56-bde4-d83fad73c099 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:14.789254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9dffa182-a87c-4b56-bde4-d83fad73c099 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:14.819180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9dffa182-a87c-4b56-bde4-d83fad73c099 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 Mar 08 04:28:14.819869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 674/1353] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:15.556739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-82b46cac-92bf-494e-8c4e-d65cd18e3dec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:15.557702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-82b46cac-92bf-494e-8c4e-d65cd18e3dec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:15.563629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-82b46cac-92bf-494e-8c4e-d65cd18e3dec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:15.564040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-82b46cac-92bf-494e-8c4e-d65cd18e3dec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:15.564803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-82b46cac-92bf-494e-8c4e-d65cd18e3dec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:15.565240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-82b46cac-92bf-494e-8c4e-d65cd18e3dec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:15.593891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-82b46cac-92bf-494e-8c4e-d65cd18e3dec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041099 Mar 08 04:28:15.594432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 680/1354] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:15.804961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7c371d06-44af-499c-81a1-69f63025cb99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:15.805565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7c371d06-44af-499c-81a1-69f63025cb99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:15.812069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c371d06-44af-499c-81a1-69f63025cb99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:15.812507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c371d06-44af-499c-81a1-69f63025cb99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:15.813313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c371d06-44af-499c-81a1-69f63025cb99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:15.813782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c371d06-44af-499c-81a1-69f63025cb99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:15.830348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-963f0c90-69c1-41ff-bf56-df361523970b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:15.831250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-963f0c90-69c1-41ff-bf56-df361523970b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:15.837298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-963f0c90-69c1-41ff-bf56-df361523970b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:15.837840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-963f0c90-69c1-41ff-bf56-df361523970b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:15.838603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-963f0c90-69c1-41ff-bf56-df361523970b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:15.839035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-963f0c90-69c1-41ff-bf56-df361523970b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:15.869034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-963f0c90-69c1-41ff-bf56-df361523970b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Mar 08 04:28:15.869600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 681/1355] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:15.947577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7c371d06-44af-499c-81a1-69f63025cb99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:15.954758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7c371d06-44af-499c-81a1-69f63025cb99 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154286 Mar 08 04:28:15.955304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 675/1356] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:15 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:16.605904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-91aa9e1b-f8b0-4e24-982e-639dc1e8512c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:16.606820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-91aa9e1b-f8b0-4e24-982e-639dc1e8512c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:16.613105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91aa9e1b-f8b0-4e24-982e-639dc1e8512c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:16.613779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91aa9e1b-f8b0-4e24-982e-639dc1e8512c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:16.614659 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91aa9e1b-f8b0-4e24-982e-639dc1e8512c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:16.615095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91aa9e1b-f8b0-4e24-982e-639dc1e8512c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:16.643974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-91aa9e1b-f8b0-4e24-982e-639dc1e8512c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042416 Mar 08 04:28:16.644513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 682/1357] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:16 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:16.881056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-74bc402e-0ca4-4d06-a3f0-5208e1c1aa13 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:16.881931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-74bc402e-0ca4-4d06-a3f0-5208e1c1aa13 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:16.888152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74bc402e-0ca4-4d06-a3f0-5208e1c1aa13 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:16.888600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74bc402e-0ca4-4d06-a3f0-5208e1c1aa13 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:16.889361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74bc402e-0ca4-4d06-a3f0-5208e1c1aa13 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:16.889852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74bc402e-0ca4-4d06-a3f0-5208e1c1aa13 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:16.917821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-74bc402e-0ca4-4d06-a3f0-5208e1c1aa13 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041308 Mar 08 04:28:16.918360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 676/1358] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:16.970852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-57fac863-be14-4f7e-9c16-7444811c3439 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:16.971464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-57fac863-be14-4f7e-9c16-7444811c3439 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:16.977942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-57fac863-be14-4f7e-9c16-7444811c3439 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:16.978393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-57fac863-be14-4f7e-9c16-7444811c3439 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:16.979159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-57fac863-be14-4f7e-9c16-7444811c3439 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:16.979593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-57fac863-be14-4f7e-9c16-7444811c3439 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:17.114570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-57fac863-be14-4f7e-9c16-7444811c3439 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:17.121992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-57fac863-be14-4f7e-9c16-7444811c3439 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155080 Mar 08 04:28:17.122551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 683/1359] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:17.656322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3b79e375-dc79-4004-b853-7481ca98c028 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:28:17.657222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3b79e375-dc79-4004-b853-7481ca98c028 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:17.663772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b79e375-dc79-4004-b853-7481ca98c028 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:17.664215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b79e375-dc79-4004-b853-7481ca98c028 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:17.664970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b79e375-dc79-4004-b853-7481ca98c028 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:17.665402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b79e375-dc79-4004-b853-7481ca98c028 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:17.690094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b79e375-dc79-4004-b853-7481ca98c028 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [119bc22d-fb7c-4ddb-9027-961cc9673764] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 04:28:17.929284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-510bcb44-4185-4c62-ae86-382e3cc36fc9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:17.930235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-510bcb44-4185-4c62-ae86-382e3cc36fc9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:17.936070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-510bcb44-4185-4c62-ae86-382e3cc36fc9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:17.936520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-510bcb44-4185-4c62-ae86-382e3cc36fc9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:17.937283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-510bcb44-4185-4c62-ae86-382e3cc36fc9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:17.937743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-510bcb44-4185-4c62-ae86-382e3cc36fc9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:17.965487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-510bcb44-4185-4c62-ae86-382e3cc36fc9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040240 Mar 08 04:28:17.966051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 684/1360] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:18.138479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e54adb2f-fe43-4f43-8c11-8fff5f457321 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:18.139107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e54adb2f-fe43-4f43-8c11-8fff5f457321 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:18.146102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e54adb2f-fe43-4f43-8c11-8fff5f457321 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:18.146555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e54adb2f-fe43-4f43-8c11-8fff5f457321 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:18.147319 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e54adb2f-fe43-4f43-8c11-8fff5f457321 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:18.147784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e54adb2f-fe43-4f43-8c11-8fff5f457321 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:18.277200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e54adb2f-fe43-4f43-8c11-8fff5f457321 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:18.284508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e54adb2f-fe43-4f43-8c11-8fff5f457321 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149724 Mar 08 04:28:18.285067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 685/1361] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:18 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:28:18.698416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b79e375-dc79-4004-b853-7481ca98c028 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [119bc22d-fb7c-4ddb-9027-961cc9673764] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 45490. Mar 08 04:28:18.756634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3b79e375-dc79-4004-b853-7481ca98c028 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action" status: 200 len: 77347 microversion: 2.1 time: 1.104225 Mar 08 04:28:18.757303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 677/1362] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:28:17 2022] POST /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22/action => generated 77347 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:28:18.977350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-064dc3ba-fcbc-40ab-932f-24c147adaeaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:18.978305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-064dc3ba-fcbc-40ab-932f-24c147adaeaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:18.984167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-064dc3ba-fcbc-40ab-932f-24c147adaeaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:18.984620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-064dc3ba-fcbc-40ab-932f-24c147adaeaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:18.985386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-064dc3ba-fcbc-40ab-932f-24c147adaeaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:18.985880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-064dc3ba-fcbc-40ab-932f-24c147adaeaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:19.013441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-064dc3ba-fcbc-40ab-932f-24c147adaeaf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040656 Mar 08 04:28:19.014028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 686/1363] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:19.302451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-30117330-cbe9-4805-950d-e035189a3248 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:19.303104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-30117330-cbe9-4805-950d-e035189a3248 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:19.309921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30117330-cbe9-4805-950d-e035189a3248 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:19.310370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30117330-cbe9-4805-950d-e035189a3248 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:19.311132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30117330-cbe9-4805-950d-e035189a3248 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:19.311566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30117330-cbe9-4805-950d-e035189a3248 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:19.452874 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-30117330-cbe9-4805-950d-e035189a3248 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:19.460623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-30117330-cbe9-4805-950d-e035189a3248 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.162762 Mar 08 04:28:19.461179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 678/1364] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:20.024605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fa612e47-26ce-4d8c-8f7a-9d0bbbf12003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:20.025813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fa612e47-26ce-4d8c-8f7a-9d0bbbf12003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:20.032162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa612e47-26ce-4d8c-8f7a-9d0bbbf12003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:20.032605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa612e47-26ce-4d8c-8f7a-9d0bbbf12003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:20.033357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa612e47-26ce-4d8c-8f7a-9d0bbbf12003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:20.033818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa612e47-26ce-4d8c-8f7a-9d0bbbf12003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:20.061548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fa612e47-26ce-4d8c-8f7a-9d0bbbf12003 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041070 Mar 08 04:28:20.062117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 687/1365] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:20.478383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1677f3fa-4283-4a5c-8307-4089c65df3c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:20.478993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1677f3fa-4283-4a5c-8307-4089c65df3c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:20.485244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1677f3fa-4283-4a5c-8307-4089c65df3c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:20.485715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1677f3fa-4283-4a5c-8307-4089c65df3c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:20.486482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1677f3fa-4283-4a5c-8307-4089c65df3c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:20.486918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1677f3fa-4283-4a5c-8307-4089c65df3c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:20.620354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1677f3fa-4283-4a5c-8307-4089c65df3c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:20.627591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1677f3fa-4283-4a5c-8307-4089c65df3c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153666 Mar 08 04:28:20.628153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 679/1366] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:20 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:21.072825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a3fd04ee-f856-44cd-a0cc-544d150fcc0b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:21.073788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a3fd04ee-f856-44cd-a0cc-544d150fcc0b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:21.079974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3fd04ee-f856-44cd-a0cc-544d150fcc0b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:21.080417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3fd04ee-f856-44cd-a0cc-544d150fcc0b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:21.081170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3fd04ee-f856-44cd-a0cc-544d150fcc0b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:21.081598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3fd04ee-f856-44cd-a0cc-544d150fcc0b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:21.111170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a3fd04ee-f856-44cd-a0cc-544d150fcc0b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042834 Mar 08 04:28:21.111644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 688/1367] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:21.644422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2582e2eb-3bd4-4cd3-aa24-b8e42eef6d4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:21.645029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2582e2eb-3bd4-4cd3-aa24-b8e42eef6d4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:21.652134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2582e2eb-3bd4-4cd3-aa24-b8e42eef6d4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:21.652582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2582e2eb-3bd4-4cd3-aa24-b8e42eef6d4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:21.653343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2582e2eb-3bd4-4cd3-aa24-b8e42eef6d4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:21.653828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2582e2eb-3bd4-4cd3-aa24-b8e42eef6d4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:21.788798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2582e2eb-3bd4-4cd3-aa24-b8e42eef6d4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:21.796790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2582e2eb-3bd4-4cd3-aa24-b8e42eef6d4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156034 Mar 08 04:28:21.797367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 680/1368] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:21 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:22.122696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-716588e6-ab54-4098-8d33-a8d0ef1023dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:22.123602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-716588e6-ab54-4098-8d33-a8d0ef1023dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:22.129923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-716588e6-ab54-4098-8d33-a8d0ef1023dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:22.130371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-716588e6-ab54-4098-8d33-a8d0ef1023dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:22.131757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-716588e6-ab54-4098-8d33-a8d0ef1023dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:22.132188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-716588e6-ab54-4098-8d33-a8d0ef1023dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:22.160240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-716588e6-ab54-4098-8d33-a8d0ef1023dc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041518 Mar 08 04:28:22.160778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 689/1369] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:22.813996 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-af84c299-938b-4b25-a81a-461d19709ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:22.814600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-af84c299-938b-4b25-a81a-461d19709ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:22.821476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af84c299-938b-4b25-a81a-461d19709ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:22.821945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af84c299-938b-4b25-a81a-461d19709ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:22.822707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af84c299-938b-4b25-a81a-461d19709ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:22.823136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af84c299-938b-4b25-a81a-461d19709ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:22.960296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-af84c299-938b-4b25-a81a-461d19709ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:22.967643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-af84c299-938b-4b25-a81a-461d19709ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157575 Mar 08 04:28:22.968208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 681/1370] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:22 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:23.171851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c54056b4-3887-477c-8338-54d341bef8c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:23.172797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c54056b4-3887-477c-8338-54d341bef8c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:23.179660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c54056b4-3887-477c-8338-54d341bef8c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:23.180113 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c54056b4-3887-477c-8338-54d341bef8c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:23.180874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c54056b4-3887-477c-8338-54d341bef8c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:23.181314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c54056b4-3887-477c-8338-54d341bef8c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:23.209133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c54056b4-3887-477c-8338-54d341bef8c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041263 Mar 08 04:28:23.209794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 690/1371] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:23.984752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ea9a1bf1-593d-4d76-b650-6e9dbc882463 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:23.985356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ea9a1bf1-593d-4d76-b650-6e9dbc882463 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:23.991816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea9a1bf1-593d-4d76-b650-6e9dbc882463 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:23.992262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea9a1bf1-593d-4d76-b650-6e9dbc882463 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:23.993023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea9a1bf1-593d-4d76-b650-6e9dbc882463 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:23.993461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea9a1bf1-593d-4d76-b650-6e9dbc882463 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:24.124088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ea9a1bf1-593d-4d76-b650-6e9dbc882463 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:24.132451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ea9a1bf1-593d-4d76-b650-6e9dbc882463 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151531 Mar 08 04:28:24.133016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 682/1372] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:24.220522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-557f5953-aeea-4057-ad30-0c34155154ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:24.221492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-557f5953-aeea-4057-ad30-0c34155154ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:24.227972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-557f5953-aeea-4057-ad30-0c34155154ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:24.228422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-557f5953-aeea-4057-ad30-0c34155154ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:24.229181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-557f5953-aeea-4057-ad30-0c34155154ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:24.229613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-557f5953-aeea-4057-ad30-0c34155154ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:24.257630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-557f5953-aeea-4057-ad30-0c34155154ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041073 Mar 08 04:28:24.258188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 691/1373] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:25.150185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5bc25343-e0fc-448b-a0d2-cd7743b18606 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:25.150789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5bc25343-e0fc-448b-a0d2-cd7743b18606 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:25.156939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bc25343-e0fc-448b-a0d2-cd7743b18606 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:25.157411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bc25343-e0fc-448b-a0d2-cd7743b18606 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:25.158191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bc25343-e0fc-448b-a0d2-cd7743b18606 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:25.158627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bc25343-e0fc-448b-a0d2-cd7743b18606 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:25.268393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7ec1afda-9d35-4066-86cb-621795c0babd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:25.269312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7ec1afda-9d35-4066-86cb-621795c0babd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:25.276321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ec1afda-9d35-4066-86cb-621795c0babd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:25.276776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ec1afda-9d35-4066-86cb-621795c0babd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:25.277544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ec1afda-9d35-4066-86cb-621795c0babd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:25.278016 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ec1afda-9d35-4066-86cb-621795c0babd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:25.289918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5bc25343-e0fc-448b-a0d2-cd7743b18606 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:25.297574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5bc25343-e0fc-448b-a0d2-cd7743b18606 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152111 Mar 08 04:28:25.298182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 683/1374] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:25.308608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7ec1afda-9d35-4066-86cb-621795c0babd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Mar 08 04:28:25.309160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 692/1375] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:26.314749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2592e635-18bb-42a8-a5e1-610f038b42b9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:26.315351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2592e635-18bb-42a8-a5e1-610f038b42b9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:26.320154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fb87f3cc-df14-4564-9444-a6886ae142f3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:26.321105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fb87f3cc-df14-4564-9444-a6886ae142f3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:26.321640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2592e635-18bb-42a8-a5e1-610f038b42b9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:26.322117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2592e635-18bb-42a8-a5e1-610f038b42b9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:26.322892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2592e635-18bb-42a8-a5e1-610f038b42b9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:26.323327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2592e635-18bb-42a8-a5e1-610f038b42b9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:26.327234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb87f3cc-df14-4564-9444-a6886ae142f3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:26.327686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb87f3cc-df14-4564-9444-a6886ae142f3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:26.328486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb87f3cc-df14-4564-9444-a6886ae142f3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:26.328918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb87f3cc-df14-4564-9444-a6886ae142f3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:26.357199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fb87f3cc-df14-4564-9444-a6886ae142f3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041303 Mar 08 04:28:26.359600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 693/1376] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:26.457571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2592e635-18bb-42a8-a5e1-610f038b42b9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:26.464853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2592e635-18bb-42a8-a5e1-610f038b42b9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154021 Mar 08 04:28:26.465413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 684/1377] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:26 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:28:27.368639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-39ab005a-a38e-4576-9891-35775fba5202 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:27.369558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-39ab005a-a38e-4576-9891-35775fba5202 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:27.375854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39ab005a-a38e-4576-9891-35775fba5202 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:27.376303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39ab005a-a38e-4576-9891-35775fba5202 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:27.377067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39ab005a-a38e-4576-9891-35775fba5202 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:27.377503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39ab005a-a38e-4576-9891-35775fba5202 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:27.406602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-39ab005a-a38e-4576-9891-35775fba5202 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 Mar 08 04:28:27.407151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 694/1378] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:27.481636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dece94f2-c110-4757-95eb-f270ce82304f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:27.482261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dece94f2-c110-4757-95eb-f270ce82304f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:27.488461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dece94f2-c110-4757-95eb-f270ce82304f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:27.488906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dece94f2-c110-4757-95eb-f270ce82304f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:27.489693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dece94f2-c110-4757-95eb-f270ce82304f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:27.490136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dece94f2-c110-4757-95eb-f270ce82304f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:27.620496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dece94f2-c110-4757-95eb-f270ce82304f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:27.627698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dece94f2-c110-4757-95eb-f270ce82304f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149886 Mar 08 04:28:27.628260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 685/1379] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:27 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:28.418765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f4a41398-7aa6-431c-acf3-a5251c9840b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:28.419660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f4a41398-7aa6-431c-acf3-a5251c9840b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:28.425908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4a41398-7aa6-431c-acf3-a5251c9840b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:28.426360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4a41398-7aa6-431c-acf3-a5251c9840b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:28.427132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4a41398-7aa6-431c-acf3-a5251c9840b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:28.427568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4a41398-7aa6-431c-acf3-a5251c9840b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:28.456258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f4a41398-7aa6-431c-acf3-a5251c9840b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041510 Mar 08 04:28:28.456797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 695/1380] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:28.646350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d7b2a48c-a7c5-484d-9e89-946ad59efea4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:28.646987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d7b2a48c-a7c5-484d-9e89-946ad59efea4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:28.654175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7b2a48c-a7c5-484d-9e89-946ad59efea4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:28.654771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7b2a48c-a7c5-484d-9e89-946ad59efea4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:28.655550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7b2a48c-a7c5-484d-9e89-946ad59efea4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:28.655989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7b2a48c-a7c5-484d-9e89-946ad59efea4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:28.993995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d7b2a48c-a7c5-484d-9e89-946ad59efea4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:29.001243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d7b2a48c-a7c5-484d-9e89-946ad59efea4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.358787 Mar 08 04:28:29.001830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 686/1381] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:28 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:29.468350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0d8653e3-4c30-4c08-ae3c-784121b6b370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:29.469258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0d8653e3-4c30-4c08-ae3c-784121b6b370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:29.475419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d8653e3-4c30-4c08-ae3c-784121b6b370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:29.475866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d8653e3-4c30-4c08-ae3c-784121b6b370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:29.476711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d8653e3-4c30-4c08-ae3c-784121b6b370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:29.477755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d8653e3-4c30-4c08-ae3c-784121b6b370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:29.505741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0d8653e3-4c30-4c08-ae3c-784121b6b370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 Mar 08 04:28:29.506278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 696/1382] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:30.018240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-65e3be00-c0a5-4935-9ce1-2efbf3dc4c9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:30.018861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-65e3be00-c0a5-4935-9ce1-2efbf3dc4c9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:30.026478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65e3be00-c0a5-4935-9ce1-2efbf3dc4c9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:30.026932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65e3be00-c0a5-4935-9ce1-2efbf3dc4c9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:30.027707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65e3be00-c0a5-4935-9ce1-2efbf3dc4c9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:30.028146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65e3be00-c0a5-4935-9ce1-2efbf3dc4c9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:30.158544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-65e3be00-c0a5-4935-9ce1-2efbf3dc4c9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:30.165667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-65e3be00-c0a5-4935-9ce1-2efbf3dc4c9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151354 Mar 08 04:28:30.166243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 687/1383] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:30 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:30.516985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0bbfb584-1d46-4b2a-a58c-37f57e3026e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:30.517918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0bbfb584-1d46-4b2a-a58c-37f57e3026e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:30.524158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0bbfb584-1d46-4b2a-a58c-37f57e3026e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:30.524607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0bbfb584-1d46-4b2a-a58c-37f57e3026e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:30.525794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0bbfb584-1d46-4b2a-a58c-37f57e3026e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:30.526232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0bbfb584-1d46-4b2a-a58c-37f57e3026e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:30.553517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0bbfb584-1d46-4b2a-a58c-37f57e3026e1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040519 Mar 08 04:28:30.554089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 697/1384] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:31.182800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2cffb463-b876-480f-b5d5-6abb7166dc74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:31.183441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2cffb463-b876-480f-b5d5-6abb7166dc74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:31.189624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2cffb463-b876-480f-b5d5-6abb7166dc74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:31.190098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2cffb463-b876-480f-b5d5-6abb7166dc74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:31.190862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2cffb463-b876-480f-b5d5-6abb7166dc74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:31.191296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2cffb463-b876-480f-b5d5-6abb7166dc74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:31.322791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2cffb463-b876-480f-b5d5-6abb7166dc74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:31.330042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2cffb463-b876-480f-b5d5-6abb7166dc74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151221 Mar 08 04:28:31.330602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 688/1385] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:31 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:31.565630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a0ce696c-17d3-443a-a0db-dbf77eead1e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:31.566496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a0ce696c-17d3-443a-a0db-dbf77eead1e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:31.573236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a0ce696c-17d3-443a-a0db-dbf77eead1e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:31.573706 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a0ce696c-17d3-443a-a0db-dbf77eead1e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:31.574479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a0ce696c-17d3-443a-a0db-dbf77eead1e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:31.574912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a0ce696c-17d3-443a-a0db-dbf77eead1e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:31.602833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a0ce696c-17d3-443a-a0db-dbf77eead1e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041199 Mar 08 04:28:31.603505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 698/1386] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:32.347355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f2e53540-676d-4762-8bfb-4c1e55d391b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:32.347966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f2e53540-676d-4762-8bfb-4c1e55d391b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:32.358101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2e53540-676d-4762-8bfb-4c1e55d391b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:32.358555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2e53540-676d-4762-8bfb-4c1e55d391b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:32.359336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2e53540-676d-4762-8bfb-4c1e55d391b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:32.359773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2e53540-676d-4762-8bfb-4c1e55d391b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:32.495865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f2e53540-676d-4762-8bfb-4c1e55d391b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:32.503100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f2e53540-676d-4762-8bfb-4c1e55d391b1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.159600 Mar 08 04:28:32.503676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 689/1387] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:32 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:32.614222 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6c336dcd-7f7f-4797-8fff-3fb96f1bc4b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:32.615170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6c336dcd-7f7f-4797-8fff-3fb96f1bc4b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:32.621612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c336dcd-7f7f-4797-8fff-3fb96f1bc4b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:32.622172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c336dcd-7f7f-4797-8fff-3fb96f1bc4b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:32.623024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c336dcd-7f7f-4797-8fff-3fb96f1bc4b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:32.623457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c336dcd-7f7f-4797-8fff-3fb96f1bc4b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:32.651823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6c336dcd-7f7f-4797-8fff-3fb96f1bc4b0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041623 Mar 08 04:28:32.652433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 699/1388] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:28:33.520212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-49929f60-27aa-486e-9664-b4bb844d725e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:33.520812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-49929f60-27aa-486e-9664-b4bb844d725e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:33.528320 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49929f60-27aa-486e-9664-b4bb844d725e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:33.528839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49929f60-27aa-486e-9664-b4bb844d725e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:33.529715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49929f60-27aa-486e-9664-b4bb844d725e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:33.530196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49929f60-27aa-486e-9664-b4bb844d725e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:33.658308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-49929f60-27aa-486e-9664-b4bb844d725e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:33.663343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-deeae8d0-ee7c-4565-aa9b-40dc437142ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:33.664263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-deeae8d0-ee7c-4565-aa9b-40dc437142ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:33.665635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-49929f60-27aa-486e-9664-b4bb844d725e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149209 Mar 08 04:28:33.666801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 690/1389] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:33 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:33.671014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-deeae8d0-ee7c-4565-aa9b-40dc437142ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:33.671470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-deeae8d0-ee7c-4565-aa9b-40dc437142ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:33.672240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-deeae8d0-ee7c-4565-aa9b-40dc437142ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:33.672680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-deeae8d0-ee7c-4565-aa9b-40dc437142ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:33.700912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-deeae8d0-ee7c-4565-aa9b-40dc437142ea tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 Mar 08 04:28:33.701459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 700/1390] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:28:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:28:34.683735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0046deb5-c2d4-4ab2-a9c4-4494d951c18a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:34.684335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0046deb5-c2d4-4ab2-a9c4-4494d951c18a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:34.695414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0046deb5-c2d4-4ab2-a9c4-4494d951c18a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:34.695890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0046deb5-c2d4-4ab2-a9c4-4494d951c18a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:34.697079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0046deb5-c2d4-4ab2-a9c4-4494d951c18a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:34.697515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0046deb5-c2d4-4ab2-a9c4-4494d951c18a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:34.712417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1796baed-2368-48ef-9eed-e5c65b20348c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:28:34.713431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1796baed-2368-48ef-9eed-e5c65b20348c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:34.719603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1796baed-2368-48ef-9eed-e5c65b20348c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:34.720055 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1796baed-2368-48ef-9eed-e5c65b20348c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:34.720827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1796baed-2368-48ef-9eed-e5c65b20348c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:34.721265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1796baed-2368-48ef-9eed-e5c65b20348c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:34.796086 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1796baed-2368-48ef-9eed-e5c65b20348c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/action" status: 200 len: 41622 microversion: 2.1 time: 0.087387 Mar 08 04:28:34.796735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 701/1391] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:28:34 2022] POST /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5/action => generated 41622 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 04:28:34.852139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0046deb5-c2d4-4ab2-a9c4-4494d951c18a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:34.860488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0046deb5-c2d4-4ab2-a9c4-4494d951c18a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.181226 Mar 08 04:28:34.861040 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 691/1392] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:34 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:35.878624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b1e8a4f2-f603-48bb-a31f-b1f768bd1958 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:35.879313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b1e8a4f2-f603-48bb-a31f-b1f768bd1958 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:35.886885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1e8a4f2-f603-48bb-a31f-b1f768bd1958 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:35.887365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1e8a4f2-f603-48bb-a31f-b1f768bd1958 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:35.888131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1e8a4f2-f603-48bb-a31f-b1f768bd1958 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:35.888564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b1e8a4f2-f603-48bb-a31f-b1f768bd1958 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:36.029863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b1e8a4f2-f603-48bb-a31f-b1f768bd1958 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:36.037504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b1e8a4f2-f603-48bb-a31f-b1f768bd1958 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.163117 Mar 08 04:28:36.038086 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 702/1393] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:35 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:37.055321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bb1ce808-cbd4-4b92-8218-7b30642a5cca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:37.055929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bb1ce808-cbd4-4b92-8218-7b30642a5cca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:37.062376 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb1ce808-cbd4-4b92-8218-7b30642a5cca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:37.062825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb1ce808-cbd4-4b92-8218-7b30642a5cca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:37.063593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb1ce808-cbd4-4b92-8218-7b30642a5cca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:37.064026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb1ce808-cbd4-4b92-8218-7b30642a5cca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:37.200970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bb1ce808-cbd4-4b92-8218-7b30642a5cca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:37.208248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bb1ce808-cbd4-4b92-8218-7b30642a5cca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156841 Mar 08 04:28:37.208807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 692/1394] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:37 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:38.226147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-307af19a-254e-4f01-b53d-170bcb700153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:38.226788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-307af19a-254e-4f01-b53d-170bcb700153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:38.233236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-307af19a-254e-4f01-b53d-170bcb700153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:38.233720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-307af19a-254e-4f01-b53d-170bcb700153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:38.234492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-307af19a-254e-4f01-b53d-170bcb700153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:38.234929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-307af19a-254e-4f01-b53d-170bcb700153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:38.365039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-307af19a-254e-4f01-b53d-170bcb700153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:38.372662 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-307af19a-254e-4f01-b53d-170bcb700153 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150385 Mar 08 04:28:38.373233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 703/1395] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:38 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:39.389527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9b973cdc-dba6-4727-83bf-f2cb8b7eb50c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:39.390242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9b973cdc-dba6-4727-83bf-f2cb8b7eb50c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:39.396441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b973cdc-dba6-4727-83bf-f2cb8b7eb50c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:39.396883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b973cdc-dba6-4727-83bf-f2cb8b7eb50c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:39.397639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b973cdc-dba6-4727-83bf-f2cb8b7eb50c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:39.398089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b973cdc-dba6-4727-83bf-f2cb8b7eb50c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:39.535091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9b973cdc-dba6-4727-83bf-f2cb8b7eb50c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:39.543654 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9b973cdc-dba6-4727-83bf-f2cb8b7eb50c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.157777 Mar 08 04:28:39.544393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 693/1396] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:39 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:40.560328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8511cf13-a75a-4678-a264-fc78ed657389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:40.560945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8511cf13-a75a-4678-a264-fc78ed657389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:40.567179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8511cf13-a75a-4678-a264-fc78ed657389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:40.567621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8511cf13-a75a-4678-a264-fc78ed657389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:40.568384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8511cf13-a75a-4678-a264-fc78ed657389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:40.568835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8511cf13-a75a-4678-a264-fc78ed657389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:40.702062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8511cf13-a75a-4678-a264-fc78ed657389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:40.709290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8511cf13-a75a-4678-a264-fc78ed657389 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153335 Mar 08 04:28:40.709879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 704/1397] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:40 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:41.726402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-926d44e0-9c73-4df7-8242-162b14b8ca10 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:41.726988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-926d44e0-9c73-4df7-8242-162b14b8ca10 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:41.733307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-926d44e0-9c73-4df7-8242-162b14b8ca10 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:41.733776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-926d44e0-9c73-4df7-8242-162b14b8ca10 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:41.734538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-926d44e0-9c73-4df7-8242-162b14b8ca10 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:41.734968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-926d44e0-9c73-4df7-8242-162b14b8ca10 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:41.871433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-926d44e0-9c73-4df7-8242-162b14b8ca10 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:41.878651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-926d44e0-9c73-4df7-8242-162b14b8ca10 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156134 Mar 08 04:28:41.879212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 694/1398] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:41 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:42.896367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9076003a-02be-4501-9762-55d1ee966a09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:42.897009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9076003a-02be-4501-9762-55d1ee966a09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:42.904378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9076003a-02be-4501-9762-55d1ee966a09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:42.904823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9076003a-02be-4501-9762-55d1ee966a09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:42.905585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9076003a-02be-4501-9762-55d1ee966a09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:42.906079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9076003a-02be-4501-9762-55d1ee966a09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:43.039946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9076003a-02be-4501-9762-55d1ee966a09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:43.047319 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9076003a-02be-4501-9762-55d1ee966a09 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154856 Mar 08 04:28:43.047876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 705/1399] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:42 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:44.064623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5b2c3945-6368-40b7-8620-b5954d043cde tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:44.065238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5b2c3945-6368-40b7-8620-b5954d043cde tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:44.071487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b2c3945-6368-40b7-8620-b5954d043cde tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:44.071936 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b2c3945-6368-40b7-8620-b5954d043cde tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:44.072699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b2c3945-6368-40b7-8620-b5954d043cde tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:44.073738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b2c3945-6368-40b7-8620-b5954d043cde tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:44.205108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5b2c3945-6368-40b7-8620-b5954d043cde tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:44.212354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5b2c3945-6368-40b7-8620-b5954d043cde tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151632 Mar 08 04:28:44.212914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 695/1400] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:44 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:45.229313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-664d9c15-c948-4f3a-afe1-125246106c4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:45.229962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-664d9c15-c948-4f3a-afe1-125246106c4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:45.236243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-664d9c15-c948-4f3a-afe1-125246106c4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:45.236698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-664d9c15-c948-4f3a-afe1-125246106c4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:45.237465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-664d9c15-c948-4f3a-afe1-125246106c4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:45.237930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-664d9c15-c948-4f3a-afe1-125246106c4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:45.372602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-664d9c15-c948-4f3a-afe1-125246106c4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:45.379817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-664d9c15-c948-4f3a-afe1-125246106c4f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154407 Mar 08 04:28:45.380381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 706/1401] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:45 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:46.396357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-07fa87a8-c4e8-40c5-9766-df1b79c40542 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:46.396946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-07fa87a8-c4e8-40c5-9766-df1b79c40542 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:46.404041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07fa87a8-c4e8-40c5-9766-df1b79c40542 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:46.404484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07fa87a8-c4e8-40c5-9766-df1b79c40542 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:46.405240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07fa87a8-c4e8-40c5-9766-df1b79c40542 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:46.405687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07fa87a8-c4e8-40c5-9766-df1b79c40542 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:46.536358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-07fa87a8-c4e8-40c5-9766-df1b79c40542 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:46.543818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-07fa87a8-c4e8-40c5-9766-df1b79c40542 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151368 Mar 08 04:28:46.544377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 696/1402] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:46 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:47.560897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-45e555a6-8511-4a25-8216-ac9f76cf50a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:47.561480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-45e555a6-8511-4a25-8216-ac9f76cf50a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:47.567714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45e555a6-8511-4a25-8216-ac9f76cf50a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:47.568161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45e555a6-8511-4a25-8216-ac9f76cf50a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:47.568916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45e555a6-8511-4a25-8216-ac9f76cf50a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:47.569346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45e555a6-8511-4a25-8216-ac9f76cf50a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:47.698195 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-45e555a6-8511-4a25-8216-ac9f76cf50a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:47.705436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-45e555a6-8511-4a25-8216-ac9f76cf50a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149015 Mar 08 04:28:47.706032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 707/1403] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:47 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:48.722767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f1fef629-0f87-4c65-8e60-37945b03b8a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:48.723371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f1fef629-0f87-4c65-8e60-37945b03b8a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:48.730628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1fef629-0f87-4c65-8e60-37945b03b8a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:48.730628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1fef629-0f87-4c65-8e60-37945b03b8a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:48.731369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1fef629-0f87-4c65-8e60-37945b03b8a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:48.731804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1fef629-0f87-4c65-8e60-37945b03b8a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:48.866246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f1fef629-0f87-4c65-8e60-37945b03b8a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:48.873790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f1fef629-0f87-4c65-8e60-37945b03b8a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154821 Mar 08 04:28:48.874356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 697/1404] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:48 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:49.890728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4d97ffc5-e25f-4d93-b76a-5a730aa55609 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:49.891333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4d97ffc5-e25f-4d93-b76a-5a730aa55609 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:49.897577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4d97ffc5-e25f-4d93-b76a-5a730aa55609 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:49.898054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4d97ffc5-e25f-4d93-b76a-5a730aa55609 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:49.898813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4d97ffc5-e25f-4d93-b76a-5a730aa55609 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:49.899244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4d97ffc5-e25f-4d93-b76a-5a730aa55609 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:50.032913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4d97ffc5-e25f-4d93-b76a-5a730aa55609 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:50.040093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4d97ffc5-e25f-4d93-b76a-5a730aa55609 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153233 Mar 08 04:28:50.040649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 708/1405] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:49 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:28:51.058027 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-149cf10b-d5a0-473e-949e-d91f707835d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:51.058647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-149cf10b-d5a0-473e-949e-d91f707835d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:51.064897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-149cf10b-d5a0-473e-949e-d91f707835d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:51.065344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-149cf10b-d5a0-473e-949e-d91f707835d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:51.066137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-149cf10b-d5a0-473e-949e-d91f707835d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:51.066579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-149cf10b-d5a0-473e-949e-d91f707835d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:51.201771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-149cf10b-d5a0-473e-949e-d91f707835d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:51.209078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-149cf10b-d5a0-473e-949e-d91f707835d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155544 Mar 08 04:28:51.209647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 698/1406] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:51 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:52.225374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1e48cf27-b762-49f5-9d0c-d448ebb75f7d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:52.226015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1e48cf27-b762-49f5-9d0c-d448ebb75f7d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:52.232259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e48cf27-b762-49f5-9d0c-d448ebb75f7d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:52.232685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e48cf27-b762-49f5-9d0c-d448ebb75f7d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:52.233443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e48cf27-b762-49f5-9d0c-d448ebb75f7d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:52.233906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e48cf27-b762-49f5-9d0c-d448ebb75f7d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:52.364520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1e48cf27-b762-49f5-9d0c-d448ebb75f7d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:52.372207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1e48cf27-b762-49f5-9d0c-d448ebb75f7d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150641 Mar 08 04:28:52.372760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 709/1407] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:52 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:53.389068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0d322863-6197-4984-b805-370884467fd7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:53.389602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0d322863-6197-4984-b805-370884467fd7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:53.395915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d322863-6197-4984-b805-370884467fd7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:53.396370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d322863-6197-4984-b805-370884467fd7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:53.397140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d322863-6197-4984-b805-370884467fd7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:53.397581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d322863-6197-4984-b805-370884467fd7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:53.537887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0d322863-6197-4984-b805-370884467fd7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:53.545400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0d322863-6197-4984-b805-370884467fd7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.161009 Mar 08 04:28:53.545999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 699/1408] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:53 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:54.562411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f343fc3a-13eb-4041-833b-8987aa8bb949 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:54.563024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f343fc3a-13eb-4041-833b-8987aa8bb949 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:54.569304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f343fc3a-13eb-4041-833b-8987aa8bb949 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:54.569778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f343fc3a-13eb-4041-833b-8987aa8bb949 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:54.570545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f343fc3a-13eb-4041-833b-8987aa8bb949 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:54.570981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f343fc3a-13eb-4041-833b-8987aa8bb949 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:54.705530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f343fc3a-13eb-4041-833b-8987aa8bb949 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:54.715289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f343fc3a-13eb-4041-833b-8987aa8bb949 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156641 Mar 08 04:28:54.715884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 710/1409] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:54 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:28:55.733015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-41187852-79b7-4847-ba4f-86047ae67ad8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:55.733600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-41187852-79b7-4847-ba4f-86047ae67ad8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:55.739811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41187852-79b7-4847-ba4f-86047ae67ad8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:55.740255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41187852-79b7-4847-ba4f-86047ae67ad8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:55.741015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41187852-79b7-4847-ba4f-86047ae67ad8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:55.741445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41187852-79b7-4847-ba4f-86047ae67ad8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:55.873689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-41187852-79b7-4847-ba4f-86047ae67ad8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:55.881026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-41187852-79b7-4847-ba4f-86047ae67ad8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152411 Mar 08 04:28:55.881592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 700/1410] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:55 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:56.898011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e2261e5d-3f36-4402-8474-8d23fbc0a39a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:56.898615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e2261e5d-3f36-4402-8474-8d23fbc0a39a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:56.905058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2261e5d-3f36-4402-8474-8d23fbc0a39a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:56.905501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2261e5d-3f36-4402-8474-8d23fbc0a39a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:56.906280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2261e5d-3f36-4402-8474-8d23fbc0a39a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:56.906709 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e2261e5d-3f36-4402-8474-8d23fbc0a39a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:57.083377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e2261e5d-3f36-4402-8474-8d23fbc0a39a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:57.090967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e2261e5d-3f36-4402-8474-8d23fbc0a39a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.196879 Mar 08 04:28:57.091523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 711/1411] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:56 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:58.108140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-78a4ed54-c09a-4188-9e23-b36b68d692d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:58.108692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-78a4ed54-c09a-4188-9e23-b36b68d692d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:58.114980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78a4ed54-c09a-4188-9e23-b36b68d692d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:58.115418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78a4ed54-c09a-4188-9e23-b36b68d692d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:58.116175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78a4ed54-c09a-4188-9e23-b36b68d692d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:58.116606 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78a4ed54-c09a-4188-9e23-b36b68d692d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:58.292197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-78a4ed54-c09a-4188-9e23-b36b68d692d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:58.299591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-78a4ed54-c09a-4188-9e23-b36b68d692d4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.195508 Mar 08 04:28:58.300157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 701/1412] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:58 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:28:59.317385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-987244c6-0dd3-4bcb-9701-b18e3d2cfe4c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:28:59.318019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-987244c6-0dd3-4bcb-9701-b18e3d2cfe4c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:28:59.324832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-987244c6-0dd3-4bcb-9701-b18e3d2cfe4c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:59.325302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-987244c6-0dd3-4bcb-9701-b18e3d2cfe4c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:59.326100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-987244c6-0dd3-4bcb-9701-b18e3d2cfe4c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:28:59.326532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-987244c6-0dd3-4bcb-9701-b18e3d2cfe4c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:28:59.459897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-987244c6-0dd3-4bcb-9701-b18e3d2cfe4c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:28:59.467913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-987244c6-0dd3-4bcb-9701-b18e3d2cfe4c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154419 Mar 08 04:28:59.468477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 712/1413] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:28:59 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:29:00.485026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8888dd38-c996-4ec2-a358-2926677aede3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:00.485625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8888dd38-c996-4ec2-a358-2926677aede3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:00.492026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8888dd38-c996-4ec2-a358-2926677aede3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:00.492461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8888dd38-c996-4ec2-a358-2926677aede3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:00.493227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8888dd38-c996-4ec2-a358-2926677aede3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:00.493682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8888dd38-c996-4ec2-a358-2926677aede3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:00.624963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8888dd38-c996-4ec2-a358-2926677aede3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:00.632236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8888dd38-c996-4ec2-a358-2926677aede3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151066 Mar 08 04:29:00.632796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 702/1414] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:00 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:01.649726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8f8bfeae-0aa1-47cf-801b-c3c51edb193a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:01.650570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8f8bfeae-0aa1-47cf-801b-c3c51edb193a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:01.657350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f8bfeae-0aa1-47cf-801b-c3c51edb193a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:01.657835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f8bfeae-0aa1-47cf-801b-c3c51edb193a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:01.658599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f8bfeae-0aa1-47cf-801b-c3c51edb193a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:01.659030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f8bfeae-0aa1-47cf-801b-c3c51edb193a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:01.787803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8f8bfeae-0aa1-47cf-801b-c3c51edb193a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:01.795366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8f8bfeae-0aa1-47cf-801b-c3c51edb193a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149445 Mar 08 04:29:01.795919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 713/1415] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:01 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:29:02.812254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dbb67f73-ca5c-4c80-b54d-48d3d7f82aaa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:02.812845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dbb67f73-ca5c-4c80-b54d-48d3d7f82aaa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:02.819260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbb67f73-ca5c-4c80-b54d-48d3d7f82aaa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:02.819706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbb67f73-ca5c-4c80-b54d-48d3d7f82aaa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:02.820461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbb67f73-ca5c-4c80-b54d-48d3d7f82aaa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:02.820889 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbb67f73-ca5c-4c80-b54d-48d3d7f82aaa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:02.954779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dbb67f73-ca5c-4c80-b54d-48d3d7f82aaa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:02.962186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dbb67f73-ca5c-4c80-b54d-48d3d7f82aaa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153667 Mar 08 04:29:02.962813 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 703/1416] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:02 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:29:03.980068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e4b45a8f-75bd-496d-bdb8-91cad1aba04e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:03.980679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e4b45a8f-75bd-496d-bdb8-91cad1aba04e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:03.986982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4b45a8f-75bd-496d-bdb8-91cad1aba04e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:03.987440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4b45a8f-75bd-496d-bdb8-91cad1aba04e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:03.988212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4b45a8f-75bd-496d-bdb8-91cad1aba04e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:03.988654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4b45a8f-75bd-496d-bdb8-91cad1aba04e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:04.122696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e4b45a8f-75bd-496d-bdb8-91cad1aba04e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:04.130014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e4b45a8f-75bd-496d-bdb8-91cad1aba04e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154048 Mar 08 04:29:04.130578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 714/1417] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:03 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:29:05.130275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:29:05.130934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:29:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:29:05.147799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9bfc06b0-9d4c-40fc-bf5c-0491ef34cebb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:05.148429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9bfc06b0-9d4c-40fc-bf5c-0491ef34cebb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:05.155003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bfc06b0-9d4c-40fc-bf5c-0491ef34cebb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:05.155439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bfc06b0-9d4c-40fc-bf5c-0491ef34cebb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:05.156199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bfc06b0-9d4c-40fc-bf5c-0491ef34cebb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:05.156686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bfc06b0-9d4c-40fc-bf5c-0491ef34cebb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:05.291254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9bfc06b0-9d4c-40fc-bf5c-0491ef34cebb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:05.299128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9bfc06b0-9d4c-40fc-bf5c-0491ef34cebb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155378 Mar 08 04:29:05.299695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 704/1418] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:29:06.272823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:06.274564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:06.281256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:06.282008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:06.282868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:06.283417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:06.316601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-41aecdbf-51a6-4f31-ae74-a47e750b83c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:06.317215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-41aecdbf-51a6-4f31-ae74-a47e750b83c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:06.324475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41aecdbf-51a6-4f31-ae74-a47e750b83c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:06.324933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41aecdbf-51a6-4f31-ae74-a47e750b83c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:06.325736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41aecdbf-51a6-4f31-ae74-a47e750b83c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:06.326187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41aecdbf-51a6-4f31-ae74-a47e750b83c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:06.458904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-41aecdbf-51a6-4f31-ae74-a47e750b83c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:06.466435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-41aecdbf-51a6-4f31-ae74-a47e750b83c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153851 Mar 08 04:29:06.467085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 705/1419] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:07.483598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-036bd2a3-fe7b-465e-a8e2-d17e718c1b91 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:07.484238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-036bd2a3-fe7b-465e-a8e2-d17e718c1b91 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:07.490493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-036bd2a3-fe7b-465e-a8e2-d17e718c1b91 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:07.490943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-036bd2a3-fe7b-465e-a8e2-d17e718c1b91 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:07.491710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-036bd2a3-fe7b-465e-a8e2-d17e718c1b91 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:07.492144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-036bd2a3-fe7b-465e-a8e2-d17e718c1b91 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:07.628492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-036bd2a3-fe7b-465e-a8e2-d17e718c1b91 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:07.636305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-036bd2a3-fe7b-465e-a8e2-d17e718c1b91 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156651 Mar 08 04:29:07.636858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 706/1420] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:08.653681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-404a1770-afb7-4781-b1f2-711c3d825c9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:08.654357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-404a1770-afb7-4781-b1f2-711c3d825c9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:08.660516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-404a1770-afb7-4781-b1f2-711c3d825c9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:08.660963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-404a1770-afb7-4781-b1f2-711c3d825c9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:08.661757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-404a1770-afb7-4781-b1f2-711c3d825c9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:08.662194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-404a1770-afb7-4781-b1f2-711c3d825c9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:08.794470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-404a1770-afb7-4781-b1f2-711c3d825c9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:08.801704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-404a1770-afb7-4781-b1f2-711c3d825c9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152092 Mar 08 04:29:08.802252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 707/1421] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:08 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:09.819786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3defe33b-a206-4f38-96e2-eff5690f14e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:09.820468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3defe33b-a206-4f38-96e2-eff5690f14e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:09.827243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3defe33b-a206-4f38-96e2-eff5690f14e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:09.827688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3defe33b-a206-4f38-96e2-eff5690f14e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:09.828448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3defe33b-a206-4f38-96e2-eff5690f14e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:09.828884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3defe33b-a206-4f38-96e2-eff5690f14e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:09.958232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3defe33b-a206-4f38-96e2-eff5690f14e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:09.966048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3defe33b-a206-4f38-96e2-eff5690f14e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150119 Mar 08 04:29:09.966605 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 708/1422] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:10.983249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ca94af09-16a5-4f00-9a87-451bcc35a840 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:10.983854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ca94af09-16a5-4f00-9a87-451bcc35a840 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:10.990225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca94af09-16a5-4f00-9a87-451bcc35a840 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:10.990781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca94af09-16a5-4f00-9a87-451bcc35a840 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:10.991543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca94af09-16a5-4f00-9a87-451bcc35a840 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:10.991974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca94af09-16a5-4f00-9a87-451bcc35a840 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:11.128299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ca94af09-16a5-4f00-9a87-451bcc35a840 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:11.135600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ca94af09-16a5-4f00-9a87-451bcc35a840 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.156895 Mar 08 04:29:11.136239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 709/1423] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:10 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:12.153200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ec2892d5-0484-473a-b0e0-78f4413893c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:12.153875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ec2892d5-0484-473a-b0e0-78f4413893c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:12.159964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec2892d5-0484-473a-b0e0-78f4413893c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:12.160409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec2892d5-0484-473a-b0e0-78f4413893c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:12.161165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec2892d5-0484-473a-b0e0-78f4413893c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:12.161599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec2892d5-0484-473a-b0e0-78f4413893c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:12.293055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ec2892d5-0484-473a-b0e0-78f4413893c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:12.300313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ec2892d5-0484-473a-b0e0-78f4413893c9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151514 Mar 08 04:29:12.300910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 710/1424] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:12 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:13.317942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8666d978-794a-4ee1-9eb1-4b806dd286d2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:13.318596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8666d978-794a-4ee1-9eb1-4b806dd286d2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:13.325489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8666d978-794a-4ee1-9eb1-4b806dd286d2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:13.326017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8666d978-794a-4ee1-9eb1-4b806dd286d2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:13.326775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8666d978-794a-4ee1-9eb1-4b806dd286d2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:13.327204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8666d978-794a-4ee1-9eb1-4b806dd286d2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:13.461485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8666d978-794a-4ee1-9eb1-4b806dd286d2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:13.468720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8666d978-794a-4ee1-9eb1-4b806dd286d2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154636 Mar 08 04:29:13.469273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 711/1425] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:13 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:14.486008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fd46b708-e6a2-4215-b025-b0c9e87ee5c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:14.486671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fd46b708-e6a2-4215-b025-b0c9e87ee5c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:14.492781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd46b708-e6a2-4215-b025-b0c9e87ee5c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:14.493225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd46b708-e6a2-4215-b025-b0c9e87ee5c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:14.494006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd46b708-e6a2-4215-b025-b0c9e87ee5c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:14.494439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd46b708-e6a2-4215-b025-b0c9e87ee5c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:14.625791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fd46b708-e6a2-4215-b025-b0c9e87ee5c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:14.632941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fd46b708-e6a2-4215-b025-b0c9e87ee5c7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150856 Mar 08 04:29:14.633506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 712/1426] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:14 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:15.650055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-590e07cc-5ae8-4969-9caa-73f66668178a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:15.650989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-590e07cc-5ae8-4969-9caa-73f66668178a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:15.657035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-590e07cc-5ae8-4969-9caa-73f66668178a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:15.657481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-590e07cc-5ae8-4969-9caa-73f66668178a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:15.658269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-590e07cc-5ae8-4969-9caa-73f66668178a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:15.658701 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-590e07cc-5ae8-4969-9caa-73f66668178a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:15.790755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-590e07cc-5ae8-4969-9caa-73f66668178a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:15.798553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-590e07cc-5ae8-4969-9caa-73f66668178a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152309 Mar 08 04:29:15.799108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 713/1427] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:15 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:16.815206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fae15dcb-ba50-4a19-b720-8dbdfc2dd19d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:16.815865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fae15dcb-ba50-4a19-b720-8dbdfc2dd19d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:16.822271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fae15dcb-ba50-4a19-b720-8dbdfc2dd19d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:16.822714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fae15dcb-ba50-4a19-b720-8dbdfc2dd19d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:16.824080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fae15dcb-ba50-4a19-b720-8dbdfc2dd19d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:16.824595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fae15dcb-ba50-4a19-b720-8dbdfc2dd19d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:16.958664 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fae15dcb-ba50-4a19-b720-8dbdfc2dd19d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:16.965916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fae15dcb-ba50-4a19-b720-8dbdfc2dd19d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154557 Mar 08 04:29:16.966479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 714/1428] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:17.982715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3f91a7a3-7874-44f5-b86e-28f9eb92c05f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:17.983320 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3f91a7a3-7874-44f5-b86e-28f9eb92c05f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:17.989288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f91a7a3-7874-44f5-b86e-28f9eb92c05f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:17.989772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f91a7a3-7874-44f5-b86e-28f9eb92c05f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:17.990545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f91a7a3-7874-44f5-b86e-28f9eb92c05f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:17.990989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f91a7a3-7874-44f5-b86e-28f9eb92c05f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:18.121587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3f91a7a3-7874-44f5-b86e-28f9eb92c05f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:18.128858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3f91a7a3-7874-44f5-b86e-28f9eb92c05f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150035 Mar 08 04:29:18.129415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 715/1429] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:17 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:19.146682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2664a286-b93c-431c-9a80-dd0129634d43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:19.147313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2664a286-b93c-431c-9a80-dd0129634d43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:19.153887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2664a286-b93c-431c-9a80-dd0129634d43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:19.154334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2664a286-b93c-431c-9a80-dd0129634d43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:19.155090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2664a286-b93c-431c-9a80-dd0129634d43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:19.155522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2664a286-b93c-431c-9a80-dd0129634d43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:19.288545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2664a286-b93c-431c-9a80-dd0129634d43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:19.295969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2664a286-b93c-431c-9a80-dd0129634d43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153220 Mar 08 04:29:19.296537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 716/1430] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:20.313562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5234f418-bf5f-44e7-a863-3ea8de8df770 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:20.314365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5234f418-bf5f-44e7-a863-3ea8de8df770 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:20.320532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5234f418-bf5f-44e7-a863-3ea8de8df770 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:20.320977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5234f418-bf5f-44e7-a863-3ea8de8df770 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:20.321754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5234f418-bf5f-44e7-a863-3ea8de8df770 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:20.322188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5234f418-bf5f-44e7-a863-3ea8de8df770 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:20.455029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5234f418-bf5f-44e7-a863-3ea8de8df770 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:20.464164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5234f418-bf5f-44e7-a863-3ea8de8df770 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154840 Mar 08 04:29:20.464720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 717/1431] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:20 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:21.480432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-464de0df-7682-4c5f-bfa2-bd205ed2c48c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:21.481351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-464de0df-7682-4c5f-bfa2-bd205ed2c48c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:21.487417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-464de0df-7682-4c5f-bfa2-bd205ed2c48c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:21.487856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-464de0df-7682-4c5f-bfa2-bd205ed2c48c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:21.488613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-464de0df-7682-4c5f-bfa2-bd205ed2c48c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:21.489047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-464de0df-7682-4c5f-bfa2-bd205ed2c48c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:21.623458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-464de0df-7682-4c5f-bfa2-bd205ed2c48c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:21.630732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-464de0df-7682-4c5f-bfa2-bd205ed2c48c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154115 Mar 08 04:29:21.631288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 718/1432] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:21 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:22.648043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-91014691-64a8-4a0e-acd7-9ae7068516cb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:22.648722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-91014691-64a8-4a0e-acd7-9ae7068516cb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:22.655804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91014691-64a8-4a0e-acd7-9ae7068516cb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:22.656266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91014691-64a8-4a0e-acd7-9ae7068516cb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:22.657036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91014691-64a8-4a0e-acd7-9ae7068516cb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:22.657477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91014691-64a8-4a0e-acd7-9ae7068516cb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:22.789363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-91014691-64a8-4a0e-acd7-9ae7068516cb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:22.796823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-91014691-64a8-4a0e-acd7-9ae7068516cb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152640 Mar 08 04:29:22.797396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 719/1433] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:22 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:23.819998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-12aafa19-ba8d-4da0-98ac-1a3ea48ddf8e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:23.820784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-12aafa19-ba8d-4da0-98ac-1a3ea48ddf8e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:23.827940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-12aafa19-ba8d-4da0-98ac-1a3ea48ddf8e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:23.828386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-12aafa19-ba8d-4da0-98ac-1a3ea48ddf8e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:23.829144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-12aafa19-ba8d-4da0-98ac-1a3ea48ddf8e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:23.829574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-12aafa19-ba8d-4da0-98ac-1a3ea48ddf8e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:23.964065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-12aafa19-ba8d-4da0-98ac-1a3ea48ddf8e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:23.971961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-12aafa19-ba8d-4da0-98ac-1a3ea48ddf8e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155929 Mar 08 04:29:23.972516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 720/1434] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:24.989182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dd211bf1-f468-4b71-8cef-35c5d4b43f75 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:24.989690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dd211bf1-f468-4b71-8cef-35c5d4b43f75 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:24.996197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd211bf1-f468-4b71-8cef-35c5d4b43f75 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:24.997295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd211bf1-f468-4b71-8cef-35c5d4b43f75 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:24.998176 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd211bf1-f468-4b71-8cef-35c5d4b43f75 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:24.998625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd211bf1-f468-4b71-8cef-35c5d4b43f75 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:25.143133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dd211bf1-f468-4b71-8cef-35c5d4b43f75 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:25.150893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dd211bf1-f468-4b71-8cef-35c5d4b43f75 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.165477 Mar 08 04:29:25.151445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 721/1435] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:24 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:26.169099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6e4b37b7-0cc1-4ba9-9c42-c24f0c91af43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:26.169985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6e4b37b7-0cc1-4ba9-9c42-c24f0c91af43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:26.176427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e4b37b7-0cc1-4ba9-9c42-c24f0c91af43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:26.176872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e4b37b7-0cc1-4ba9-9c42-c24f0c91af43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:26.177633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e4b37b7-0cc1-4ba9-9c42-c24f0c91af43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:26.178088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e4b37b7-0cc1-4ba9-9c42-c24f0c91af43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:26.310457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6e4b37b7-0cc1-4ba9-9c42-c24f0c91af43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:26.317563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6e4b37b7-0cc1-4ba9-9c42-c24f0c91af43 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152929 Mar 08 04:29:26.318143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 722/1436] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:26 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:27.334397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b9eef50a-97b3-4239-b571-1f01cb26d852 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:27.335128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b9eef50a-97b3-4239-b571-1f01cb26d852 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:27.341216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b9eef50a-97b3-4239-b571-1f01cb26d852 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:27.341679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b9eef50a-97b3-4239-b571-1f01cb26d852 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:27.342449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b9eef50a-97b3-4239-b571-1f01cb26d852 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:27.342883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b9eef50a-97b3-4239-b571-1f01cb26d852 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:27.475888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b9eef50a-97b3-4239-b571-1f01cb26d852 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:27.483106 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b9eef50a-97b3-4239-b571-1f01cb26d852 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152584 Mar 08 04:29:27.483659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 723/1437] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:27 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:28.499907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f934088a-81f5-4477-84e5-ffe9c12d8bdc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:28.500571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f934088a-81f5-4477-84e5-ffe9c12d8bdc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:28.506798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f934088a-81f5-4477-84e5-ffe9c12d8bdc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:28.507242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f934088a-81f5-4477-84e5-ffe9c12d8bdc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:28.508000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f934088a-81f5-4477-84e5-ffe9c12d8bdc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:28.508435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f934088a-81f5-4477-84e5-ffe9c12d8bdc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:28.639670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f934088a-81f5-4477-84e5-ffe9c12d8bdc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:28.647024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f934088a-81f5-4477-84e5-ffe9c12d8bdc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151196 Mar 08 04:29:28.647582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 724/1438] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:28 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:29.664138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1b06959f-0cd1-485c-8409-14b96fa34969 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:29.664790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1b06959f-0cd1-485c-8409-14b96fa34969 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:29.671656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b06959f-0cd1-485c-8409-14b96fa34969 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:29.672098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b06959f-0cd1-485c-8409-14b96fa34969 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:29.672851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b06959f-0cd1-485c-8409-14b96fa34969 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:29.673285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b06959f-0cd1-485c-8409-14b96fa34969 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:29.803058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1b06959f-0cd1-485c-8409-14b96fa34969 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:29.810530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1b06959f-0cd1-485c-8409-14b96fa34969 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150258 Mar 08 04:29:29.811089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 725/1439] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:29 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:30.828298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5999dc4c-e741-4d0e-9215-eaadd64c3d6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:30.828973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5999dc4c-e741-4d0e-9215-eaadd64c3d6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:30.835126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5999dc4c-e741-4d0e-9215-eaadd64c3d6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:30.835569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5999dc4c-e741-4d0e-9215-eaadd64c3d6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:30.836324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5999dc4c-e741-4d0e-9215-eaadd64c3d6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:30.836758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5999dc4c-e741-4d0e-9215-eaadd64c3d6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:30.970806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5999dc4c-e741-4d0e-9215-eaadd64c3d6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:30.978190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5999dc4c-e741-4d0e-9215-eaadd64c3d6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154353 Mar 08 04:29:30.978754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 726/1440] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:30 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:31.995198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4275a3a7-2331-4983-b502-1206a86a8d33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:31.995837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4275a3a7-2331-4983-b502-1206a86a8d33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:32.002181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4275a3a7-2331-4983-b502-1206a86a8d33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:32.002633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4275a3a7-2331-4983-b502-1206a86a8d33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:32.003403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4275a3a7-2331-4983-b502-1206a86a8d33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:32.003843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4275a3a7-2331-4983-b502-1206a86a8d33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:32.136906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4275a3a7-2331-4983-b502-1206a86a8d33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:32.144777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4275a3a7-2331-4983-b502-1206a86a8d33 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153512 Mar 08 04:29:32.145327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 727/1441] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:31 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:33.162065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-376dc305-f648-4e53-b92c-f903ab63124d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:33.162732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-376dc305-f648-4e53-b92c-f903ab63124d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:33.169398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-376dc305-f648-4e53-b92c-f903ab63124d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:33.169874 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-376dc305-f648-4e53-b92c-f903ab63124d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:33.170638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-376dc305-f648-4e53-b92c-f903ab63124d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:33.171071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-376dc305-f648-4e53-b92c-f903ab63124d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:33.305321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-376dc305-f648-4e53-b92c-f903ab63124d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:33.312721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-376dc305-f648-4e53-b92c-f903ab63124d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.154532 Mar 08 04:29:33.313280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 728/1442] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:33 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:34.329777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2994b090-f0f1-4245-81af-973a4d31b11e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:34.330441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2994b090-f0f1-4245-81af-973a4d31b11e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:34.336698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2994b090-f0f1-4245-81af-973a4d31b11e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:34.337146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2994b090-f0f1-4245-81af-973a4d31b11e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:34.337933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2994b090-f0f1-4245-81af-973a4d31b11e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:34.338369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2994b090-f0f1-4245-81af-973a4d31b11e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:34.471749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2994b090-f0f1-4245-81af-973a4d31b11e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:34.479062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2994b090-f0f1-4245-81af-973a4d31b11e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153295 Mar 08 04:29:34.479625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 729/1443] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:34 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:35.501094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f2f7f233-694f-462b-8287-5567426b24cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:35.501794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f2f7f233-694f-462b-8287-5567426b24cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:35.507976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2f7f233-694f-462b-8287-5567426b24cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:35.508423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2f7f233-694f-462b-8287-5567426b24cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:35.509193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2f7f233-694f-462b-8287-5567426b24cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:35.509632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f2f7f233-694f-462b-8287-5567426b24cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:35.641502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f2f7f233-694f-462b-8287-5567426b24cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:35.648748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f2f7f233-694f-462b-8287-5567426b24cf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.152278 Mar 08 04:29:35.649301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 730/1444] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:35 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:36.666332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-de7c2583-6f2f-4507-ad5d-181a4d483caf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:36.667095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-de7c2583-6f2f-4507-ad5d-181a4d483caf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:36.673983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de7c2583-6f2f-4507-ad5d-181a4d483caf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:36.674431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de7c2583-6f2f-4507-ad5d-181a4d483caf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:36.675201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de7c2583-6f2f-4507-ad5d-181a4d483caf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:36.675637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de7c2583-6f2f-4507-ad5d-181a4d483caf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:36.819642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-de7c2583-6f2f-4507-ad5d-181a4d483caf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:36.829602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-de7c2583-6f2f-4507-ad5d-181a4d483caf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.167175 Mar 08 04:29:36.830585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 731/1445] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:36 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:37.850571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e70cdbe7-4105-4bdc-9058-100ca466fb80 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:37.851247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e70cdbe7-4105-4bdc-9058-100ca466fb80 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:37.857966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e70cdbe7-4105-4bdc-9058-100ca466fb80 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:37.858412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e70cdbe7-4105-4bdc-9058-100ca466fb80 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:37.859197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e70cdbe7-4105-4bdc-9058-100ca466fb80 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:37.859627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e70cdbe7-4105-4bdc-9058-100ca466fb80 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:38.001831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e70cdbe7-4105-4bdc-9058-100ca466fb80 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:38.009019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e70cdbe7-4105-4bdc-9058-100ca466fb80 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.162310 Mar 08 04:29:38.009570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 732/1446] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:37 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:39.026727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a601053c-b300-4ea4-847a-a39ea283103f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:39.027335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a601053c-b300-4ea4-847a-a39ea283103f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:39.034176 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a601053c-b300-4ea4-847a-a39ea283103f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:39.034617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a601053c-b300-4ea4-847a-a39ea283103f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:39.035372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a601053c-b300-4ea4-847a-a39ea283103f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:39.035804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a601053c-b300-4ea4-847a-a39ea283103f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:39.170362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a601053c-b300-4ea4-847a-a39ea283103f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:39.177667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a601053c-b300-4ea4-847a-a39ea283103f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155034 Mar 08 04:29:39.178240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 733/1447] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:39 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:40.194949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0e917a5f-0edd-4231-9ffa-cd578a0227c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:40.195613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0e917a5f-0edd-4231-9ffa-cd578a0227c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:40.202540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0e917a5f-0edd-4231-9ffa-cd578a0227c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:40.202982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0e917a5f-0edd-4231-9ffa-cd578a0227c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:40.203744 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0e917a5f-0edd-4231-9ffa-cd578a0227c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:40.204185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0e917a5f-0edd-4231-9ffa-cd578a0227c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:40.334067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0e917a5f-0edd-4231-9ffa-cd578a0227c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:40.341394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0e917a5f-0edd-4231-9ffa-cd578a0227c3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.150206 Mar 08 04:29:40.341988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 734/1448] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:40 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:41.358704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3c1f29a2-8a51-4cdd-a878-859cb6819878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:41.359379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3c1f29a2-8a51-4cdd-a878-859cb6819878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:41.365508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c1f29a2-8a51-4cdd-a878-859cb6819878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:41.365979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c1f29a2-8a51-4cdd-a878-859cb6819878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:41.366732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c1f29a2-8a51-4cdd-a878-859cb6819878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:41.367162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c1f29a2-8a51-4cdd-a878-859cb6819878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:41.500605 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3c1f29a2-8a51-4cdd-a878-859cb6819878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:41.507895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3c1f29a2-8a51-4cdd-a878-859cb6819878 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.153513 Mar 08 04:29:41.508458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 735/1449] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:41 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:42.524571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5683a060-2913-4149-8991-dba3a7967db3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:42.526099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5683a060-2913-4149-8991-dba3a7967db3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:42.533180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5683a060-2913-4149-8991-dba3a7967db3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:42.533630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5683a060-2913-4149-8991-dba3a7967db3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:42.534453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5683a060-2913-4149-8991-dba3a7967db3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:42.534892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5683a060-2913-4149-8991-dba3a7967db3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:42.664135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5683a060-2913-4149-8991-dba3a7967db3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:42.672089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5683a060-2913-4149-8991-dba3a7967db3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151405 Mar 08 04:29:42.672654 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 736/1450] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:42 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:43.689687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5eaaa624-64e0-4843-9fca-2cb568235c0a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:43.690380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5eaaa624-64e0-4843-9fca-2cb568235c0a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:43.696602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5eaaa624-64e0-4843-9fca-2cb568235c0a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:43.697049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5eaaa624-64e0-4843-9fca-2cb568235c0a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:43.697862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5eaaa624-64e0-4843-9fca-2cb568235c0a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:43.698293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5eaaa624-64e0-4843-9fca-2cb568235c0a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:43.829635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5eaaa624-64e0-4843-9fca-2cb568235c0a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:43.836994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5eaaa624-64e0-4843-9fca-2cb568235c0a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.151139 Mar 08 04:29:43.837585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 737/1451] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:43 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:44.853028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-10cc101a-cf17-43d9-8f33-b1289d588fbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:44.853730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-10cc101a-cf17-43d9-8f33-b1289d588fbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:44.860506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10cc101a-cf17-43d9-8f33-b1289d588fbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:44.860948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10cc101a-cf17-43d9-8f33-b1289d588fbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:44.861734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10cc101a-cf17-43d9-8f33-b1289d588fbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:44.862168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10cc101a-cf17-43d9-8f33-b1289d588fbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:44.996690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-10cc101a-cf17-43d9-8f33-b1289d588fbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:45.004338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-10cc101a-cf17-43d9-8f33-b1289d588fbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.155190 Mar 08 04:29:45.004897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 738/1452] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:44 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:46.021875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c5665825-7d84-455f-a701-b9828232ddd8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:46.022542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c5665825-7d84-455f-a701-b9828232ddd8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:46.029137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5665825-7d84-455f-a701-b9828232ddd8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:46.029588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5665825-7d84-455f-a701-b9828232ddd8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:46.030384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5665825-7d84-455f-a701-b9828232ddd8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:46.030820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5665825-7d84-455f-a701-b9828232ddd8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:46.160053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c5665825-7d84-455f-a701-b9828232ddd8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:46.167290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c5665825-7d84-455f-a701-b9828232ddd8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.149285 Mar 08 04:29:46.167855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 739/1453] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:46 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:47.024820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-847c6d06-78de-4a97-9593-e911eda64c2f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:47.025407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-847c6d06-78de-4a97-9593-e911eda64c2f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:47.031991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-847c6d06-78de-4a97-9593-e911eda64c2f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:47.032440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-847c6d06-78de-4a97-9593-e911eda64c2f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:47.033211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-847c6d06-78de-4a97-9593-e911eda64c2f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:47.033649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-847c6d06-78de-4a97-9593-e911eda64c2f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:47.058947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-847c6d06-78de-4a97-9593-e911eda64c2f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Going to try to terminate instance {{(pid=116774) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:29:47.135369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-847c6d06-78de-4a97-9593-e911eda64c2f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 204 len: 0 microversion: 2.1 time: 0.114124 Mar 08 04:29:47.139457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 740/1454] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:29:47 2022] DELETE /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 04:29:47.195677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-1f1280fb-76f0-4c60-94db-826ff983c200 req-0f0033ec-ac6e-4e67-b400-4f8991ba34b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4208bcea-e0a6-4c9d-956c-477a87d388ca", "tag": "5ed21f05-392d-4365-8c94-f119e23a8232"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:29:47.205244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-1f1280fb-76f0-4c60-94db-826ff983c200 req-0f0033ec-ac6e-4e67-b400-4f8991ba34b5 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:47.205710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-1f1280fb-76f0-4c60-94db-826ff983c200 req-0f0033ec-ac6e-4e67-b400-4f8991ba34b5 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:47.216527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-1f1280fb-76f0-4c60-94db-826ff983c200 req-0f0033ec-ac6e-4e67-b400-4f8991ba34b5 service nova] Creating event network-changed:5ed21f05-392d-4365-8c94-f119e23a8232 for instance 4208bcea-e0a6-4c9d-956c-477a87d388ca on hv-cinder-73306 Mar 08 04:29:47.221452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-1f1280fb-76f0-4c60-94db-826ff983c200 req-0f0033ec-ac6e-4e67-b400-4f8991ba34b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084210 Mar 08 04:29:47.222067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 741/1455] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:29:47.227136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fdc78e60-3cbf-4115-93c7-b8ba0419061c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:47.227820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fdc78e60-3cbf-4115-93c7-b8ba0419061c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:47.235701 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdc78e60-3cbf-4115-93c7-b8ba0419061c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:47.236063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdc78e60-3cbf-4115-93c7-b8ba0419061c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:47.236838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdc78e60-3cbf-4115-93c7-b8ba0419061c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:47.237273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdc78e60-3cbf-4115-93c7-b8ba0419061c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:47.382460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fdc78e60-3cbf-4115-93c7-b8ba0419061c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:47.390378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fdc78e60-3cbf-4115-93c7-b8ba0419061c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1568 microversion: 2.1 time: 0.167206 Mar 08 04:29:47.390954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 742/1456] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:47 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:29:48.408959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-17e16a35-204e-4a8d-9009-f4dafebc9acd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:48.409576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-17e16a35-204e-4a8d-9009-f4dafebc9acd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:48.417481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-17e16a35-204e-4a8d-9009-f4dafebc9acd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:48.417965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-17e16a35-204e-4a8d-9009-f4dafebc9acd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:48.419542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-17e16a35-204e-4a8d-9009-f4dafebc9acd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:48.420013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-17e16a35-204e-4a8d-9009-f4dafebc9acd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:48.550430 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-17e16a35-204e-4a8d-9009-f4dafebc9acd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:48.557547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-17e16a35-204e-4a8d-9009-f4dafebc9acd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.152654 Mar 08 04:29:48.558133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 743/1457] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:48 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:49.574372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-866bbb36-6047-4f60-8609-94d11b8e294b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:49.575704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-866bbb36-6047-4f60-8609-94d11b8e294b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:49.581794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866bbb36-6047-4f60-8609-94d11b8e294b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:49.582251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866bbb36-6047-4f60-8609-94d11b8e294b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:49.583014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866bbb36-6047-4f60-8609-94d11b8e294b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:49.583451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866bbb36-6047-4f60-8609-94d11b8e294b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:49.721372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-866bbb36-6047-4f60-8609-94d11b8e294b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:49.728597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-866bbb36-6047-4f60-8609-94d11b8e294b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.158122 Mar 08 04:29:49.729155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 744/1458] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:49 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:50.745275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9991cda8-c8ab-4a0a-bb1c-13070e45f86a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:50.745921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9991cda8-c8ab-4a0a-bb1c-13070e45f86a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:50.752937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9991cda8-c8ab-4a0a-bb1c-13070e45f86a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:50.753383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9991cda8-c8ab-4a0a-bb1c-13070e45f86a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:50.754201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9991cda8-c8ab-4a0a-bb1c-13070e45f86a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:50.754638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9991cda8-c8ab-4a0a-bb1c-13070e45f86a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:50.887214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9991cda8-c8ab-4a0a-bb1c-13070e45f86a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:50.894504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9991cda8-c8ab-4a0a-bb1c-13070e45f86a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153113 Mar 08 04:29:50.895067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 745/1459] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:50 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:51.911860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-af303c15-3486-4dba-8cbb-135170ee1832 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:51.912465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-af303c15-3486-4dba-8cbb-135170ee1832 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:51.919264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af303c15-3486-4dba-8cbb-135170ee1832 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:51.919699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af303c15-3486-4dba-8cbb-135170ee1832 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:51.920454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af303c15-3486-4dba-8cbb-135170ee1832 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:51.920885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af303c15-3486-4dba-8cbb-135170ee1832 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:52.053011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-af303c15-3486-4dba-8cbb-135170ee1832 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:52.060403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-af303c15-3486-4dba-8cbb-135170ee1832 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.152309 Mar 08 04:29:52.060898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 746/1460] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:51 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:53.076254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-688373b1-4ac0-4044-bfa8-4c420519a165 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:53.076872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-688373b1-4ac0-4044-bfa8-4c420519a165 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:53.083141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-688373b1-4ac0-4044-bfa8-4c420519a165 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:53.083595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-688373b1-4ac0-4044-bfa8-4c420519a165 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:53.084365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-688373b1-4ac0-4044-bfa8-4c420519a165 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:53.084807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-688373b1-4ac0-4044-bfa8-4c420519a165 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:53.222695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-688373b1-4ac0-4044-bfa8-4c420519a165 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:53.229981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-688373b1-4ac0-4044-bfa8-4c420519a165 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.157576 Mar 08 04:29:53.230544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 747/1461] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:53 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:54.246351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1d1d7a42-3df6-4119-8313-2754f8831f1d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:54.247723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1d1d7a42-3df6-4119-8313-2754f8831f1d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:54.253708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d1d7a42-3df6-4119-8313-2754f8831f1d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:54.254155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d1d7a42-3df6-4119-8313-2754f8831f1d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:54.254908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d1d7a42-3df6-4119-8313-2754f8831f1d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:54.255339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d1d7a42-3df6-4119-8313-2754f8831f1d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:54.386666 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1d1d7a42-3df6-4119-8313-2754f8831f1d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:54.394222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1d1d7a42-3df6-4119-8313-2754f8831f1d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151927 Mar 08 04:29:54.394791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 748/1462] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:54 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:55.411851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0b4dd417-181d-40bf-940b-5d1e0172e635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:55.412504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0b4dd417-181d-40bf-940b-5d1e0172e635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:55.419174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b4dd417-181d-40bf-940b-5d1e0172e635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:55.419613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b4dd417-181d-40bf-940b-5d1e0172e635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:55.420367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b4dd417-181d-40bf-940b-5d1e0172e635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:55.420796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b4dd417-181d-40bf-940b-5d1e0172e635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:55.553498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0b4dd417-181d-40bf-940b-5d1e0172e635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:55.562162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0b4dd417-181d-40bf-940b-5d1e0172e635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.154079 Mar 08 04:29:55.563009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 749/1463] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:55 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:56.580493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0db29e85-550d-47f3-ab56-ac9ff5b535e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:56.581181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0db29e85-550d-47f3-ab56-ac9ff5b535e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:56.587349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0db29e85-550d-47f3-ab56-ac9ff5b535e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:56.587791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0db29e85-550d-47f3-ab56-ac9ff5b535e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:56.588555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0db29e85-550d-47f3-ab56-ac9ff5b535e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:56.588986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0db29e85-550d-47f3-ab56-ac9ff5b535e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:56.719161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0db29e85-550d-47f3-ab56-ac9ff5b535e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:56.726261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0db29e85-550d-47f3-ab56-ac9ff5b535e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.149680 Mar 08 04:29:56.726819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 750/1464] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:56 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:57.743540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6e682d49-ce7b-47d9-ba6e-2dbf42b25ef9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:57.744221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6e682d49-ce7b-47d9-ba6e-2dbf42b25ef9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:57.751174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e682d49-ce7b-47d9-ba6e-2dbf42b25ef9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:57.751612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e682d49-ce7b-47d9-ba6e-2dbf42b25ef9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:57.752383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e682d49-ce7b-47d9-ba6e-2dbf42b25ef9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:57.752818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6e682d49-ce7b-47d9-ba6e-2dbf42b25ef9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:57.883288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6e682d49-ce7b-47d9-ba6e-2dbf42b25ef9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:57.890903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6e682d49-ce7b-47d9-ba6e-2dbf42b25ef9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151231 Mar 08 04:29:57.891463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 751/1465] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:57 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:29:58.907608 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5d4c31aa-ced6-40a1-9ce0-416b319dedc8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:58.908241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5d4c31aa-ced6-40a1-9ce0-416b319dedc8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:58.914516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d4c31aa-ced6-40a1-9ce0-416b319dedc8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:58.914958 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d4c31aa-ced6-40a1-9ce0-416b319dedc8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:58.915721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d4c31aa-ced6-40a1-9ce0-416b319dedc8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:58.916154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d4c31aa-ced6-40a1-9ce0-416b319dedc8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:59.028697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lazy-loading 'services' on Instance uuid 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:29:59.056861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5d4c31aa-ced6-40a1-9ce0-416b319dedc8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:29:59.064882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5d4c31aa-ced6-40a1-9ce0-416b319dedc8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.161094 Mar 08 04:29:59.065526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 752/1466] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:29:58 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:29:59.070916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d92c1b1c-f4a1-4f40-8623-6a906102a569 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:29:59.071893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d92c1b1c-f4a1-4f40-8623-6a906102a569 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:29:59.078119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d92c1b1c-f4a1-4f40-8623-6a906102a569 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:59.078632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d92c1b1c-f4a1-4f40-8623-6a906102a569 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:59.079482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d92c1b1c-f4a1-4f40-8623-6a906102a569 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:29:59.079986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d92c1b1c-f4a1-4f40-8623-6a906102a569 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:29:59.108468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d92c1b1c-f4a1-4f40-8623-6a906102a569 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041844 Mar 08 04:29:59.109026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 753/1467] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:29:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:30:00.081521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a0d6d625-1827-4801-b03a-95760e2860ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:00.082188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a0d6d625-1827-4801-b03a-95760e2860ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:00.088421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d6d625-1827-4801-b03a-95760e2860ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:00.088873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d6d625-1827-4801-b03a-95760e2860ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:00.089644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d6d625-1827-4801-b03a-95760e2860ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:00.090763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d6d625-1827-4801-b03a-95760e2860ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:00.224333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a0d6d625-1827-4801-b03a-95760e2860ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:30:00.231894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a0d6d625-1827-4801-b03a-95760e2860ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.154270 Mar 08 04:30:00.232562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 754/1468] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:30:00 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:30:00.237130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b396dca2-5204-4e4f-a139-d4b2e5ef2a6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:00.238082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b396dca2-5204-4e4f-a139-d4b2e5ef2a6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:00.243566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b396dca2-5204-4e4f-a139-d4b2e5ef2a6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:00.244019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b396dca2-5204-4e4f-a139-d4b2e5ef2a6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:00.244795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b396dca2-5204-4e4f-a139-d4b2e5ef2a6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:00.245236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b396dca2-5204-4e4f-a139-d4b2e5ef2a6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:00.276568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b396dca2-5204-4e4f-a139-d4b2e5ef2a6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042978 Mar 08 04:30:00.277349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 755/1469] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:30:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:30:01.249288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e65b9d07-5895-422d-a918-88a9199ba105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:01.249948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e65b9d07-5895-422d-a918-88a9199ba105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:01.256060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e65b9d07-5895-422d-a918-88a9199ba105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:01.256503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e65b9d07-5895-422d-a918-88a9199ba105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:01.257278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e65b9d07-5895-422d-a918-88a9199ba105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:01.257710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e65b9d07-5895-422d-a918-88a9199ba105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:01.395871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e65b9d07-5895-422d-a918-88a9199ba105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:30:01.403499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e65b9d07-5895-422d-a918-88a9199ba105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.158584 Mar 08 04:30:01.404059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 756/1470] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:30:01 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:30:01.408471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d326a3be-e93d-40bf-88e6-a3d1c38653c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:01.409351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d326a3be-e93d-40bf-88e6-a3d1c38653c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:01.414638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d326a3be-e93d-40bf-88e6-a3d1c38653c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:01.415095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d326a3be-e93d-40bf-88e6-a3d1c38653c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:01.415828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d326a3be-e93d-40bf-88e6-a3d1c38653c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:01.416296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d326a3be-e93d-40bf-88e6-a3d1c38653c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:01.445679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d326a3be-e93d-40bf-88e6-a3d1c38653c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040629 Mar 08 04:30:01.446227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 757/1471] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:30:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:30:02.420658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e008ce3b-a8cf-42d3-9e2e-3e2d0e4d3107 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:02.421348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e008ce3b-a8cf-42d3-9e2e-3e2d0e4d3107 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:02.427476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e008ce3b-a8cf-42d3-9e2e-3e2d0e4d3107 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:02.427917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e008ce3b-a8cf-42d3-9e2e-3e2d0e4d3107 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:02.428678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e008ce3b-a8cf-42d3-9e2e-3e2d0e4d3107 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:02.429112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e008ce3b-a8cf-42d3-9e2e-3e2d0e4d3107 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:02.562320 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e008ce3b-a8cf-42d3-9e2e-3e2d0e4d3107 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:30:02.569446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e008ce3b-a8cf-42d3-9e2e-3e2d0e4d3107 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.152718 Mar 08 04:30:02.570059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 758/1472] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:30:02 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:30:02.575078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-da8ed2bb-9f18-4991-b4c9-c1eb18d5792f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:02.576085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-da8ed2bb-9f18-4991-b4c9-c1eb18d5792f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:02.581406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da8ed2bb-9f18-4991-b4c9-c1eb18d5792f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:02.581883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da8ed2bb-9f18-4991-b4c9-c1eb18d5792f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:02.582631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da8ed2bb-9f18-4991-b4c9-c1eb18d5792f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:02.583062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da8ed2bb-9f18-4991-b4c9-c1eb18d5792f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:02.609572 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-da8ed2bb-9f18-4991-b4c9-c1eb18d5792f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038588 Mar 08 04:30:02.610146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 759/1473] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:30:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:30:03.587384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-788b67d3-ef05-433a-90be-2ae6eaf2f01f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:03.588031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-788b67d3-ef05-433a-90be-2ae6eaf2f01f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:03.594753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-788b67d3-ef05-433a-90be-2ae6eaf2f01f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:03.595200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-788b67d3-ef05-433a-90be-2ae6eaf2f01f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:03.595959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-788b67d3-ef05-433a-90be-2ae6eaf2f01f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:03.596390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-788b67d3-ef05-433a-90be-2ae6eaf2f01f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:03.728517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-788b67d3-ef05-433a-90be-2ae6eaf2f01f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:30:03.735721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-788b67d3-ef05-433a-90be-2ae6eaf2f01f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.152213 Mar 08 04:30:03.736277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 760/1474] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:30:03 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:30:03.740665 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-82fe1065-2394-4eeb-9e3a-61cc2c2d2bf4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:03.741542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-82fe1065-2394-4eeb-9e3a-61cc2c2d2bf4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:03.747040 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82fe1065-2394-4eeb-9e3a-61cc2c2d2bf4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:03.747484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82fe1065-2394-4eeb-9e3a-61cc2c2d2bf4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:03.748260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82fe1065-2394-4eeb-9e3a-61cc2c2d2bf4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:03.748673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82fe1065-2394-4eeb-9e3a-61cc2c2d2bf4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:03.776952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-82fe1065-2394-4eeb-9e3a-61cc2c2d2bf4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039695 Mar 08 04:30:03.778181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 761/1475] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:30:03 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:30:04.753009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b32dd423-3949-4eb6-a4d7-9ad091ee4a22 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:04.753706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b32dd423-3949-4eb6-a4d7-9ad091ee4a22 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:04.759950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b32dd423-3949-4eb6-a4d7-9ad091ee4a22 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:04.760397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b32dd423-3949-4eb6-a4d7-9ad091ee4a22 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:04.761192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b32dd423-3949-4eb6-a4d7-9ad091ee4a22 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:04.761627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b32dd423-3949-4eb6-a4d7-9ad091ee4a22 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:04.894766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b32dd423-3949-4eb6-a4d7-9ad091ee4a22 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:30:04.902251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b32dd423-3949-4eb6-a4d7-9ad091ee4a22 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153089 Mar 08 04:30:04.902839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 762/1476] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:30:04 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:30:04.907443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dd6ddad3-ac98-4b42-98b6-55e833587223 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:04.908333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dd6ddad3-ac98-4b42-98b6-55e833587223 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:04.913915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd6ddad3-ac98-4b42-98b6-55e833587223 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:04.914383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd6ddad3-ac98-4b42-98b6-55e833587223 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:04.915168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd6ddad3-ac98-4b42-98b6-55e833587223 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:04.915630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd6ddad3-ac98-4b42-98b6-55e833587223 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:04.943978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dd6ddad3-ac98-4b42-98b6-55e833587223 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040070 Mar 08 04:30:04.944518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 763/1477] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:30:04 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:30:05.920208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a2893624-b1a2-456b-9db3-2d1d95e666d3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:05.920842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a2893624-b1a2-456b-9db3-2d1d95e666d3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:05.927108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2893624-b1a2-456b-9db3-2d1d95e666d3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:05.927564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2893624-b1a2-456b-9db3-2d1d95e666d3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:05.928328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2893624-b1a2-456b-9db3-2d1d95e666d3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:05.928764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a2893624-b1a2-456b-9db3-2d1d95e666d3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:06.059920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a2893624-b1a2-456b-9db3-2d1d95e666d3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:30:06.067222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a2893624-b1a2-456b-9db3-2d1d95e666d3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151449 Mar 08 04:30:06.067789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 764/1478] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:30:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:30:06.133853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c53064bf-da31-4066-8632-30625ed9d978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:06.134778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c53064bf-da31-4066-8632-30625ed9d978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:06.142768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c53064bf-da31-4066-8632-30625ed9d978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:06.143235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c53064bf-da31-4066-8632-30625ed9d978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:06.144011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c53064bf-da31-4066-8632-30625ed9d978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:06.144452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c53064bf-da31-4066-8632-30625ed9d978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:06.173215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c53064bf-da31-4066-8632-30625ed9d978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104436 Mar 08 04:30:06.173790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 765/1479] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:30:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:30:06.333594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:30:06.334117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:30:06.340445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:06.341092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:06.341900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:30:06.342348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:30:20.307938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:30:20.309080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:30:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 (ip 10.222.0.30) !!! Mar 08 04:30:39.934173 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:30:39.934689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:30:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 (ip 10.222.0.30) !!! Mar 08 04:30:58.683698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:30:58.684275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:30:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 (ip 10.222.0.30) !!! Mar 08 04:31:06.405637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [23955917-fceb-49d9-a999-2863c6de4c4b] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 04:31:06.515560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lazy-loading 'services' on Instance uuid 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:31:07.412513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [23955917-fceb-49d9-a999-2863c6de4c4b] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 45826. Mar 08 04:31:07.415948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1098b492-6db2-4028-9f1d-42e06010ef3b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75" status: 202 len: 0 microversion: 2.1 time: 121.147251 Mar 08 04:31:07.416534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 715/1480] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:29:06 2022] DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 => generated 0 bytes in 121148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:31:07.487887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-13f5f719-07ba-4270-a964-7a6515c0a9e6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:31:07.488587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-13f5f719-07ba-4270-a964-7a6515c0a9e6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:31:07.494683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13f5f719-07ba-4270-a964-7a6515c0a9e6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:07.495071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13f5f719-07ba-4270-a964-7a6515c0a9e6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:07.495839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13f5f719-07ba-4270-a964-7a6515c0a9e6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:07.496273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13f5f719-07ba-4270-a964-7a6515c0a9e6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:07.632347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-13f5f719-07ba-4270-a964-7a6515c0a9e6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:31:07.640078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-13f5f719-07ba-4270-a964-7a6515c0a9e6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.222340 Mar 08 04:31:07.640634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 716/1481] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:31:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:31:07.645138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2edc6421-be26-4f4d-b1cc-95fd04036a03 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:31:07.646121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2edc6421-be26-4f4d-b1cc-95fd04036a03 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:31:07.651647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2edc6421-be26-4f4d-b1cc-95fd04036a03 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:07.652093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2edc6421-be26-4f4d-b1cc-95fd04036a03 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:07.652845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2edc6421-be26-4f4d-b1cc-95fd04036a03 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:07.653278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2edc6421-be26-4f4d-b1cc-95fd04036a03 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:07.682420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2edc6421-be26-4f4d-b1cc-95fd04036a03 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040793 Mar 08 04:31:07.682978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 717/1482] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:31:07 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:31:07.688047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:31:07.688535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:31:07.693789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:07.694249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:07.695011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:07.695451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:59.287383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d865cfa4-ce6d-4db8-b7e4-b24ec3e77449) Mar 08 04:31:59.287950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d865cfa4-ce6d-4db8-b7e4-b24ec3e77449) {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:31:59.288751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-76ed3aa8-d14b-44a3-b83c-2ec64ffb6ac7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75" status: 400 len: 269 microversion: 2.1 time: 112.959097 Mar 08 04:31:59.289305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 766/1483] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:30:06 2022] DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 => generated 269 bytes in 112960 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 04:31:59.295067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-45437310-afdb-48ee-abf4-7d087700a905 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:31:59.295679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-45437310-afdb-48ee-abf4-7d087700a905 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:31:59.303064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45437310-afdb-48ee-abf4-7d087700a905 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:59.303511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45437310-afdb-48ee-abf4-7d087700a905 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:59.304268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45437310-afdb-48ee-abf4-7d087700a905 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:59.304708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45437310-afdb-48ee-abf4-7d087700a905 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:59.420805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lazy-loading 'services' on Instance uuid 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:31:59.447583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-45437310-afdb-48ee-abf4-7d087700a905 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:31:59.454972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-45437310-afdb-48ee-abf4-7d087700a905 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.164443 Mar 08 04:31:59.455527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 767/1484] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:31:59 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:31:59.460052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1eb91d65-4f3a-4487-b0aa-fd97456cd4c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:31:59.460991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1eb91d65-4f3a-4487-b0aa-fd97456cd4c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:31:59.466434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1eb91d65-4f3a-4487-b0aa-fd97456cd4c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:59.466882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1eb91d65-4f3a-4487-b0aa-fd97456cd4c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:59.467642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1eb91d65-4f3a-4487-b0aa-fd97456cd4c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:31:59.468582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1eb91d65-4f3a-4487-b0aa-fd97456cd4c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:31:59.496276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1eb91d65-4f3a-4487-b0aa-fd97456cd4c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039786 Mar 08 04:31:59.496817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 768/1485] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:31:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:32:00.472656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f32246b0-65c2-49ca-b246-601625427e14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:00.473344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f32246b0-65c2-49ca-b246-601625427e14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:00.479531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f32246b0-65c2-49ca-b246-601625427e14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:00.479989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f32246b0-65c2-49ca-b246-601625427e14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:00.480754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f32246b0-65c2-49ca-b246-601625427e14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:00.481193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f32246b0-65c2-49ca-b246-601625427e14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:00.614991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f32246b0-65c2-49ca-b246-601625427e14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:32:00.622156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f32246b0-65c2-49ca-b246-601625427e14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153547 Mar 08 04:32:00.622717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 769/1486] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:32:00 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:32:00.627989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-722c22e8-2c5e-42c1-aaa2-be62eea816d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:00.628873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-722c22e8-2c5e-42c1-aaa2-be62eea816d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:00.634198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-722c22e8-2c5e-42c1-aaa2-be62eea816d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:00.634639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-722c22e8-2c5e-42c1-aaa2-be62eea816d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:00.635392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-722c22e8-2c5e-42c1-aaa2-be62eea816d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:00.635823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-722c22e8-2c5e-42c1-aaa2-be62eea816d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:00.662819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-722c22e8-2c5e-42c1-aaa2-be62eea816d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039147 Mar 08 04:32:00.663346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 770/1487] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:32:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:32:01.639222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-eb94d58e-39ae-48dc-83a3-43a4b1d0b546 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:01.640662 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-eb94d58e-39ae-48dc-83a3-43a4b1d0b546 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:01.646741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb94d58e-39ae-48dc-83a3-43a4b1d0b546 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:01.647198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb94d58e-39ae-48dc-83a3-43a4b1d0b546 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:01.647969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb94d58e-39ae-48dc-83a3-43a4b1d0b546 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:01.648412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb94d58e-39ae-48dc-83a3-43a4b1d0b546 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:01.779051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-eb94d58e-39ae-48dc-83a3-43a4b1d0b546 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:32:01.786338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-eb94d58e-39ae-48dc-83a3-43a4b1d0b546 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151044 Mar 08 04:32:01.786907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 771/1488] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:32:01 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:32:01.791695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-064cd3ca-47a3-413f-bd5d-6fd769551d17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:01.792604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-064cd3ca-47a3-413f-bd5d-6fd769551d17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:01.798539 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-064cd3ca-47a3-413f-bd5d-6fd769551d17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:01.798993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-064cd3ca-47a3-413f-bd5d-6fd769551d17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:01.799767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-064cd3ca-47a3-413f-bd5d-6fd769551d17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:01.800208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-064cd3ca-47a3-413f-bd5d-6fd769551d17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:01.830369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-064cd3ca-47a3-413f-bd5d-6fd769551d17 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042366 Mar 08 04:32:01.830933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 772/1489] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:32:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:32:02.803438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7b319dac-755f-4658-a817-ec45f45bb768 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:02.804121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7b319dac-755f-4658-a817-ec45f45bb768 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:02.810441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b319dac-755f-4658-a817-ec45f45bb768 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:02.810890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b319dac-755f-4658-a817-ec45f45bb768 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:02.811708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b319dac-755f-4658-a817-ec45f45bb768 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:02.812293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b319dac-755f-4658-a817-ec45f45bb768 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:02.941561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7b319dac-755f-4658-a817-ec45f45bb768 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:32:02.948791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7b319dac-755f-4658-a817-ec45f45bb768 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.149177 Mar 08 04:32:02.949356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 773/1490] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:32:02 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:32:02.954714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-21146c7a-491b-4bd4-ad8b-4be633abddc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:02.955610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-21146c7a-491b-4bd4-ad8b-4be633abddc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:02.960982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21146c7a-491b-4bd4-ad8b-4be633abddc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:02.961437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21146c7a-491b-4bd4-ad8b-4be633abddc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:02.962237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21146c7a-491b-4bd4-ad8b-4be633abddc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:02.962681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-21146c7a-491b-4bd4-ad8b-4be633abddc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:02.990224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-21146c7a-491b-4bd4-ad8b-4be633abddc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039873 Mar 08 04:32:02.990760 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 774/1491] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:32:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:32:03.966181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2c2a5d9c-f421-4c47-97df-8e0560294728 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:03.966783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2c2a5d9c-f421-4c47-97df-8e0560294728 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:03.973420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c2a5d9c-f421-4c47-97df-8e0560294728 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:03.973904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c2a5d9c-f421-4c47-97df-8e0560294728 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:03.974666 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c2a5d9c-f421-4c47-97df-8e0560294728 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:03.975094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c2a5d9c-f421-4c47-97df-8e0560294728 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:04.109235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2c2a5d9c-f421-4c47-97df-8e0560294728 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:32:04.116453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2c2a5d9c-f421-4c47-97df-8e0560294728 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.154269 Mar 08 04:32:04.117006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 775/1492] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:32:03 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:32:04.121547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ae653ac8-8d04-46f3-8daf-6a3b2b07924a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:04.122540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ae653ac8-8d04-46f3-8daf-6a3b2b07924a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:04.128098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae653ac8-8d04-46f3-8daf-6a3b2b07924a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:04.128542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae653ac8-8d04-46f3-8daf-6a3b2b07924a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:04.129297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae653ac8-8d04-46f3-8daf-6a3b2b07924a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:04.129752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae653ac8-8d04-46f3-8daf-6a3b2b07924a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:04.158073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ae653ac8-8d04-46f3-8daf-6a3b2b07924a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040070 Mar 08 04:32:04.158609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 776/1493] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:32:04 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:32:05.134094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-452e29f0-e29d-4d45-b6b4-96517816b6af tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:05.134685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-452e29f0-e29d-4d45-b6b4-96517816b6af tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:05.142112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-452e29f0-e29d-4d45-b6b4-96517816b6af tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:05.142562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-452e29f0-e29d-4d45-b6b4-96517816b6af tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:05.143361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-452e29f0-e29d-4d45-b6b4-96517816b6af tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:05.143795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-452e29f0-e29d-4d45-b6b4-96517816b6af tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:05.274735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-452e29f0-e29d-4d45-b6b4-96517816b6af tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:32:05.282292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-452e29f0-e29d-4d45-b6b4-96517816b6af tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.152202 Mar 08 04:32:05.282854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 777/1494] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:32:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:32:05.287303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d80fad9f-cbdf-413e-9e52-e93ee90d28ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:05.288191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d80fad9f-cbdf-413e-9e52-e93ee90d28ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:05.293569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d80fad9f-cbdf-413e-9e52-e93ee90d28ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:05.294064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d80fad9f-cbdf-413e-9e52-e93ee90d28ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:05.294824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d80fad9f-cbdf-413e-9e52-e93ee90d28ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:05.295263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d80fad9f-cbdf-413e-9e52-e93ee90d28ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:05.323849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d80fad9f-cbdf-413e-9e52-e93ee90d28ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039987 Mar 08 04:32:05.324394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 778/1495] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:32:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:32:06.298252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1ed6c3e7-fc9f-4030-b0a9-bbffb403d4f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:06.298917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1ed6c3e7-fc9f-4030-b0a9-bbffb403d4f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:06.305085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ed6c3e7-fc9f-4030-b0a9-bbffb403d4f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:06.305533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ed6c3e7-fc9f-4030-b0a9-bbffb403d4f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:06.306331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ed6c3e7-fc9f-4030-b0a9-bbffb403d4f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:06.306777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ed6c3e7-fc9f-4030-b0a9-bbffb403d4f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:06.445042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1ed6c3e7-fc9f-4030-b0a9-bbffb403d4f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:32:06.453455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1ed6c3e7-fc9f-4030-b0a9-bbffb403d4f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.158892 Mar 08 04:32:06.454061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 779/1496] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:32:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:32:06.459190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5ddfbfd3-8ffe-45ba-95a4-25c9870d0e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:06.460099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5ddfbfd3-8ffe-45ba-95a4-25c9870d0e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:06.465634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ddfbfd3-8ffe-45ba-95a4-25c9870d0e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:06.466103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ddfbfd3-8ffe-45ba-95a4-25c9870d0e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:06.466862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ddfbfd3-8ffe-45ba-95a4-25c9870d0e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:06.467373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ddfbfd3-8ffe-45ba-95a4-25c9870d0e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:06.497396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5ddfbfd3-8ffe-45ba-95a4-25c9870d0e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Mar 08 04:32:06.497916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 780/1497] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:32:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:32:06.503067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:32:06.503552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:32:06.509149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:06.509593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:06.510379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:32:06.510810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:32:25.139024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:32:25.139586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:32:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 (ip 10.222.0.30) !!! Mar 08 04:32:37.126122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:32:37.126730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:32:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 (ip 10.222.0.30) !!! Mar 08 04:33:06.696340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b74893f5-9488-4de1-ac50-b19db22b89d8) Mar 08 04:33:06.696963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b74893f5-9488-4de1-ac50-b19db22b89d8) {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:33:06.697823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-baf89397-c6a9-4b6f-ae16-f92d4afa1672 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75" status: 400 len: 269 microversion: 2.1 time: 119.013921 Mar 08 04:33:06.698718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 718/1498] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:31:07 2022] DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 => generated 269 bytes in 119015 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:33:06.704097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6956af4d-f132-428f-a6c5-e31ff1e10ad0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:06.704722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6956af4d-f132-428f-a6c5-e31ff1e10ad0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:06.710506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6956af4d-f132-428f-a6c5-e31ff1e10ad0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:06.710954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6956af4d-f132-428f-a6c5-e31ff1e10ad0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:06.711726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6956af4d-f132-428f-a6c5-e31ff1e10ad0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:06.712161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6956af4d-f132-428f-a6c5-e31ff1e10ad0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:06.829359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lazy-loading 'services' on Instance uuid 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:33:06.854592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6956af4d-f132-428f-a6c5-e31ff1e10ad0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:06.861907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6956af4d-f132-428f-a6c5-e31ff1e10ad0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.162240 Mar 08 04:33:06.862452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 719/1499] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:06.867385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-eeca803e-495b-48bd-98e6-cf7b80b6d5df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:06.868547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eeca803e-495b-48bd-98e6-cf7b80b6d5df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:06.875252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eeca803e-495b-48bd-98e6-cf7b80b6d5df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:06.875799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eeca803e-495b-48bd-98e6-cf7b80b6d5df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:06.876634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eeca803e-495b-48bd-98e6-cf7b80b6d5df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:06.877142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eeca803e-495b-48bd-98e6-cf7b80b6d5df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:06.906114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eeca803e-495b-48bd-98e6-cf7b80b6d5df tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 Mar 08 04:33:06.909898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 720/1500] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:06.911209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:06.911703 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:06.917632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:06.918106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:06.918873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:06.919649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:06.941883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-44478947-f1f6-4c9e-b185-2f50fad1ee58) Mar 08 04:33:06.942492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-44478947-f1f6-4c9e-b185-2f50fad1ee58) {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:33:06.943323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a4ba0f15-e771-409d-8111-e04463bf1f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75" status: 400 len: 269 microversion: 2.1 time: 60.444524 Mar 08 04:33:06.944046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 781/1501] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:32:06 2022] DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 => generated 269 bytes in 60446 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:33:06.994985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lazy-loading 'services' on Instance uuid 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:33:07.049898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdd1de29-cbf0-4055-becd-609796ddb90e) Mar 08 04:33:07.050505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdd1de29-cbf0-4055-becd-609796ddb90e) {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:33:07.051335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-836a04c7-cdba-4c69-89c0-7d6cb9b93b82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75" status: 400 len: 269 microversion: 2.1 time: 0.143801 Mar 08 04:33:07.051900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 721/1502] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:33:06 2022] DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef/os-volume_attachments/00a2f503-8d11-475a-b09f-35f61659ba75 => generated 269 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:33:07.880168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7076c8b3-da9b-4c95-9e09-33aacb70d5be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:07.880782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7076c8b3-da9b-4c95-9e09-33aacb70d5be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:07.886732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7076c8b3-da9b-4c95-9e09-33aacb70d5be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:07.887181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7076c8b3-da9b-4c95-9e09-33aacb70d5be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:07.888055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7076c8b3-da9b-4c95-9e09-33aacb70d5be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:07.888495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7076c8b3-da9b-4c95-9e09-33aacb70d5be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:07.917581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5c5bb8e8-cf5c-4e3b-97b3-e98e7c7530a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:07.918515 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5c5bb8e8-cf5c-4e3b-97b3-e98e7c7530a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:07.925806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c5bb8e8-cf5c-4e3b-97b3-e98e7c7530a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:07.926256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c5bb8e8-cf5c-4e3b-97b3-e98e7c7530a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:07.927022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c5bb8e8-cf5c-4e3b-97b3-e98e7c7530a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:07.927467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c5bb8e8-cf5c-4e3b-97b3-e98e7c7530a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:07.956057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5c5bb8e8-cf5c-4e3b-97b3-e98e7c7530a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042909 Mar 08 04:33:07.956609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 722/1503] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:07 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:33:08.020681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7076c8b3-da9b-4c95-9e09-33aacb70d5be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:08.028963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7076c8b3-da9b-4c95-9e09-33aacb70d5be tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153112 Mar 08 04:33:08.029546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 782/1504] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:33:08.967841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c9e04f7c-bb6a-4302-b1ee-e153ba9d8bb2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:08.968745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c9e04f7c-bb6a-4302-b1ee-e153ba9d8bb2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:08.974935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9e04f7c-bb6a-4302-b1ee-e153ba9d8bb2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:08.975379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9e04f7c-bb6a-4302-b1ee-e153ba9d8bb2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:08.976133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9e04f7c-bb6a-4302-b1ee-e153ba9d8bb2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:08.976563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9e04f7c-bb6a-4302-b1ee-e153ba9d8bb2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:09.004312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c9e04f7c-bb6a-4302-b1ee-e153ba9d8bb2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040696 Mar 08 04:33:09.004840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 723/1505] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:08 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:09.045611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f4abe687-4f6a-46a7-8fb2-1ceb0d3c2f5d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:09.046246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f4abe687-4f6a-46a7-8fb2-1ceb0d3c2f5d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:09.052486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4abe687-4f6a-46a7-8fb2-1ceb0d3c2f5d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:09.052935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4abe687-4f6a-46a7-8fb2-1ceb0d3c2f5d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:09.053722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4abe687-4f6a-46a7-8fb2-1ceb0d3c2f5d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:09.054162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4abe687-4f6a-46a7-8fb2-1ceb0d3c2f5d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:09.183968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f4abe687-4f6a-46a7-8fb2-1ceb0d3c2f5d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:09.191807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f4abe687-4f6a-46a7-8fb2-1ceb0d3c2f5d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.150259 Mar 08 04:33:09.192391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 783/1506] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:10.016687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0c311567-ead7-4cb5-9c7c-ce0945606efa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:10.017607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0c311567-ead7-4cb5-9c7c-ce0945606efa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:10.023801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c311567-ead7-4cb5-9c7c-ce0945606efa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:10.024246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c311567-ead7-4cb5-9c7c-ce0945606efa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:10.025000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c311567-ead7-4cb5-9c7c-ce0945606efa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:10.025432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c311567-ead7-4cb5-9c7c-ce0945606efa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:10.055304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0c311567-ead7-4cb5-9c7c-ce0945606efa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043590 Mar 08 04:33:10.055852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 724/1507] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:10 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:10.208755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-efeb38e9-a7cf-45ed-a16d-54b148eb81f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:10.209402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-efeb38e9-a7cf-45ed-a16d-54b148eb81f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:10.216612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efeb38e9-a7cf-45ed-a16d-54b148eb81f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:10.217061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efeb38e9-a7cf-45ed-a16d-54b148eb81f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:10.218067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efeb38e9-a7cf-45ed-a16d-54b148eb81f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:10.218659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-efeb38e9-a7cf-45ed-a16d-54b148eb81f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:10.354397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-efeb38e9-a7cf-45ed-a16d-54b148eb81f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:10.362183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-efeb38e9-a7cf-45ed-a16d-54b148eb81f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.157304 Mar 08 04:33:10.362915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 784/1508] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:10 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:11.066178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8653c684-d997-4984-8ec5-86907be4216f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:11.067015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8653c684-d997-4984-8ec5-86907be4216f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:11.073430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8653c684-d997-4984-8ec5-86907be4216f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:11.073939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8653c684-d997-4984-8ec5-86907be4216f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:11.074709 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8653c684-d997-4984-8ec5-86907be4216f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:11.075170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8653c684-d997-4984-8ec5-86907be4216f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:11.103303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8653c684-d997-4984-8ec5-86907be4216f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041179 Mar 08 04:33:11.103850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 725/1509] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:11.379284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c0b972d7-b257-4635-9618-f69d77eadb1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:11.379834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c0b972d7-b257-4635-9618-f69d77eadb1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:11.386041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0b972d7-b257-4635-9618-f69d77eadb1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:11.386483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0b972d7-b257-4635-9618-f69d77eadb1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:11.387236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0b972d7-b257-4635-9618-f69d77eadb1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:11.388325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c0b972d7-b257-4635-9618-f69d77eadb1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:11.521100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c0b972d7-b257-4635-9618-f69d77eadb1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:11.529406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c0b972d7-b257-4635-9618-f69d77eadb1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153949 Mar 08 04:33:11.530060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 785/1510] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:11 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:12.115440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-54e4fa6d-e708-4b73-8f03-84011be5943a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:12.116275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-54e4fa6d-e708-4b73-8f03-84011be5943a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:12.122412 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54e4fa6d-e708-4b73-8f03-84011be5943a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:12.123505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54e4fa6d-e708-4b73-8f03-84011be5943a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:12.124345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54e4fa6d-e708-4b73-8f03-84011be5943a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:12.124777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54e4fa6d-e708-4b73-8f03-84011be5943a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:12.152769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-54e4fa6d-e708-4b73-8f03-84011be5943a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041328 Mar 08 04:33:12.153308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 726/1511] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:12.546290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9f283182-9928-4544-97a8-f6f7f7a06be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:12.546896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9f283182-9928-4544-97a8-f6f7f7a06be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:12.553307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f283182-9928-4544-97a8-f6f7f7a06be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:12.553780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f283182-9928-4544-97a8-f6f7f7a06be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:12.554560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f283182-9928-4544-97a8-f6f7f7a06be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:12.554997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f283182-9928-4544-97a8-f6f7f7a06be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:12.688148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9f283182-9928-4544-97a8-f6f7f7a06be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:12.695321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9f283182-9928-4544-97a8-f6f7f7a06be6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153170 Mar 08 04:33:12.695878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 786/1512] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:12 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:13.164332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-20902d68-b754-4e22-aeff-e2cdae7893c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:13.165238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-20902d68-b754-4e22-aeff-e2cdae7893c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:13.172747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20902d68-b754-4e22-aeff-e2cdae7893c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:13.173393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20902d68-b754-4e22-aeff-e2cdae7893c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:13.174477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20902d68-b754-4e22-aeff-e2cdae7893c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:13.175115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20902d68-b754-4e22-aeff-e2cdae7893c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:13.204457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-20902d68-b754-4e22-aeff-e2cdae7893c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Mar 08 04:33:13.204994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 727/1513] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:13 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:13.713818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c17f8bcd-48dc-45a1-bfc8-8964ed6f3846 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:13.714435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c17f8bcd-48dc-45a1-bfc8-8964ed6f3846 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:13.721433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c17f8bcd-48dc-45a1-bfc8-8964ed6f3846 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:13.721907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c17f8bcd-48dc-45a1-bfc8-8964ed6f3846 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:13.722674 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c17f8bcd-48dc-45a1-bfc8-8964ed6f3846 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:13.723108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c17f8bcd-48dc-45a1-bfc8-8964ed6f3846 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:13.855454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c17f8bcd-48dc-45a1-bfc8-8964ed6f3846 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:13.863419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c17f8bcd-48dc-45a1-bfc8-8964ed6f3846 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153541 Mar 08 04:33:13.863979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 787/1514] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:13 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:14.216063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5a36cc76-2ea7-4c7a-829a-5a123db14481 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:14.217512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5a36cc76-2ea7-4c7a-829a-5a123db14481 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:14.223797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a36cc76-2ea7-4c7a-829a-5a123db14481 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:14.224244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a36cc76-2ea7-4c7a-829a-5a123db14481 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:14.225005 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a36cc76-2ea7-4c7a-829a-5a123db14481 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:14.225445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a36cc76-2ea7-4c7a-829a-5a123db14481 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:14.253990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5a36cc76-2ea7-4c7a-829a-5a123db14481 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041861 Mar 08 04:33:14.254540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 728/1515] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:14.880219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b0bb0054-1904-4f65-a67d-905a2733e54d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:14.880831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b0bb0054-1904-4f65-a67d-905a2733e54d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:14.887137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0bb0054-1904-4f65-a67d-905a2733e54d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:14.887586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0bb0054-1904-4f65-a67d-905a2733e54d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:14.888961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0bb0054-1904-4f65-a67d-905a2733e54d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:14.889444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0bb0054-1904-4f65-a67d-905a2733e54d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:15.030544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b0bb0054-1904-4f65-a67d-905a2733e54d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:15.037762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b0bb0054-1904-4f65-a67d-905a2733e54d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.161429 Mar 08 04:33:15.038328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 788/1516] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:14 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:15.265809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b5225035-b7a3-48d1-9074-76fdcd5cf86a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:15.266750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b5225035-b7a3-48d1-9074-76fdcd5cf86a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:15.272920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5225035-b7a3-48d1-9074-76fdcd5cf86a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:15.273370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5225035-b7a3-48d1-9074-76fdcd5cf86a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:15.274150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5225035-b7a3-48d1-9074-76fdcd5cf86a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:15.274588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5225035-b7a3-48d1-9074-76fdcd5cf86a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:15.302787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b5225035-b7a3-48d1-9074-76fdcd5cf86a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041131 Mar 08 04:33:15.303319 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 729/1517] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:15 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:16.054722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8aeedf89-6e45-4332-bbc6-4ca7ac803795 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:16.055327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8aeedf89-6e45-4332-bbc6-4ca7ac803795 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:16.061848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8aeedf89-6e45-4332-bbc6-4ca7ac803795 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:16.062304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8aeedf89-6e45-4332-bbc6-4ca7ac803795 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:16.063581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8aeedf89-6e45-4332-bbc6-4ca7ac803795 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:16.063781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8aeedf89-6e45-4332-bbc6-4ca7ac803795 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:16.194244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8aeedf89-6e45-4332-bbc6-4ca7ac803795 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:16.202173 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8aeedf89-6e45-4332-bbc6-4ca7ac803795 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151322 Mar 08 04:33:16.202735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 789/1518] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:16.314578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6a1e9feb-1a60-459e-a523-f165f2a16d00 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:16.315466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6a1e9feb-1a60-459e-a523-f165f2a16d00 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:16.321686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a1e9feb-1a60-459e-a523-f165f2a16d00 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:16.322145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a1e9feb-1a60-459e-a523-f165f2a16d00 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:16.322901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a1e9feb-1a60-459e-a523-f165f2a16d00 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:16.323329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a1e9feb-1a60-459e-a523-f165f2a16d00 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:16.351410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6a1e9feb-1a60-459e-a523-f165f2a16d00 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041446 Mar 08 04:33:16.351937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 730/1519] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:16 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:17.219599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-380b44b6-9add-470e-adcc-854d575a8978 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:17.220207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-380b44b6-9add-470e-adcc-854d575a8978 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:17.226518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-380b44b6-9add-470e-adcc-854d575a8978 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:17.226964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-380b44b6-9add-470e-adcc-854d575a8978 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:17.227764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-380b44b6-9add-470e-adcc-854d575a8978 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:17.228201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-380b44b6-9add-470e-adcc-854d575a8978 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:17.363397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-380b44b6-9add-470e-adcc-854d575a8978 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:17.363631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ac99c146-3070-4575-9ec3-da168c19862c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:17.364545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ac99c146-3070-4575-9ec3-da168c19862c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:17.370637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac99c146-3070-4575-9ec3-da168c19862c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:17.370775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-380b44b6-9add-470e-adcc-854d575a8978 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.155588 Mar 08 04:33:17.371141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac99c146-3070-4575-9ec3-da168c19862c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:17.371333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 790/1520] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:17 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:17.371908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac99c146-3070-4575-9ec3-da168c19862c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:17.372338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac99c146-3070-4575-9ec3-da168c19862c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:17.400287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ac99c146-3070-4575-9ec3-da168c19862c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040854 Mar 08 04:33:17.400819 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 731/1521] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:33:18.387962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fd1278d5-50f3-48c8-b871-44cc6616a937 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:18.388652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fd1278d5-50f3-48c8-b871-44cc6616a937 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:18.394659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd1278d5-50f3-48c8-b871-44cc6616a937 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:18.395115 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd1278d5-50f3-48c8-b871-44cc6616a937 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:18.395875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd1278d5-50f3-48c8-b871-44cc6616a937 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:18.396313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fd1278d5-50f3-48c8-b871-44cc6616a937 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:18.413505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-20d28323-67ed-4717-a201-fc7fa0500154 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:18.414599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-20d28323-67ed-4717-a201-fc7fa0500154 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:18.421518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20d28323-67ed-4717-a201-fc7fa0500154 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:18.422010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20d28323-67ed-4717-a201-fc7fa0500154 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:18.422792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20d28323-67ed-4717-a201-fc7fa0500154 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:18.423230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20d28323-67ed-4717-a201-fc7fa0500154 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:18.452326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-20d28323-67ed-4717-a201-fc7fa0500154 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Mar 08 04:33:18.452884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 732/1522] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:18 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:18.528097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fd1278d5-50f3-48c8-b871-44cc6616a937 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:18.535842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fd1278d5-50f3-48c8-b871-44cc6616a937 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151892 Mar 08 04:33:18.536402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 791/1523] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:18 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:19.463815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8cf22bc2-e072-4444-ba31-8f24d346c83e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:19.464723 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8cf22bc2-e072-4444-ba31-8f24d346c83e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:19.471063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8cf22bc2-e072-4444-ba31-8f24d346c83e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:19.471516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8cf22bc2-e072-4444-ba31-8f24d346c83e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:19.472276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8cf22bc2-e072-4444-ba31-8f24d346c83e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:19.472721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8cf22bc2-e072-4444-ba31-8f24d346c83e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:19.500321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8cf22bc2-e072-4444-ba31-8f24d346c83e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040473 Mar 08 04:33:19.500889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 733/1524] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:19 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:19.553293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9b2c00ea-12f2-40b5-8155-7f605ea1ab14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:19.553919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9b2c00ea-12f2-40b5-8155-7f605ea1ab14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:19.560711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b2c00ea-12f2-40b5-8155-7f605ea1ab14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:19.561315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b2c00ea-12f2-40b5-8155-7f605ea1ab14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:19.562104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b2c00ea-12f2-40b5-8155-7f605ea1ab14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:19.562542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b2c00ea-12f2-40b5-8155-7f605ea1ab14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:19.695514 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9b2c00ea-12f2-40b5-8155-7f605ea1ab14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:19.702734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9b2c00ea-12f2-40b5-8155-7f605ea1ab14 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153245 Mar 08 04:33:19.703296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 792/1525] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:20.511788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-37408707-0f4c-4745-8f4a-5f8a5d1fef07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:20.512693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-37408707-0f4c-4745-8f4a-5f8a5d1fef07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:20.519802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37408707-0f4c-4745-8f4a-5f8a5d1fef07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:20.520243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37408707-0f4c-4745-8f4a-5f8a5d1fef07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:20.520997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37408707-0f4c-4745-8f4a-5f8a5d1fef07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:20.521428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37408707-0f4c-4745-8f4a-5f8a5d1fef07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:20.549925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-37408707-0f4c-4745-8f4a-5f8a5d1fef07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042033 Mar 08 04:33:20.550463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 734/1526] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:20.720149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-777c9dbd-030b-4fb4-aac8-0e40bfdc8806 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:20.720758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-777c9dbd-030b-4fb4-aac8-0e40bfdc8806 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:20.727049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-777c9dbd-030b-4fb4-aac8-0e40bfdc8806 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:20.727503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-777c9dbd-030b-4fb4-aac8-0e40bfdc8806 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:20.728276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-777c9dbd-030b-4fb4-aac8-0e40bfdc8806 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:20.728715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-777c9dbd-030b-4fb4-aac8-0e40bfdc8806 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:20.862118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-777c9dbd-030b-4fb4-aac8-0e40bfdc8806 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:20.869425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-777c9dbd-030b-4fb4-aac8-0e40bfdc8806 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153857 Mar 08 04:33:20.870012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 793/1527] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:20 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:21.561397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0ee2205d-cba4-48aa-b4e9-39ec6d292f20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:21.562346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0ee2205d-cba4-48aa-b4e9-39ec6d292f20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:21.568569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ee2205d-cba4-48aa-b4e9-39ec6d292f20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:21.569022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ee2205d-cba4-48aa-b4e9-39ec6d292f20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:21.569821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ee2205d-cba4-48aa-b4e9-39ec6d292f20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:21.570265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ee2205d-cba4-48aa-b4e9-39ec6d292f20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:21.597956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0ee2205d-cba4-48aa-b4e9-39ec6d292f20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040627 Mar 08 04:33:21.598500 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 735/1528] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:21 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:21.886817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9de3e6fd-feb5-4855-998a-e91f0efab4ec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:21.887433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9de3e6fd-feb5-4855-998a-e91f0efab4ec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:21.894170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9de3e6fd-feb5-4855-998a-e91f0efab4ec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:21.894620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9de3e6fd-feb5-4855-998a-e91f0efab4ec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:21.895383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9de3e6fd-feb5-4855-998a-e91f0efab4ec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:21.895821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9de3e6fd-feb5-4855-998a-e91f0efab4ec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:22.029557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9de3e6fd-feb5-4855-998a-e91f0efab4ec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:22.036758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9de3e6fd-feb5-4855-998a-e91f0efab4ec tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153841 Mar 08 04:33:22.037313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 794/1529] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:21 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:22.610446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7a2944c4-a481-4039-b7db-0b880640e2a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:22.611382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7a2944c4-a481-4039-b7db-0b880640e2a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:22.617925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a2944c4-a481-4039-b7db-0b880640e2a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:22.618370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a2944c4-a481-4039-b7db-0b880640e2a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:22.619126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a2944c4-a481-4039-b7db-0b880640e2a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:22.619562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a2944c4-a481-4039-b7db-0b880640e2a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:22.647117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7a2944c4-a481-4039-b7db-0b880640e2a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Mar 08 04:33:22.647651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 736/1530] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:23.053576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f183517c-dd88-4119-9900-c4d87c924c17 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:23.054211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f183517c-dd88-4119-9900-c4d87c924c17 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:23.060974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f183517c-dd88-4119-9900-c4d87c924c17 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:23.061421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f183517c-dd88-4119-9900-c4d87c924c17 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:23.062207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f183517c-dd88-4119-9900-c4d87c924c17 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:23.062664 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f183517c-dd88-4119-9900-c4d87c924c17 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:23.399052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f183517c-dd88-4119-9900-c4d87c924c17 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:23.407226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f183517c-dd88-4119-9900-c4d87c924c17 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.357472 Mar 08 04:33:23.407783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 795/1531] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:23.659385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7bf3bc6f-5f4d-4f9d-82b7-689cea34c759 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:23.660219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7bf3bc6f-5f4d-4f9d-82b7-689cea34c759 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:23.666660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bf3bc6f-5f4d-4f9d-82b7-689cea34c759 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:23.667112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bf3bc6f-5f4d-4f9d-82b7-689cea34c759 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:23.667917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bf3bc6f-5f4d-4f9d-82b7-689cea34c759 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:23.668353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bf3bc6f-5f4d-4f9d-82b7-689cea34c759 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:23.696375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7bf3bc6f-5f4d-4f9d-82b7-689cea34c759 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041036 Mar 08 04:33:23.696922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 737/1532] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:24.424208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2592a967-d83e-4fdc-a134-fe8b5b136938 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:24.424814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2592a967-d83e-4fdc-a134-fe8b5b136938 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:24.431218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2592a967-d83e-4fdc-a134-fe8b5b136938 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:24.431663 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2592a967-d83e-4fdc-a134-fe8b5b136938 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:24.432420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2592a967-d83e-4fdc-a134-fe8b5b136938 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:24.432851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2592a967-d83e-4fdc-a134-fe8b5b136938 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:24.563985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2592a967-d83e-4fdc-a134-fe8b5b136938 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:24.571355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2592a967-d83e-4fdc-a134-fe8b5b136938 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151814 Mar 08 04:33:24.571916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 796/1533] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:24 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:24.707679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-babf081c-5027-45be-b698-1c158b0aabe5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:24.708511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-babf081c-5027-45be-b698-1c158b0aabe5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:24.714647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-babf081c-5027-45be-b698-1c158b0aabe5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:24.715090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-babf081c-5027-45be-b698-1c158b0aabe5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:24.715841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-babf081c-5027-45be-b698-1c158b0aabe5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:24.716821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-babf081c-5027-45be-b698-1c158b0aabe5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:24.745450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-babf081c-5027-45be-b698-1c158b0aabe5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 Mar 08 04:33:24.746336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 738/1534] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:25.588525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c162dba3-3e47-41f0-8f8f-24b843d9417f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:25.589156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c162dba3-3e47-41f0-8f8f-24b843d9417f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:25.595605 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c162dba3-3e47-41f0-8f8f-24b843d9417f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:25.596050 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c162dba3-3e47-41f0-8f8f-24b843d9417f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:25.596811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c162dba3-3e47-41f0-8f8f-24b843d9417f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:25.597243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c162dba3-3e47-41f0-8f8f-24b843d9417f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:25.734741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c162dba3-3e47-41f0-8f8f-24b843d9417f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:25.741965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c162dba3-3e47-41f0-8f8f-24b843d9417f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.157261 Mar 08 04:33:25.742531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 797/1535] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:25.756932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-37c827f3-0183-4b90-ab10-57097b23d19c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:25.757871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-37c827f3-0183-4b90-ab10-57097b23d19c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:25.764094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37c827f3-0183-4b90-ab10-57097b23d19c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:25.764533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37c827f3-0183-4b90-ab10-57097b23d19c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:25.765289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37c827f3-0183-4b90-ab10-57097b23d19c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:25.765748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37c827f3-0183-4b90-ab10-57097b23d19c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:25.793972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-37c827f3-0183-4b90-ab10-57097b23d19c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040996 Mar 08 04:33:25.795135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 739/1536] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:26.759859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1c7cf7cf-2420-4280-99ac-d3d9a46b9b6f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:26.760463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1c7cf7cf-2420-4280-99ac-d3d9a46b9b6f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:26.766774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c7cf7cf-2420-4280-99ac-d3d9a46b9b6f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:26.767223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c7cf7cf-2420-4280-99ac-d3d9a46b9b6f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:26.767981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c7cf7cf-2420-4280-99ac-d3d9a46b9b6f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:26.768417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c7cf7cf-2420-4280-99ac-d3d9a46b9b6f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:26.806049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a010c1ec-75ad-474e-8f2b-73f78ff1e023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:26.806957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a010c1ec-75ad-474e-8f2b-73f78ff1e023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:26.813428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a010c1ec-75ad-474e-8f2b-73f78ff1e023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:26.813982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a010c1ec-75ad-474e-8f2b-73f78ff1e023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:26.814771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a010c1ec-75ad-474e-8f2b-73f78ff1e023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:26.815207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a010c1ec-75ad-474e-8f2b-73f78ff1e023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:26.844437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a010c1ec-75ad-474e-8f2b-73f78ff1e023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Mar 08 04:33:26.844995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 740/1537] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:26 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:33:26.899640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1c7cf7cf-2420-4280-99ac-d3d9a46b9b6f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:26.907708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1c7cf7cf-2420-4280-99ac-d3d9a46b9b6f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151739 Mar 08 04:33:26.908278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 798/1538] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:26 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:27.855900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-34ca7c31-5caf-454e-a44a-a9ff08bc0571 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:27.857350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-34ca7c31-5caf-454e-a44a-a9ff08bc0571 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:27.863681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-34ca7c31-5caf-454e-a44a-a9ff08bc0571 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:27.864123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-34ca7c31-5caf-454e-a44a-a9ff08bc0571 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:27.864875 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-34ca7c31-5caf-454e-a44a-a9ff08bc0571 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:27.865304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-34ca7c31-5caf-454e-a44a-a9ff08bc0571 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:27.893417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-34ca7c31-5caf-454e-a44a-a9ff08bc0571 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041437 Mar 08 04:33:27.894002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 741/1539] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:27 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:27.924724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-53d47254-012f-4fb2-b9ab-83ecf70af591 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:27.925369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-53d47254-012f-4fb2-b9ab-83ecf70af591 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:27.931549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-53d47254-012f-4fb2-b9ab-83ecf70af591 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:27.931995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-53d47254-012f-4fb2-b9ab-83ecf70af591 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:27.932757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-53d47254-012f-4fb2-b9ab-83ecf70af591 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:27.933196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-53d47254-012f-4fb2-b9ab-83ecf70af591 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:28.072279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-53d47254-012f-4fb2-b9ab-83ecf70af591 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:28.079842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-53d47254-012f-4fb2-b9ab-83ecf70af591 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.158948 Mar 08 04:33:28.080406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 799/1540] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:27 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:28.904739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d260256d-8ab7-48df-a96d-edf47678e8cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:28.905677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d260256d-8ab7-48df-a96d-edf47678e8cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:28.911895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d260256d-8ab7-48df-a96d-edf47678e8cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:28.912344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d260256d-8ab7-48df-a96d-edf47678e8cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:28.913106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d260256d-8ab7-48df-a96d-edf47678e8cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:28.913548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d260256d-8ab7-48df-a96d-edf47678e8cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:28.942011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d260256d-8ab7-48df-a96d-edf47678e8cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 Mar 08 04:33:28.942544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 742/1541] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:28 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:29.097279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8dc94c04-e1c1-4807-845e-56dcdea2fdbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:29.097912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8dc94c04-e1c1-4807-845e-56dcdea2fdbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:29.104164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8dc94c04-e1c1-4807-845e-56dcdea2fdbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:29.104552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8dc94c04-e1c1-4807-845e-56dcdea2fdbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:29.105310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8dc94c04-e1c1-4807-845e-56dcdea2fdbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:29.105907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8dc94c04-e1c1-4807-845e-56dcdea2fdbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:29.235774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8dc94c04-e1c1-4807-845e-56dcdea2fdbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:29.242949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8dc94c04-e1c1-4807-845e-56dcdea2fdbd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.149516 Mar 08 04:33:29.243496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 800/1542] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:29 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:29.953479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7c470785-3ea4-4ef7-99f1-3c77f6844c14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:29.954419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7c470785-3ea4-4ef7-99f1-3c77f6844c14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:29.960621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c470785-3ea4-4ef7-99f1-3c77f6844c14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:29.961066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c470785-3ea4-4ef7-99f1-3c77f6844c14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:29.961868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c470785-3ea4-4ef7-99f1-3c77f6844c14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:29.962298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c470785-3ea4-4ef7-99f1-3c77f6844c14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:29.990564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7c470785-3ea4-4ef7-99f1-3c77f6844c14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041139 Mar 08 04:33:29.991102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 743/1543] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:30.259837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-16d98b71-4570-46b4-a4aa-91aa47219ce1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:30.260445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-16d98b71-4570-46b4-a4aa-91aa47219ce1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:30.267179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d98b71-4570-46b4-a4aa-91aa47219ce1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:30.267638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d98b71-4570-46b4-a4aa-91aa47219ce1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:30.268374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d98b71-4570-46b4-a4aa-91aa47219ce1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:30.268804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16d98b71-4570-46b4-a4aa-91aa47219ce1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:30.406019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-16d98b71-4570-46b4-a4aa-91aa47219ce1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:30.413250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-16d98b71-4570-46b4-a4aa-91aa47219ce1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.157266 Mar 08 04:33:30.413881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 801/1544] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:30 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:31.004175 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b6abda69-ae95-42b7-a1f6-29dd83ceeb85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:31.005134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b6abda69-ae95-42b7-a1f6-29dd83ceeb85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:31.011316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6abda69-ae95-42b7-a1f6-29dd83ceeb85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:31.011767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6abda69-ae95-42b7-a1f6-29dd83ceeb85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:31.012533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6abda69-ae95-42b7-a1f6-29dd83ceeb85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:31.013001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6abda69-ae95-42b7-a1f6-29dd83ceeb85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:31.041031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b6abda69-ae95-42b7-a1f6-29dd83ceeb85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040894 Mar 08 04:33:31.041571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 744/1545] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:31.430326 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1edfe423-3ed6-454d-ace3-ad1cca6925c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:31.430937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1edfe423-3ed6-454d-ace3-ad1cca6925c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:31.437200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1edfe423-3ed6-454d-ace3-ad1cca6925c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:31.437649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1edfe423-3ed6-454d-ace3-ad1cca6925c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:31.438442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1edfe423-3ed6-454d-ace3-ad1cca6925c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:31.438879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1edfe423-3ed6-454d-ace3-ad1cca6925c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:31.567342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1edfe423-3ed6-454d-ace3-ad1cca6925c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:31.574507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1edfe423-3ed6-454d-ace3-ad1cca6925c2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.148077 Mar 08 04:33:31.575075 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 802/1546] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:31 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:32.052472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c650919f-d4e7-469a-be08-b1c096d24688 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:32.053383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c650919f-d4e7-469a-be08-b1c096d24688 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:32.059619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c650919f-d4e7-469a-be08-b1c096d24688 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:32.060069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c650919f-d4e7-469a-be08-b1c096d24688 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:32.060833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c650919f-d4e7-469a-be08-b1c096d24688 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:32.061333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c650919f-d4e7-469a-be08-b1c096d24688 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:32.088709 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c650919f-d4e7-469a-be08-b1c096d24688 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040183 Mar 08 04:33:32.089245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 745/1547] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:32 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:32.592409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3c1dd2c8-5282-4d5e-b3b3-243f0b5d0712 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:32.593009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3c1dd2c8-5282-4d5e-b3b3-243f0b5d0712 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:32.599261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c1dd2c8-5282-4d5e-b3b3-243f0b5d0712 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:32.599715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c1dd2c8-5282-4d5e-b3b3-243f0b5d0712 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:32.600485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c1dd2c8-5282-4d5e-b3b3-243f0b5d0712 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:32.600922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c1dd2c8-5282-4d5e-b3b3-243f0b5d0712 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:32.736593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3c1dd2c8-5282-4d5e-b3b3-243f0b5d0712 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:32.743768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3c1dd2c8-5282-4d5e-b3b3-243f0b5d0712 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.155326 Mar 08 04:33:32.744323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 803/1548] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:32 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:33.100459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e0ec6cb0-ec81-4397-87a0-e9c63ea75b15 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:33.101477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e0ec6cb0-ec81-4397-87a0-e9c63ea75b15 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:33.107912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0ec6cb0-ec81-4397-87a0-e9c63ea75b15 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:33.108247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0ec6cb0-ec81-4397-87a0-e9c63ea75b15 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:33.109013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0ec6cb0-ec81-4397-87a0-e9c63ea75b15 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:33.109467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0ec6cb0-ec81-4397-87a0-e9c63ea75b15 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:33.137079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e0ec6cb0-ec81-4397-87a0-e9c63ea75b15 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040564 Mar 08 04:33:33.137631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 746/1549] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:33.760439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-88de3a10-debb-47a0-aad0-488c8e01f3d8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:33.761065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-88de3a10-debb-47a0-aad0-488c8e01f3d8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:33.767891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88de3a10-debb-47a0-aad0-488c8e01f3d8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:33.768333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88de3a10-debb-47a0-aad0-488c8e01f3d8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:33.769090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88de3a10-debb-47a0-aad0-488c8e01f3d8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:33.769520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88de3a10-debb-47a0-aad0-488c8e01f3d8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:33.903534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-88de3a10-debb-47a0-aad0-488c8e01f3d8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:33.910876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-88de3a10-debb-47a0-aad0-488c8e01f3d8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.154295 Mar 08 04:33:33.911432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 804/1550] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:33 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:34.148781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-07ae5ce8-2268-4df9-aa90-1c8ad4afd13c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:34.149601 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-07ae5ce8-2268-4df9-aa90-1c8ad4afd13c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:34.156094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07ae5ce8-2268-4df9-aa90-1c8ad4afd13c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:34.156538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07ae5ce8-2268-4df9-aa90-1c8ad4afd13c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:34.157291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07ae5ce8-2268-4df9-aa90-1c8ad4afd13c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:34.157739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07ae5ce8-2268-4df9-aa90-1c8ad4afd13c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:34.185258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-07ae5ce8-2268-4df9-aa90-1c8ad4afd13c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040492 Mar 08 04:33:34.186532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 747/1551] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:34.928146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ca31af1b-42bd-4764-a3b1-7bfa2773f8fe tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:34.928753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ca31af1b-42bd-4764-a3b1-7bfa2773f8fe tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:34.935006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca31af1b-42bd-4764-a3b1-7bfa2773f8fe tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:34.935449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca31af1b-42bd-4764-a3b1-7bfa2773f8fe tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:34.936205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca31af1b-42bd-4764-a3b1-7bfa2773f8fe tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:34.936632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ca31af1b-42bd-4764-a3b1-7bfa2773f8fe tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:35.067182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ca31af1b-42bd-4764-a3b1-7bfa2773f8fe tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:35.074343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ca31af1b-42bd-4764-a3b1-7bfa2773f8fe tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.150078 Mar 08 04:33:35.074903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 805/1552] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:34 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:35.196436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8f810b02-322c-45eb-91ac-4286ddabfa2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:35.197345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8f810b02-322c-45eb-91ac-4286ddabfa2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:35.204165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f810b02-322c-45eb-91ac-4286ddabfa2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:35.204611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f810b02-322c-45eb-91ac-4286ddabfa2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:35.205370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f810b02-322c-45eb-91ac-4286ddabfa2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:35.205840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8f810b02-322c-45eb-91ac-4286ddabfa2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:35.233061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8f810b02-322c-45eb-91ac-4286ddabfa2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040500 Mar 08 04:33:35.233598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 748/1553] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:35 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:36.092477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0784de6e-499b-4f3a-a5d3-f3e64d9628f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:36.093052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0784de6e-499b-4f3a-a5d3-f3e64d9628f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:36.099289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0784de6e-499b-4f3a-a5d3-f3e64d9628f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:36.099735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0784de6e-499b-4f3a-a5d3-f3e64d9628f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:36.100499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0784de6e-499b-4f3a-a5d3-f3e64d9628f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:36.100942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0784de6e-499b-4f3a-a5d3-f3e64d9628f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:36.233981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0784de6e-499b-4f3a-a5d3-f3e64d9628f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:36.241402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0784de6e-499b-4f3a-a5d3-f3e64d9628f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153353 Mar 08 04:33:36.242007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 806/1554] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:36 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:36.244513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b4711b71-b169-4c4b-9d70-0992d301ef14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:36.245418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b4711b71-b169-4c4b-9d70-0992d301ef14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:36.251167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4711b71-b169-4c4b-9d70-0992d301ef14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:36.251610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4711b71-b169-4c4b-9d70-0992d301ef14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:36.252363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4711b71-b169-4c4b-9d70-0992d301ef14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:36.252794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4711b71-b169-4c4b-9d70-0992d301ef14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:36.283239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b4711b71-b169-4c4b-9d70-0992d301ef14 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042782 Mar 08 04:33:36.283778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 749/1555] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:36 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:37.257754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-62e9a87d-7ea8-4ef5-9edb-f769ac30305d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:37.258363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-62e9a87d-7ea8-4ef5-9edb-f769ac30305d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:37.264621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-62e9a87d-7ea8-4ef5-9edb-f769ac30305d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:37.265078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-62e9a87d-7ea8-4ef5-9edb-f769ac30305d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:37.265875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-62e9a87d-7ea8-4ef5-9edb-f769ac30305d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:37.266309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-62e9a87d-7ea8-4ef5-9edb-f769ac30305d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:37.294554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-99a06831-7dec-4c79-96bb-96048eb8022f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:37.296201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-99a06831-7dec-4c79-96bb-96048eb8022f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:37.302582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99a06831-7dec-4c79-96bb-96048eb8022f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:37.303031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99a06831-7dec-4c79-96bb-96048eb8022f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:37.303794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99a06831-7dec-4c79-96bb-96048eb8022f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:37.304225 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99a06831-7dec-4c79-96bb-96048eb8022f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:37.332217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-99a06831-7dec-4c79-96bb-96048eb8022f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041514 Mar 08 04:33:37.332771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 750/1556] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:37 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:33:37.396354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-62e9a87d-7ea8-4ef5-9edb-f769ac30305d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:37.403782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-62e9a87d-7ea8-4ef5-9edb-f769ac30305d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.149904 Mar 08 04:33:37.405099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 807/1557] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:37 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:38.343364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-38769ed4-c6f9-480b-9558-c564472f743d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:38.344278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-38769ed4-c6f9-480b-9558-c564472f743d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:38.350483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-38769ed4-c6f9-480b-9558-c564472f743d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:38.350939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-38769ed4-c6f9-480b-9558-c564472f743d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:38.351704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-38769ed4-c6f9-480b-9558-c564472f743d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:38.352141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-38769ed4-c6f9-480b-9558-c564472f743d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:38.381051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-38769ed4-c6f9-480b-9558-c564472f743d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041683 Mar 08 04:33:38.381593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 751/1558] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:38 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:38.421054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a0974918-64f3-47e0-b6b7-8a13606660d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:38.421688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a0974918-64f3-47e0-b6b7-8a13606660d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:38.427916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0974918-64f3-47e0-b6b7-8a13606660d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:38.428372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0974918-64f3-47e0-b6b7-8a13606660d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:38.429174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0974918-64f3-47e0-b6b7-8a13606660d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:38.429621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0974918-64f3-47e0-b6b7-8a13606660d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:38.560004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a0974918-64f3-47e0-b6b7-8a13606660d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:38.568026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a0974918-64f3-47e0-b6b7-8a13606660d1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151331 Mar 08 04:33:38.568593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 808/1559] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:38 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:39.392781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8a291827-9b79-4515-995c-13db8b64a9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:39.393635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8a291827-9b79-4515-995c-13db8b64a9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:39.399936 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a291827-9b79-4515-995c-13db8b64a9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:39.400379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a291827-9b79-4515-995c-13db8b64a9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:39.401132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a291827-9b79-4515-995c-13db8b64a9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:39.401562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a291827-9b79-4515-995c-13db8b64a9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:39.429448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8a291827-9b79-4515-995c-13db8b64a9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041170 Mar 08 04:33:39.430035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 752/1560] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:39 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:39.584757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-86c4d2a0-baeb-4ab5-84ec-0df5c8de9812 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:39.585358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-86c4d2a0-baeb-4ab5-84ec-0df5c8de9812 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:39.591811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86c4d2a0-baeb-4ab5-84ec-0df5c8de9812 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:39.592261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86c4d2a0-baeb-4ab5-84ec-0df5c8de9812 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:39.593015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86c4d2a0-baeb-4ab5-84ec-0df5c8de9812 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:39.593450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86c4d2a0-baeb-4ab5-84ec-0df5c8de9812 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:39.725032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-86c4d2a0-baeb-4ab5-84ec-0df5c8de9812 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:39.732555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-86c4d2a0-baeb-4ab5-84ec-0df5c8de9812 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151406 Mar 08 04:33:39.733122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 809/1561] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:39 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:40.317387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:33:40.317625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:33:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:33:40.440991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d3da9b2d-65ef-4fd5-9f93-fc58c74e5cbe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:40.441933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d3da9b2d-65ef-4fd5-9f93-fc58c74e5cbe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:40.448250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3da9b2d-65ef-4fd5-9f93-fc58c74e5cbe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:40.448695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3da9b2d-65ef-4fd5-9f93-fc58c74e5cbe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:40.449465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3da9b2d-65ef-4fd5-9f93-fc58c74e5cbe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:40.449949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3da9b2d-65ef-4fd5-9f93-fc58c74e5cbe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:40.478661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d3da9b2d-65ef-4fd5-9f93-fc58c74e5cbe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041649 Mar 08 04:33:40.479203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 753/1562] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:40.749502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d72a9a9e-3dc7-43b5-9623-dd7b1b7cdd95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:40.750132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d72a9a9e-3dc7-43b5-9623-dd7b1b7cdd95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:40.756353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d72a9a9e-3dc7-43b5-9623-dd7b1b7cdd95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:40.756801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d72a9a9e-3dc7-43b5-9623-dd7b1b7cdd95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:40.757559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d72a9a9e-3dc7-43b5-9623-dd7b1b7cdd95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:40.758016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d72a9a9e-3dc7-43b5-9623-dd7b1b7cdd95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:40.898063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d72a9a9e-3dc7-43b5-9623-dd7b1b7cdd95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:40.906088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d72a9a9e-3dc7-43b5-9623-dd7b1b7cdd95 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.160593 Mar 08 04:33:40.906645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 810/1563] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:40 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:41.490073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cadefb56-16e9-4c04-b065-a6bc360c8daf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:41.490986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cadefb56-16e9-4c04-b065-a6bc360c8daf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:41.497160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cadefb56-16e9-4c04-b065-a6bc360c8daf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:41.497612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cadefb56-16e9-4c04-b065-a6bc360c8daf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:41.499117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cadefb56-16e9-4c04-b065-a6bc360c8daf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:41.499555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cadefb56-16e9-4c04-b065-a6bc360c8daf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:41.527004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cadefb56-16e9-4c04-b065-a6bc360c8daf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040728 Mar 08 04:33:41.527535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 754/1564] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:41 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:41.923804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8227c90b-f141-4e16-a7a4-4248140d6b4a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:41.924417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8227c90b-f141-4e16-a7a4-4248140d6b4a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:41.930735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8227c90b-f141-4e16-a7a4-4248140d6b4a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:41.931188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8227c90b-f141-4e16-a7a4-4248140d6b4a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:41.931960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8227c90b-f141-4e16-a7a4-4248140d6b4a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:41.932403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8227c90b-f141-4e16-a7a4-4248140d6b4a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:42.066140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8227c90b-f141-4e16-a7a4-4248140d6b4a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:42.073392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8227c90b-f141-4e16-a7a4-4248140d6b4a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.154303 Mar 08 04:33:42.073982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 811/1565] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:41 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:42.539137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bbb96438-9d70-4186-9bbe-98af14c402c2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:42.540048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bbb96438-9d70-4186-9bbe-98af14c402c2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:42.546627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bbb96438-9d70-4186-9bbe-98af14c402c2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:42.547128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bbb96438-9d70-4186-9bbe-98af14c402c2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:42.547946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bbb96438-9d70-4186-9bbe-98af14c402c2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:42.548375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bbb96438-9d70-4186-9bbe-98af14c402c2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:42.578697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bbb96438-9d70-4186-9bbe-98af14c402c2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Mar 08 04:33:42.579481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 755/1566] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:42 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:33:43.090933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ea5644f2-09ad-4ea0-837c-182e0e231a9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:43.091696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ea5644f2-09ad-4ea0-837c-182e0e231a9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:43.098043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea5644f2-09ad-4ea0-837c-182e0e231a9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:43.098494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea5644f2-09ad-4ea0-837c-182e0e231a9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:43.099260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea5644f2-09ad-4ea0-837c-182e0e231a9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:43.099696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea5644f2-09ad-4ea0-837c-182e0e231a9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:43.233343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ea5644f2-09ad-4ea0-837c-182e0e231a9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:43.240819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ea5644f2-09ad-4ea0-837c-182e0e231a9a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153775 Mar 08 04:33:43.241379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 812/1567] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:43 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:43.590957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f565099b-450e-4a02-b20c-51577e8f96a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:43.592584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f565099b-450e-4a02-b20c-51577e8f96a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:43.598765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f565099b-450e-4a02-b20c-51577e8f96a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:43.599211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f565099b-450e-4a02-b20c-51577e8f96a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:43.599963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f565099b-450e-4a02-b20c-51577e8f96a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:43.600394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f565099b-450e-4a02-b20c-51577e8f96a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:43.627302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f565099b-450e-4a02-b20c-51577e8f96a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040328 Mar 08 04:33:43.627827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 756/1568] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:44.257735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7fe91ae9-59f6-42a8-a2ec-b79d0c901c28 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:44.258350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7fe91ae9-59f6-42a8-a2ec-b79d0c901c28 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:44.265479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7fe91ae9-59f6-42a8-a2ec-b79d0c901c28 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:44.265961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7fe91ae9-59f6-42a8-a2ec-b79d0c901c28 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:44.266736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7fe91ae9-59f6-42a8-a2ec-b79d0c901c28 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:44.267197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7fe91ae9-59f6-42a8-a2ec-b79d0c901c28 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:44.402256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7fe91ae9-59f6-42a8-a2ec-b79d0c901c28 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:44.410157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7fe91ae9-59f6-42a8-a2ec-b79d0c901c28 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.156347 Mar 08 04:33:44.410727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 813/1569] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:44 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:44.639646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f695a31c-f972-4ac6-b7ab-09040e43c02d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:44.640490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f695a31c-f972-4ac6-b7ab-09040e43c02d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:44.646739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f695a31c-f972-4ac6-b7ab-09040e43c02d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:44.647184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f695a31c-f972-4ac6-b7ab-09040e43c02d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:44.647948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f695a31c-f972-4ac6-b7ab-09040e43c02d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:44.648378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f695a31c-f972-4ac6-b7ab-09040e43c02d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:44.676349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f695a31c-f972-4ac6-b7ab-09040e43c02d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041253 Mar 08 04:33:44.676888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 757/1570] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:45.428369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a72db6b5-aaaf-4c10-8dbd-4fa85114062c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:45.428966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a72db6b5-aaaf-4c10-8dbd-4fa85114062c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:45.437574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a72db6b5-aaaf-4c10-8dbd-4fa85114062c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:45.438055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a72db6b5-aaaf-4c10-8dbd-4fa85114062c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:45.438839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a72db6b5-aaaf-4c10-8dbd-4fa85114062c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:45.439307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a72db6b5-aaaf-4c10-8dbd-4fa85114062c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:45.570325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a72db6b5-aaaf-4c10-8dbd-4fa85114062c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:45.578283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a72db6b5-aaaf-4c10-8dbd-4fa85114062c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.154946 Mar 08 04:33:45.578848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 814/1571] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:45 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:45.687716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2a4df1b9-df90-41aa-a411-2a538071758e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:45.688556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2a4df1b9-df90-41aa-a411-2a538071758e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:45.694708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2a4df1b9-df90-41aa-a411-2a538071758e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:45.695151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2a4df1b9-df90-41aa-a411-2a538071758e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:45.695899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2a4df1b9-df90-41aa-a411-2a538071758e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:45.696330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2a4df1b9-df90-41aa-a411-2a538071758e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:45.724140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2a4df1b9-df90-41aa-a411-2a538071758e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040440 Mar 08 04:33:45.724670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 758/1572] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:45 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:46.594588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5bc6fe39-4feb-405f-8571-f5be5ef92792 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:46.595193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5bc6fe39-4feb-405f-8571-f5be5ef92792 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:46.601388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bc6fe39-4feb-405f-8571-f5be5ef92792 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:46.601865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bc6fe39-4feb-405f-8571-f5be5ef92792 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:46.602617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bc6fe39-4feb-405f-8571-f5be5ef92792 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:46.603049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bc6fe39-4feb-405f-8571-f5be5ef92792 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:46.734748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5bc6fe39-4feb-405f-8571-f5be5ef92792 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:46.735714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bdddafe2-df44-4edb-9c5b-3e575ac3397a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:46.736633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bdddafe2-df44-4edb-9c5b-3e575ac3397a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:46.742290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5bc6fe39-4feb-405f-8571-f5be5ef92792 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151533 Mar 08 04:33:46.742903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bdddafe2-df44-4edb-9c5b-3e575ac3397a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:46.743059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 815/1573] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:46 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:46.743354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bdddafe2-df44-4edb-9c5b-3e575ac3397a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:46.744132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bdddafe2-df44-4edb-9c5b-3e575ac3397a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:46.744575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bdddafe2-df44-4edb-9c5b-3e575ac3397a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:46.773048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bdddafe2-df44-4edb-9c5b-3e575ac3397a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041465 Mar 08 04:33:46.773587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 759/1574] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:46 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:33:47.759496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5227caaa-baa1-45c4-b6a4-4afddc4558f1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:47.760136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5227caaa-baa1-45c4-b6a4-4afddc4558f1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:47.766321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5227caaa-baa1-45c4-b6a4-4afddc4558f1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:47.766770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5227caaa-baa1-45c4-b6a4-4afddc4558f1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:47.767541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5227caaa-baa1-45c4-b6a4-4afddc4558f1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:47.767979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5227caaa-baa1-45c4-b6a4-4afddc4558f1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:47.784769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-96631aa8-25f9-4464-a2e8-d60a2d0b0910 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:47.786281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-96631aa8-25f9-4464-a2e8-d60a2d0b0910 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:47.792442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-96631aa8-25f9-4464-a2e8-d60a2d0b0910 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:47.792883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-96631aa8-25f9-4464-a2e8-d60a2d0b0910 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:47.793645 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-96631aa8-25f9-4464-a2e8-d60a2d0b0910 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:47.794100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-96631aa8-25f9-4464-a2e8-d60a2d0b0910 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:47.823400 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-96631aa8-25f9-4464-a2e8-d60a2d0b0910 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Mar 08 04:33:47.823956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 760/1575] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:47 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:33:47.905985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5227caaa-baa1-45c4-b6a4-4afddc4558f1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:47.913266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5227caaa-baa1-45c4-b6a4-4afddc4558f1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.157843 Mar 08 04:33:47.913853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 816/1576] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:47 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:48.834958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8039e7f5-cad6-47a7-9551-2b6bc3249a40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:48.835896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8039e7f5-cad6-47a7-9551-2b6bc3249a40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:48.842418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8039e7f5-cad6-47a7-9551-2b6bc3249a40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:48.842869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8039e7f5-cad6-47a7-9551-2b6bc3249a40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:48.843631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8039e7f5-cad6-47a7-9551-2b6bc3249a40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:48.844074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8039e7f5-cad6-47a7-9551-2b6bc3249a40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:48.872373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8039e7f5-cad6-47a7-9551-2b6bc3249a40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041286 Mar 08 04:33:48.873596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 761/1577] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:48 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:48.931178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0f445e40-7c23-4e9f-b786-aba49705bc73 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:48.931781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0f445e40-7c23-4e9f-b786-aba49705bc73 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:48.938683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f445e40-7c23-4e9f-b786-aba49705bc73 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:48.939129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f445e40-7c23-4e9f-b786-aba49705bc73 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:48.939894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f445e40-7c23-4e9f-b786-aba49705bc73 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:48.940362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f445e40-7c23-4e9f-b786-aba49705bc73 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:49.072839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0f445e40-7c23-4e9f-b786-aba49705bc73 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:49.080196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0f445e40-7c23-4e9f-b786-aba49705bc73 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.152980 Mar 08 04:33:49.080780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 817/1578] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:48 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:49.884572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0581ac70-837c-47a7-b55b-02ef6a6d4e93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:49.885471 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0581ac70-837c-47a7-b55b-02ef6a6d4e93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:49.891853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0581ac70-837c-47a7-b55b-02ef6a6d4e93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:49.892296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0581ac70-837c-47a7-b55b-02ef6a6d4e93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:49.893048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0581ac70-837c-47a7-b55b-02ef6a6d4e93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:49.893479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0581ac70-837c-47a7-b55b-02ef6a6d4e93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:49.922367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0581ac70-837c-47a7-b55b-02ef6a6d4e93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041839 Mar 08 04:33:49.922922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 762/1579] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:49 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:50.096767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d5dbc472-cd59-4191-a643-1208d429b42e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:50.097376 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d5dbc472-cd59-4191-a643-1208d429b42e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:50.103708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5dbc472-cd59-4191-a643-1208d429b42e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:50.104103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5dbc472-cd59-4191-a643-1208d429b42e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:50.104868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5dbc472-cd59-4191-a643-1208d429b42e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:50.105307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5dbc472-cd59-4191-a643-1208d429b42e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:50.238951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d5dbc472-cd59-4191-a643-1208d429b42e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:50.246187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d5dbc472-cd59-4191-a643-1208d429b42e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153241 Mar 08 04:33:50.246755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 818/1580] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:50 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:50.933858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f1544019-0589-4cac-b46c-8bef2ae12a77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:50.934766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f1544019-0589-4cac-b46c-8bef2ae12a77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:50.941441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1544019-0589-4cac-b46c-8bef2ae12a77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:50.941912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1544019-0589-4cac-b46c-8bef2ae12a77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:50.942679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1544019-0589-4cac-b46c-8bef2ae12a77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:50.943194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1544019-0589-4cac-b46c-8bef2ae12a77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:50.971857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f1544019-0589-4cac-b46c-8bef2ae12a77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 Mar 08 04:33:50.972402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 763/1581] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:50 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:51.264497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-11c8cc10-3d8f-46f0-b049-40a3a0b64122 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:51.265096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-11c8cc10-3d8f-46f0-b049-40a3a0b64122 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:51.271359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11c8cc10-3d8f-46f0-b049-40a3a0b64122 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:51.271804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11c8cc10-3d8f-46f0-b049-40a3a0b64122 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:51.272556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11c8cc10-3d8f-46f0-b049-40a3a0b64122 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:51.272986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11c8cc10-3d8f-46f0-b049-40a3a0b64122 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:51.401362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-11c8cc10-3d8f-46f0-b049-40a3a0b64122 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:51.408857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-11c8cc10-3d8f-46f0-b049-40a3a0b64122 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.148810 Mar 08 04:33:51.409421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 819/1582] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:51 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:51.983779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0e4f5dad-352e-40e6-b821-c7be8056c578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:51.984676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0e4f5dad-352e-40e6-b821-c7be8056c578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:51.990878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e4f5dad-352e-40e6-b821-c7be8056c578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:51.991320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e4f5dad-352e-40e6-b821-c7be8056c578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:51.992072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e4f5dad-352e-40e6-b821-c7be8056c578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:51.992502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e4f5dad-352e-40e6-b821-c7be8056c578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:52.019935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0e4f5dad-352e-40e6-b821-c7be8056c578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040555 Mar 08 04:33:52.020463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 764/1583] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:51 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:52.426353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6ffa197e-6dc2-49d8-a649-21acd4d36062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:52.426962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6ffa197e-6dc2-49d8-a649-21acd4d36062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:52.433210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ffa197e-6dc2-49d8-a649-21acd4d36062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:52.433675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ffa197e-6dc2-49d8-a649-21acd4d36062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:52.434460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ffa197e-6dc2-49d8-a649-21acd4d36062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:52.434942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ffa197e-6dc2-49d8-a649-21acd4d36062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:52.566850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6ffa197e-6dc2-49d8-a649-21acd4d36062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:52.574182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6ffa197e-6dc2-49d8-a649-21acd4d36062 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151706 Mar 08 04:33:52.574753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 820/1584] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:52 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:53.031786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-37a702d7-612c-471f-9de5-405ff5ee205d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:53.032955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-37a702d7-612c-471f-9de5-405ff5ee205d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:53.039162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37a702d7-612c-471f-9de5-405ff5ee205d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:53.039610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37a702d7-612c-471f-9de5-405ff5ee205d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:53.040370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37a702d7-612c-471f-9de5-405ff5ee205d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:53.040804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-37a702d7-612c-471f-9de5-405ff5ee205d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:53.069208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-37a702d7-612c-471f-9de5-405ff5ee205d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 Mar 08 04:33:53.069771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 765/1585] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:53 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:53.592524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c926beb4-99a7-4f48-a0d5-2644dc811a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:53.593133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c926beb4-99a7-4f48-a0d5-2644dc811a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:53.599501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c926beb4-99a7-4f48-a0d5-2644dc811a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:53.599950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c926beb4-99a7-4f48-a0d5-2644dc811a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:53.600717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c926beb4-99a7-4f48-a0d5-2644dc811a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:53.601156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c926beb4-99a7-4f48-a0d5-2644dc811a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:53.734495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c926beb4-99a7-4f48-a0d5-2644dc811a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:53.741724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c926beb4-99a7-4f48-a0d5-2644dc811a62 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.153813 Mar 08 04:33:53.742287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 821/1586] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:53 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:54.081210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bd14c528-1d00-45dd-9ed8-e9c2b0b3d250 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:54.082163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bd14c528-1d00-45dd-9ed8-e9c2b0b3d250 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:54.088302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd14c528-1d00-45dd-9ed8-e9c2b0b3d250 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:54.088757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd14c528-1d00-45dd-9ed8-e9c2b0b3d250 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:54.089535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd14c528-1d00-45dd-9ed8-e9c2b0b3d250 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:54.090012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd14c528-1d00-45dd-9ed8-e9c2b0b3d250 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:54.118303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bd14c528-1d00-45dd-9ed8-e9c2b0b3d250 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Mar 08 04:33:54.118770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 766/1587] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:54 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:54.758852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-446d6aca-9c96-4e84-a3b4-1d8b98063cdb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:54.759493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-446d6aca-9c96-4e84-a3b4-1d8b98063cdb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:54.765914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-446d6aca-9c96-4e84-a3b4-1d8b98063cdb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:54.766370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-446d6aca-9c96-4e84-a3b4-1d8b98063cdb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:54.767171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-446d6aca-9c96-4e84-a3b4-1d8b98063cdb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:54.767611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-446d6aca-9c96-4e84-a3b4-1d8b98063cdb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:54.900353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-446d6aca-9c96-4e84-a3b4-1d8b98063cdb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:54.907946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-446d6aca-9c96-4e84-a3b4-1d8b98063cdb tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.152961 Mar 08 04:33:54.908503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 822/1588] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:54 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:55.129561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-67fbf47e-ffa6-4106-a0f3-435cf268598a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:55.130500 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-67fbf47e-ffa6-4106-a0f3-435cf268598a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:55.136782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67fbf47e-ffa6-4106-a0f3-435cf268598a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:55.137224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67fbf47e-ffa6-4106-a0f3-435cf268598a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:55.138062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67fbf47e-ffa6-4106-a0f3-435cf268598a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:55.138497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67fbf47e-ffa6-4106-a0f3-435cf268598a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:55.166617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-67fbf47e-ffa6-4106-a0f3-435cf268598a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040954 Mar 08 04:33:55.167159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 767/1589] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:55 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:55.924192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c5f45c9f-9432-4b38-baf0-7c053905f105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:55.924796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c5f45c9f-9432-4b38-baf0-7c053905f105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:55.930992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5f45c9f-9432-4b38-baf0-7c053905f105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:55.931435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5f45c9f-9432-4b38-baf0-7c053905f105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:55.932196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5f45c9f-9432-4b38-baf0-7c053905f105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:55.932625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5f45c9f-9432-4b38-baf0-7c053905f105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:56.068809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c5f45c9f-9432-4b38-baf0-7c053905f105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:56.076825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c5f45c9f-9432-4b38-baf0-7c053905f105 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.156505 Mar 08 04:33:56.077386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 823/1590] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:55 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:56.178680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c99d348e-eb2c-4821-94e8-c58a6de15914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:56.179581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c99d348e-eb2c-4821-94e8-c58a6de15914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:56.186666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c99d348e-eb2c-4821-94e8-c58a6de15914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:56.187303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c99d348e-eb2c-4821-94e8-c58a6de15914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:56.188448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c99d348e-eb2c-4821-94e8-c58a6de15914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:56.189039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c99d348e-eb2c-4821-94e8-c58a6de15914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:56.217761 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c99d348e-eb2c-4821-94e8-c58a6de15914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042980 Mar 08 04:33:56.218297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 768/1591] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:56 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:57.094235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6573b498-a22c-440f-bf8d-8d12bd8c2874 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:57.094842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6573b498-a22c-440f-bf8d-8d12bd8c2874 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:57.100952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6573b498-a22c-440f-bf8d-8d12bd8c2874 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:57.101397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6573b498-a22c-440f-bf8d-8d12bd8c2874 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:57.102185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6573b498-a22c-440f-bf8d-8d12bd8c2874 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:57.102617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6573b498-a22c-440f-bf8d-8d12bd8c2874 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:57.229132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-eddb7c36-4b8a-404b-a043-a191ef4bd558 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:57.230065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eddb7c36-4b8a-404b-a043-a191ef4bd558 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:57.233801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6573b498-a22c-440f-bf8d-8d12bd8c2874 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:57.236380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eddb7c36-4b8a-404b-a043-a191ef4bd558 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:57.236841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eddb7c36-4b8a-404b-a043-a191ef4bd558 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:57.237611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eddb7c36-4b8a-404b-a043-a191ef4bd558 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:57.238096 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eddb7c36-4b8a-404b-a043-a191ef4bd558 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:57.241282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6573b498-a22c-440f-bf8d-8d12bd8c2874 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.151554 Mar 08 04:33:57.241964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 824/1592] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:57 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:57.266301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eddb7c36-4b8a-404b-a043-a191ef4bd558 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041161 Mar 08 04:33:57.266836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 769/1593] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:57 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:33:58.258221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cd9b1ccf-b424-4fe8-91fb-d44b33850baf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:58.258830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cd9b1ccf-b424-4fe8-91fb-d44b33850baf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:58.265868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd9b1ccf-b424-4fe8-91fb-d44b33850baf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:58.266317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd9b1ccf-b424-4fe8-91fb-d44b33850baf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:58.267078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd9b1ccf-b424-4fe8-91fb-d44b33850baf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:58.267520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd9b1ccf-b424-4fe8-91fb-d44b33850baf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:58.277565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ef6c6fc6-e068-47eb-a153-e7a0f9e5fe75 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:58.278531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ef6c6fc6-e068-47eb-a153-e7a0f9e5fe75 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:58.284718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef6c6fc6-e068-47eb-a153-e7a0f9e5fe75 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:58.285177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef6c6fc6-e068-47eb-a153-e7a0f9e5fe75 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:58.285983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef6c6fc6-e068-47eb-a153-e7a0f9e5fe75 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:58.286425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef6c6fc6-e068-47eb-a153-e7a0f9e5fe75 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:58.314816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ef6c6fc6-e068-47eb-a153-e7a0f9e5fe75 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041424 Mar 08 04:33:58.315369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 770/1594] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:58 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:33:58.605315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cd9b1ccf-b424-4fe8-91fb-d44b33850baf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:58.613078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cd9b1ccf-b424-4fe8-91fb-d44b33850baf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1450 microversion: 2.1 time: 0.358693 Mar 08 04:33:58.613640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 825/1595] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:58 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1450 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:59.326032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6c591b6b-f7a0-493a-b1ac-4fdfae61efb4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:59.326958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6c591b6b-f7a0-493a-b1ac-4fdfae61efb4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:59.333109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c591b6b-f7a0-493a-b1ac-4fdfae61efb4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:59.333555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c591b6b-f7a0-493a-b1ac-4fdfae61efb4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:59.334347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c591b6b-f7a0-493a-b1ac-4fdfae61efb4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:59.334783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c591b6b-f7a0-493a-b1ac-4fdfae61efb4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:59.362787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6c591b6b-f7a0-493a-b1ac-4fdfae61efb4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Mar 08 04:33:59.363327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 771/1596] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:33:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:33:59.630214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7bf0c8c0-f337-4703-9068-5016419c4b9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:33:59.630824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7bf0c8c0-f337-4703-9068-5016419c4b9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:33:59.637013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bf0c8c0-f337-4703-9068-5016419c4b9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:59.637464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bf0c8c0-f337-4703-9068-5016419c4b9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:59.638870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bf0c8c0-f337-4703-9068-5016419c4b9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:33:59.639308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bf0c8c0-f337-4703-9068-5016419c4b9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:33:59.784926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7bf0c8c0-f337-4703-9068-5016419c4b9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:33:59.792821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7bf0c8c0-f337-4703-9068-5016419c4b9d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1444 microversion: 2.1 time: 0.166369 Mar 08 04:33:59.793391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 826/1597] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:33:59 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:33:59.943857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:33:59.944019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:33:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:34:00.170715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-ba5678c8-5b2c-4d5f-9906-526dbc15e94f req-7c58eefe-ad18-46ce-8b9e-e1c0c617aeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4208bcea-e0a6-4c9d-956c-477a87d388ca", "name": "network-vif-deleted", "tag": "5ed21f05-392d-4365-8c94-f119e23a8232"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:34:00.180750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-ba5678c8-5b2c-4d5f-9906-526dbc15e94f req-7c58eefe-ad18-46ce-8b9e-e1c0c617aeb9 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:00.181353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-ba5678c8-5b2c-4d5f-9906-526dbc15e94f req-7c58eefe-ad18-46ce-8b9e-e1c0c617aeb9 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:00.202557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-ba5678c8-5b2c-4d5f-9906-526dbc15e94f req-7c58eefe-ad18-46ce-8b9e-e1c0c617aeb9 service nova] Creating event network-vif-deleted:5ed21f05-392d-4365-8c94-f119e23a8232 for instance 4208bcea-e0a6-4c9d-956c-477a87d388ca on hv-cinder-73306 Mar 08 04:34:00.207871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-ba5678c8-5b2c-4d5f-9906-526dbc15e94f req-7c58eefe-ad18-46ce-8b9e-e1c0c617aeb9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041976 Mar 08 04:34:00.208461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 772/1598] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:00.374890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-18a85f9c-5d14-4e41-bd09-4259e99a5bdb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:00.375710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-18a85f9c-5d14-4e41-bd09-4259e99a5bdb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:00.381523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-18a85f9c-5d14-4e41-bd09-4259e99a5bdb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:00.382013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-18a85f9c-5d14-4e41-bd09-4259e99a5bdb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:00.382766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-18a85f9c-5d14-4e41-bd09-4259e99a5bdb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:00.383200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-18a85f9c-5d14-4e41-bd09-4259e99a5bdb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:00.411938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-18a85f9c-5d14-4e41-bd09-4259e99a5bdb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041088 Mar 08 04:34:00.412641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 827/1599] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:00.811656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-54422106-6d3d-4b5d-9623-b8a6f56c9e2e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:00.812379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-54422106-6d3d-4b5d-9623-b8a6f56c9e2e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:00.818606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54422106-6d3d-4b5d-9623-b8a6f56c9e2e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:00.819155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54422106-6d3d-4b5d-9623-b8a6f56c9e2e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:00.820177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54422106-6d3d-4b5d-9623-b8a6f56c9e2e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:00.820780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54422106-6d3d-4b5d-9623-b8a6f56c9e2e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:00.934312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-54422106-6d3d-4b5d-9623-b8a6f56c9e2e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:00.942238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-54422106-6d3d-4b5d-9623-b8a6f56c9e2e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.135878 Mar 08 04:34:00.942795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 773/1600] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:00 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:01.424251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5924b724-ed05-4be6-8d2e-a07bbdb9b3fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:01.425154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5924b724-ed05-4be6-8d2e-a07bbdb9b3fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:01.431612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5924b724-ed05-4be6-8d2e-a07bbdb9b3fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:01.432058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5924b724-ed05-4be6-8d2e-a07bbdb9b3fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:01.432817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5924b724-ed05-4be6-8d2e-a07bbdb9b3fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:01.433248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5924b724-ed05-4be6-8d2e-a07bbdb9b3fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:01.460622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5924b724-ed05-4be6-8d2e-a07bbdb9b3fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040420 Mar 08 04:34:01.461160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 828/1601] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:01.959207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f44cf48d-88a4-4585-95d5-894e3d9eef05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:01.959847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f44cf48d-88a4-4585-95d5-894e3d9eef05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:01.966646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f44cf48d-88a4-4585-95d5-894e3d9eef05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:01.967230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f44cf48d-88a4-4585-95d5-894e3d9eef05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:01.967988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f44cf48d-88a4-4585-95d5-894e3d9eef05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:01.968420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f44cf48d-88a4-4585-95d5-894e3d9eef05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:02.026007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f44cf48d-88a4-4585-95d5-894e3d9eef05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:02.033475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f44cf48d-88a4-4585-95d5-894e3d9eef05 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078119 Mar 08 04:34:02.034057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 774/1602] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:01 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:02.472451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-31cae789-dad4-4ad8-8390-ffbe22a1e665 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:02.473406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-31cae789-dad4-4ad8-8390-ffbe22a1e665 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:02.479603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31cae789-dad4-4ad8-8390-ffbe22a1e665 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:02.480047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31cae789-dad4-4ad8-8390-ffbe22a1e665 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:02.480806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31cae789-dad4-4ad8-8390-ffbe22a1e665 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:02.481238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31cae789-dad4-4ad8-8390-ffbe22a1e665 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:02.509334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-31cae789-dad4-4ad8-8390-ffbe22a1e665 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 Mar 08 04:34:02.509910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 829/1603] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:03.049823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ef1e9526-16ba-4e71-b7f1-3023c4e0f2e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:03.050436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ef1e9526-16ba-4e71-b7f1-3023c4e0f2e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:03.056624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef1e9526-16ba-4e71-b7f1-3023c4e0f2e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:03.057078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef1e9526-16ba-4e71-b7f1-3023c4e0f2e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:03.057870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef1e9526-16ba-4e71-b7f1-3023c4e0f2e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:03.058310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef1e9526-16ba-4e71-b7f1-3023c4e0f2e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:03.119608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ef1e9526-16ba-4e71-b7f1-3023c4e0f2e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:03.127407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ef1e9526-16ba-4e71-b7f1-3023c4e0f2e7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081440 Mar 08 04:34:03.127973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 775/1604] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:03 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:03.520686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-eb459093-2b5c-4f2b-b041-582227bc1c38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:03.521596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-eb459093-2b5c-4f2b-b041-582227bc1c38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:03.528084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb459093-2b5c-4f2b-b041-582227bc1c38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:03.528530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb459093-2b5c-4f2b-b041-582227bc1c38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:03.529290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb459093-2b5c-4f2b-b041-582227bc1c38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:03.529755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb459093-2b5c-4f2b-b041-582227bc1c38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:03.557074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-eb459093-2b5c-4f2b-b041-582227bc1c38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040526 Mar 08 04:34:03.557609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 830/1605] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:03 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:04.143803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-85cd09a7-548f-42c3-ab13-a6c739e2fb6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:04.144407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-85cd09a7-548f-42c3-ab13-a6c739e2fb6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:04.150608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85cd09a7-548f-42c3-ab13-a6c739e2fb6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:04.151052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85cd09a7-548f-42c3-ab13-a6c739e2fb6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:04.152079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85cd09a7-548f-42c3-ab13-a6c739e2fb6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:04.152506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85cd09a7-548f-42c3-ab13-a6c739e2fb6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:04.210615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-85cd09a7-548f-42c3-ab13-a6c739e2fb6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:04.218335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-85cd09a7-548f-42c3-ab13-a6c739e2fb6d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078513 Mar 08 04:34:04.218899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 776/1606] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:04 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:04.569817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1f966dd8-f22a-4e95-8908-cb042eafd65d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:04.570718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1f966dd8-f22a-4e95-8908-cb042eafd65d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:04.577447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f966dd8-f22a-4e95-8908-cb042eafd65d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:04.577917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f966dd8-f22a-4e95-8908-cb042eafd65d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:04.578678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f966dd8-f22a-4e95-8908-cb042eafd65d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:04.579107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f966dd8-f22a-4e95-8908-cb042eafd65d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:04.607318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1f966dd8-f22a-4e95-8908-cb042eafd65d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041575 Mar 08 04:34:04.607860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 831/1607] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:04 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:05.235075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c1d4dd15-cb70-4df5-bac1-868c14332868 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:05.235690 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c1d4dd15-cb70-4df5-bac1-868c14332868 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:05.242004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1d4dd15-cb70-4df5-bac1-868c14332868 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:05.242456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1d4dd15-cb70-4df5-bac1-868c14332868 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:05.243266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1d4dd15-cb70-4df5-bac1-868c14332868 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:05.243701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1d4dd15-cb70-4df5-bac1-868c14332868 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:05.301934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c1d4dd15-cb70-4df5-bac1-868c14332868 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:05.309170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c1d4dd15-cb70-4df5-bac1-868c14332868 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078166 Mar 08 04:34:05.310261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 777/1608] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:05.617975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dbfa380d-c3a0-4bdf-b482-e88914886524 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:05.618880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dbfa380d-c3a0-4bdf-b482-e88914886524 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:05.625945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbfa380d-c3a0-4bdf-b482-e88914886524 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:05.626390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbfa380d-c3a0-4bdf-b482-e88914886524 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:05.627145 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbfa380d-c3a0-4bdf-b482-e88914886524 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:05.627574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbfa380d-c3a0-4bdf-b482-e88914886524 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:05.656557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dbfa380d-c3a0-4bdf-b482-e88914886524 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042574 Mar 08 04:34:05.657091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 832/1609] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:06.327118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-49219731-c2ba-442a-8d1a-83bf95c301e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:06.327728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-49219731-c2ba-442a-8d1a-83bf95c301e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:06.333530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-49219731-c2ba-442a-8d1a-83bf95c301e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:06.334012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-49219731-c2ba-442a-8d1a-83bf95c301e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:06.334757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-49219731-c2ba-442a-8d1a-83bf95c301e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:06.335208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-49219731-c2ba-442a-8d1a-83bf95c301e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:06.392877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-49219731-c2ba-442a-8d1a-83bf95c301e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:06.400034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-49219731-c2ba-442a-8d1a-83bf95c301e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077433 Mar 08 04:34:06.400581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 778/1610] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:06.667963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f30cf8a5-8dec-4c8e-9372-834e0e135486 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:06.669104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f30cf8a5-8dec-4c8e-9372-834e0e135486 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:06.675371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f30cf8a5-8dec-4c8e-9372-834e0e135486 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:06.675819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f30cf8a5-8dec-4c8e-9372-834e0e135486 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:06.676581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f30cf8a5-8dec-4c8e-9372-834e0e135486 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:06.677019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f30cf8a5-8dec-4c8e-9372-834e0e135486 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:06.705336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f30cf8a5-8dec-4c8e-9372-834e0e135486 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041342 Mar 08 04:34:06.705900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 833/1611] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:07.417300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9002b3f5-0b38-47eb-897f-68aa5b1bcb1e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:07.417940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9002b3f5-0b38-47eb-897f-68aa5b1bcb1e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:07.424685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9002b3f5-0b38-47eb-897f-68aa5b1bcb1e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:07.425131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9002b3f5-0b38-47eb-897f-68aa5b1bcb1e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:07.425915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9002b3f5-0b38-47eb-897f-68aa5b1bcb1e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:07.426348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9002b3f5-0b38-47eb-897f-68aa5b1bcb1e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:07.484869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9002b3f5-0b38-47eb-897f-68aa5b1bcb1e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:07.492053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9002b3f5-0b38-47eb-897f-68aa5b1bcb1e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078609 Mar 08 04:34:07.492608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 779/1612] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:07.717567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-88686b52-ba7f-4a20-9d15-f0eebedc1c77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:07.718473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-88686b52-ba7f-4a20-9d15-f0eebedc1c77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:07.724690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88686b52-ba7f-4a20-9d15-f0eebedc1c77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:07.725129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88686b52-ba7f-4a20-9d15-f0eebedc1c77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:07.725916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88686b52-ba7f-4a20-9d15-f0eebedc1c77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:07.726349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-88686b52-ba7f-4a20-9d15-f0eebedc1c77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:07.753158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-88686b52-ba7f-4a20-9d15-f0eebedc1c77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040250 Mar 08 04:34:07.753706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 834/1613] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:07 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:08.508239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-900223b6-6f6c-4351-a3a8-3ea735ded2c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:08.508841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-900223b6-6f6c-4351-a3a8-3ea735ded2c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:08.515191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-900223b6-6f6c-4351-a3a8-3ea735ded2c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:08.515633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-900223b6-6f6c-4351-a3a8-3ea735ded2c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:08.516384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-900223b6-6f6c-4351-a3a8-3ea735ded2c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:08.516814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-900223b6-6f6c-4351-a3a8-3ea735ded2c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:08.575594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-900223b6-6f6c-4351-a3a8-3ea735ded2c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:08.582733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-900223b6-6f6c-4351-a3a8-3ea735ded2c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078342 Mar 08 04:34:08.583286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 780/1614] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:08 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:08.764266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-61fba926-20f2-49a6-b018-6fb93cc26a7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:08.765211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-61fba926-20f2-49a6-b018-6fb93cc26a7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:08.771456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61fba926-20f2-49a6-b018-6fb93cc26a7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:08.771900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61fba926-20f2-49a6-b018-6fb93cc26a7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:08.772683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61fba926-20f2-49a6-b018-6fb93cc26a7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:08.773117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61fba926-20f2-49a6-b018-6fb93cc26a7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:08.802911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-61fba926-20f2-49a6-b018-6fb93cc26a7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042795 Mar 08 04:34:08.803464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 835/1615] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:08 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:09.599683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ccc7f04b-0bcd-4b02-9664-666f605826d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:09.600290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ccc7f04b-0bcd-4b02-9664-666f605826d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:09.606515 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccc7f04b-0bcd-4b02-9664-666f605826d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:09.606965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccc7f04b-0bcd-4b02-9664-666f605826d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:09.607722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccc7f04b-0bcd-4b02-9664-666f605826d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:09.608163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccc7f04b-0bcd-4b02-9664-666f605826d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:09.669104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ccc7f04b-0bcd-4b02-9664-666f605826d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:09.676396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ccc7f04b-0bcd-4b02-9664-666f605826d9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080580 Mar 08 04:34:09.676952 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 781/1616] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:09.814794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c86fd2cb-85e6-4ebb-a102-c45825034460 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:09.815704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c86fd2cb-85e6-4ebb-a102-c45825034460 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:09.822290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c86fd2cb-85e6-4ebb-a102-c45825034460 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:09.822756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c86fd2cb-85e6-4ebb-a102-c45825034460 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:09.823532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c86fd2cb-85e6-4ebb-a102-c45825034460 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:09.824008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c86fd2cb-85e6-4ebb-a102-c45825034460 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:09.852682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c86fd2cb-85e6-4ebb-a102-c45825034460 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041697 Mar 08 04:34:09.853160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 836/1617] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:09 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:10.694290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-78332246-2c07-473a-915d-1efd98b41dcf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:10.694904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-78332246-2c07-473a-915d-1efd98b41dcf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:10.701100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78332246-2c07-473a-915d-1efd98b41dcf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:10.701550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78332246-2c07-473a-915d-1efd98b41dcf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:10.702347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78332246-2c07-473a-915d-1efd98b41dcf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:10.702787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78332246-2c07-473a-915d-1efd98b41dcf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:10.760357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-78332246-2c07-473a-915d-1efd98b41dcf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:10.767886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-78332246-2c07-473a-915d-1efd98b41dcf tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077470 Mar 08 04:34:10.768445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 782/1618] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:10 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:34:10.864607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-580fc6c0-b32e-41ec-823d-686f49e6dbc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:10.865561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-580fc6c0-b32e-41ec-823d-686f49e6dbc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:10.872474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-580fc6c0-b32e-41ec-823d-686f49e6dbc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:10.872940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-580fc6c0-b32e-41ec-823d-686f49e6dbc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:10.873728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-580fc6c0-b32e-41ec-823d-686f49e6dbc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:10.874168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-580fc6c0-b32e-41ec-823d-686f49e6dbc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:10.902317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-580fc6c0-b32e-41ec-823d-686f49e6dbc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041501 Mar 08 04:34:10.902872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 837/1619] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:10 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:11.784274 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-930b1da0-7d80-48d9-9e6a-4d764c923769 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:11.784881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-930b1da0-7d80-48d9-9e6a-4d764c923769 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:11.791099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-930b1da0-7d80-48d9-9e6a-4d764c923769 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:11.791548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-930b1da0-7d80-48d9-9e6a-4d764c923769 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:11.792308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-930b1da0-7d80-48d9-9e6a-4d764c923769 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:11.792742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-930b1da0-7d80-48d9-9e6a-4d764c923769 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:11.852011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-930b1da0-7d80-48d9-9e6a-4d764c923769 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:11.859797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-930b1da0-7d80-48d9-9e6a-4d764c923769 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079367 Mar 08 04:34:11.860357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 783/1620] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:11 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:11.913861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-44e923e4-f5c9-48a8-9fe0-3715b646e48c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:11.914777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-44e923e4-f5c9-48a8-9fe0-3715b646e48c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:11.921151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44e923e4-f5c9-48a8-9fe0-3715b646e48c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:11.921604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44e923e4-f5c9-48a8-9fe0-3715b646e48c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:11.922400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44e923e4-f5c9-48a8-9fe0-3715b646e48c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:11.922840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44e923e4-f5c9-48a8-9fe0-3715b646e48c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:11.951518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-44e923e4-f5c9-48a8-9fe0-3715b646e48c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041575 Mar 08 04:34:11.952068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 838/1621] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:12.876472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d9e35c1c-3c1e-4dd4-83f7-147874b862e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:12.877083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d9e35c1c-3c1e-4dd4-83f7-147874b862e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:12.883376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9e35c1c-3c1e-4dd4-83f7-147874b862e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:12.883828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9e35c1c-3c1e-4dd4-83f7-147874b862e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:12.884591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9e35c1c-3c1e-4dd4-83f7-147874b862e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:12.885029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9e35c1c-3c1e-4dd4-83f7-147874b862e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:12.943075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d9e35c1c-3c1e-4dd4-83f7-147874b862e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:12.950940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d9e35c1c-3c1e-4dd4-83f7-147874b862e9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078437 Mar 08 04:34:12.951493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 784/1622] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:12 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:12.963689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fc4ca24a-ff0c-4b7e-bfaf-f5ec9032c7c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:12.964603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fc4ca24a-ff0c-4b7e-bfaf-f5ec9032c7c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:12.971468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc4ca24a-ff0c-4b7e-bfaf-f5ec9032c7c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:12.971916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc4ca24a-ff0c-4b7e-bfaf-f5ec9032c7c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:12.972684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc4ca24a-ff0c-4b7e-bfaf-f5ec9032c7c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:12.973122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc4ca24a-ff0c-4b7e-bfaf-f5ec9032c7c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:13.000398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fc4ca24a-ff0c-4b7e-bfaf-f5ec9032c7c9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040625 Mar 08 04:34:13.000945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 839/1623] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:13.967613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0e6390ff-6031-48f0-9b0a-3ff8b899809f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:13.968216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0e6390ff-6031-48f0-9b0a-3ff8b899809f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:13.974425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e6390ff-6031-48f0-9b0a-3ff8b899809f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:13.974868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e6390ff-6031-48f0-9b0a-3ff8b899809f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:13.975624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e6390ff-6031-48f0-9b0a-3ff8b899809f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:13.976054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e6390ff-6031-48f0-9b0a-3ff8b899809f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:14.011690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f219eb97-22f0-4436-ad38-c45fce4e421d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:14.012598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f219eb97-22f0-4436-ad38-c45fce4e421d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:14.018784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f219eb97-22f0-4436-ad38-c45fce4e421d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:14.019230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f219eb97-22f0-4436-ad38-c45fce4e421d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:14.019991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f219eb97-22f0-4436-ad38-c45fce4e421d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:14.020428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f219eb97-22f0-4436-ad38-c45fce4e421d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:14.034813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0e6390ff-6031-48f0-9b0a-3ff8b899809f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:14.042153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0e6390ff-6031-48f0-9b0a-3ff8b899809f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079046 Mar 08 04:34:14.042721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 785/1624] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:13 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:14.049785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f219eb97-22f0-4436-ad38-c45fce4e421d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Mar 08 04:34:14.050335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 840/1625] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:34:15.060248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1f753c7c-cdf6-4211-b225-3b2d15dd4237 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:15.060855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1f753c7c-cdf6-4211-b225-3b2d15dd4237 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:15.061028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-11cf046a-d676-4530-b9be-98bea0c10aee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:15.061966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-11cf046a-d676-4530-b9be-98bea0c10aee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:15.067503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f753c7c-cdf6-4211-b225-3b2d15dd4237 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:15.067957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f753c7c-cdf6-4211-b225-3b2d15dd4237 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:15.068076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11cf046a-d676-4530-b9be-98bea0c10aee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:15.068478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11cf046a-d676-4530-b9be-98bea0c10aee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:15.068724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f753c7c-cdf6-4211-b225-3b2d15dd4237 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:15.069160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f753c7c-cdf6-4211-b225-3b2d15dd4237 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:15.069265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11cf046a-d676-4530-b9be-98bea0c10aee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:15.069761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-11cf046a-d676-4530-b9be-98bea0c10aee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:15.098055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-11cf046a-d676-4530-b9be-98bea0c10aee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041370 Mar 08 04:34:15.098613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 841/1626] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:15 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:34:15.131234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1f753c7c-cdf6-4211-b225-3b2d15dd4237 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:15.140064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1f753c7c-cdf6-4211-b225-3b2d15dd4237 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.083818 Mar 08 04:34:15.141068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 786/1627] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:15 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:16.109031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-20ec64f2-c4ed-4853-b605-625ccbd651cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:16.109896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-20ec64f2-c4ed-4853-b605-625ccbd651cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:16.116105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20ec64f2-c4ed-4853-b605-625ccbd651cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:16.116551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20ec64f2-c4ed-4853-b605-625ccbd651cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:16.117315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20ec64f2-c4ed-4853-b605-625ccbd651cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:16.117780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20ec64f2-c4ed-4853-b605-625ccbd651cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:16.145707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-20ec64f2-c4ed-4853-b605-625ccbd651cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040688 Mar 08 04:34:16.146254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 842/1628] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:16 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:16.157257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-beb5de3d-661b-4854-a866-1d0ff313729e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:16.157891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-beb5de3d-661b-4854-a866-1d0ff313729e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:16.164061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-beb5de3d-661b-4854-a866-1d0ff313729e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:16.164505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-beb5de3d-661b-4854-a866-1d0ff313729e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:16.165252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-beb5de3d-661b-4854-a866-1d0ff313729e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:16.165700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-beb5de3d-661b-4854-a866-1d0ff313729e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:16.226365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-beb5de3d-661b-4854-a866-1d0ff313729e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:16.233797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-beb5de3d-661b-4854-a866-1d0ff313729e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081224 Mar 08 04:34:16.234356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 787/1629] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:17.157186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-de64c8ba-e492-4c62-a9fb-5d53064a3a39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:17.158130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-de64c8ba-e492-4c62-a9fb-5d53064a3a39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:17.164303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de64c8ba-e492-4c62-a9fb-5d53064a3a39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:17.164749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de64c8ba-e492-4c62-a9fb-5d53064a3a39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:17.165515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de64c8ba-e492-4c62-a9fb-5d53064a3a39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:17.165981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de64c8ba-e492-4c62-a9fb-5d53064a3a39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:17.193529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-de64c8ba-e492-4c62-a9fb-5d53064a3a39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040844 Mar 08 04:34:17.194112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 843/1630] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:17.250804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d8722d53-9bf6-4d7c-8ae0-a99032f75d84 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:17.251410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d8722d53-9bf6-4d7c-8ae0-a99032f75d84 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:17.257650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8722d53-9bf6-4d7c-8ae0-a99032f75d84 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:17.258127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8722d53-9bf6-4d7c-8ae0-a99032f75d84 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:17.258874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8722d53-9bf6-4d7c-8ae0-a99032f75d84 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:17.259301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8722d53-9bf6-4d7c-8ae0-a99032f75d84 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:17.317409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d8722d53-9bf6-4d7c-8ae0-a99032f75d84 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:17.324576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d8722d53-9bf6-4d7c-8ae0-a99032f75d84 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078059 Mar 08 04:34:17.325934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 788/1631] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:17 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:18.205346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c6e20aad-dca4-4593-a3cb-85ba2250fb3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:18.206272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c6e20aad-dca4-4593-a3cb-85ba2250fb3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:18.212062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6e20aad-dca4-4593-a3cb-85ba2250fb3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:18.212515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6e20aad-dca4-4593-a3cb-85ba2250fb3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:18.213269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6e20aad-dca4-4593-a3cb-85ba2250fb3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:18.213732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c6e20aad-dca4-4593-a3cb-85ba2250fb3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:18.241891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c6e20aad-dca4-4593-a3cb-85ba2250fb3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040656 Mar 08 04:34:18.242438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 844/1632] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:18 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:18.341933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f76c8729-2fc2-40e2-8d07-0ff86dd0a0d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:18.342537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f76c8729-2fc2-40e2-8d07-0ff86dd0a0d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:18.348710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f76c8729-2fc2-40e2-8d07-0ff86dd0a0d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:18.349153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f76c8729-2fc2-40e2-8d07-0ff86dd0a0d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:18.349926 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f76c8729-2fc2-40e2-8d07-0ff86dd0a0d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:18.350357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f76c8729-2fc2-40e2-8d07-0ff86dd0a0d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:18.410561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f76c8729-2fc2-40e2-8d07-0ff86dd0a0d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:18.419105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f76c8729-2fc2-40e2-8d07-0ff86dd0a0d5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080565 Mar 08 04:34:18.419744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 789/1633] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:18 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:18.691825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:34:18.692048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:34:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:34:19.252986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cc0d156d-e529-4506-9dbe-8c5210c25828 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:19.253953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cc0d156d-e529-4506-9dbe-8c5210c25828 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:19.260156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc0d156d-e529-4506-9dbe-8c5210c25828 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:19.260607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc0d156d-e529-4506-9dbe-8c5210c25828 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:19.261375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc0d156d-e529-4506-9dbe-8c5210c25828 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:19.261905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc0d156d-e529-4506-9dbe-8c5210c25828 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:19.295669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cc0d156d-e529-4506-9dbe-8c5210c25828 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046645 Mar 08 04:34:19.296216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 845/1634] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:19 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:19.436402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-930568b1-dbbc-4e87-84c9-b2a7e7072511 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:19.437045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-930568b1-dbbc-4e87-84c9-b2a7e7072511 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:19.443379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-930568b1-dbbc-4e87-84c9-b2a7e7072511 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:19.443830 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-930568b1-dbbc-4e87-84c9-b2a7e7072511 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:19.444595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-930568b1-dbbc-4e87-84c9-b2a7e7072511 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:19.445034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-930568b1-dbbc-4e87-84c9-b2a7e7072511 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:19.502994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-930568b1-dbbc-4e87-84c9-b2a7e7072511 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:19.510077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-930568b1-dbbc-4e87-84c9-b2a7e7072511 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078129 Mar 08 04:34:19.510620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 790/1635] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:20.307339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1205e9c3-30d6-4c69-9bec-65397eae8afd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:20.308245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1205e9c3-30d6-4c69-9bec-65397eae8afd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:20.314668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1205e9c3-30d6-4c69-9bec-65397eae8afd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:20.315114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1205e9c3-30d6-4c69-9bec-65397eae8afd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:20.315873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1205e9c3-30d6-4c69-9bec-65397eae8afd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:20.316305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1205e9c3-30d6-4c69-9bec-65397eae8afd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:20.344574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1205e9c3-30d6-4c69-9bec-65397eae8afd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041161 Mar 08 04:34:20.345111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 846/1636] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:20.527714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-389cab4c-6062-420f-8aa5-96c3b1d15793 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:20.528888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-389cab4c-6062-420f-8aa5-96c3b1d15793 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:20.535109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-389cab4c-6062-420f-8aa5-96c3b1d15793 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:20.535550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-389cab4c-6062-420f-8aa5-96c3b1d15793 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:20.536304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-389cab4c-6062-420f-8aa5-96c3b1d15793 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:20.536733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-389cab4c-6062-420f-8aa5-96c3b1d15793 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:20.594749 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-389cab4c-6062-420f-8aa5-96c3b1d15793 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:20.601922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-389cab4c-6062-420f-8aa5-96c3b1d15793 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078388 Mar 08 04:34:20.602476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 791/1637] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:20 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:21.355694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-27666197-1369-4fee-8456-a3091b4b03f6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:21.357243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-27666197-1369-4fee-8456-a3091b4b03f6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:21.363409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27666197-1369-4fee-8456-a3091b4b03f6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:21.363852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27666197-1369-4fee-8456-a3091b4b03f6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:21.364607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27666197-1369-4fee-8456-a3091b4b03f6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:21.365040 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27666197-1369-4fee-8456-a3091b4b03f6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:21.392701 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-27666197-1369-4fee-8456-a3091b4b03f6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040951 Mar 08 04:34:21.393174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 847/1638] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:21 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:21.618849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7b75c93b-476d-4748-8e6a-d35df60781f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:21.619451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7b75c93b-476d-4748-8e6a-d35df60781f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:21.625677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b75c93b-476d-4748-8e6a-d35df60781f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:21.626129 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b75c93b-476d-4748-8e6a-d35df60781f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:21.626877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b75c93b-476d-4748-8e6a-d35df60781f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:21.627306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b75c93b-476d-4748-8e6a-d35df60781f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:21.685498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7b75c93b-476d-4748-8e6a-d35df60781f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:21.692637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7b75c93b-476d-4748-8e6a-d35df60781f0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077669 Mar 08 04:34:21.693188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 792/1639] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:21 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:22.404456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4f5bcfd0-add0-46fa-b6ee-49a62ce1d3d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:22.405369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4f5bcfd0-add0-46fa-b6ee-49a62ce1d3d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:22.411795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f5bcfd0-add0-46fa-b6ee-49a62ce1d3d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:22.412247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f5bcfd0-add0-46fa-b6ee-49a62ce1d3d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:22.413042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f5bcfd0-add0-46fa-b6ee-49a62ce1d3d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:22.413483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f5bcfd0-add0-46fa-b6ee-49a62ce1d3d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:22.441716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4f5bcfd0-add0-46fa-b6ee-49a62ce1d3d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041465 Mar 08 04:34:22.442267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 848/1640] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:22.709386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0e97339f-6ed8-4344-a96d-e73482daa07c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:22.710023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0e97339f-6ed8-4344-a96d-e73482daa07c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:22.716505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e97339f-6ed8-4344-a96d-e73482daa07c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:22.716951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e97339f-6ed8-4344-a96d-e73482daa07c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:22.717739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e97339f-6ed8-4344-a96d-e73482daa07c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:22.718171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e97339f-6ed8-4344-a96d-e73482daa07c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:22.781071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0e97339f-6ed8-4344-a96d-e73482daa07c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:22.789627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0e97339f-6ed8-4344-a96d-e73482daa07c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.083989 Mar 08 04:34:22.790378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 793/1641] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:22 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:23.454081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7782480b-29bc-41f2-ad28-7efadc58ba9e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:23.455020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7782480b-29bc-41f2-ad28-7efadc58ba9e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:23.461248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7782480b-29bc-41f2-ad28-7efadc58ba9e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:23.461728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7782480b-29bc-41f2-ad28-7efadc58ba9e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:23.462492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7782480b-29bc-41f2-ad28-7efadc58ba9e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:23.462929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7782480b-29bc-41f2-ad28-7efadc58ba9e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:23.490919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7782480b-29bc-41f2-ad28-7efadc58ba9e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041646 Mar 08 04:34:23.491461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 849/1642] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:23.807653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3da4214b-7371-487e-9322-a155515a0442 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:23.808240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3da4214b-7371-487e-9322-a155515a0442 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:23.814993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3da4214b-7371-487e-9322-a155515a0442 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:23.815440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3da4214b-7371-487e-9322-a155515a0442 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:23.816186 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3da4214b-7371-487e-9322-a155515a0442 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:23.816616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3da4214b-7371-487e-9322-a155515a0442 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:23.874569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3da4214b-7371-487e-9322-a155515a0442 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:23.881698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3da4214b-7371-487e-9322-a155515a0442 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078079 Mar 08 04:34:23.882250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 794/1643] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:24.502883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8812010f-c7a4-4572-952d-0b9bc46c7bc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:24.503786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8812010f-c7a4-4572-952d-0b9bc46c7bc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:24.510005 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8812010f-c7a4-4572-952d-0b9bc46c7bc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:24.510451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8812010f-c7a4-4572-952d-0b9bc46c7bc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:24.511208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8812010f-c7a4-4572-952d-0b9bc46c7bc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:24.511640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8812010f-c7a4-4572-952d-0b9bc46c7bc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:24.539427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8812010f-c7a4-4572-952d-0b9bc46c7bc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040552 Mar 08 04:34:24.539966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 850/1644] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:34:24.898916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0680500f-128c-4647-9f47-dc82f3a59e3b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:24.899517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0680500f-128c-4647-9f47-dc82f3a59e3b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:24.906227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0680500f-128c-4647-9f47-dc82f3a59e3b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:24.906681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0680500f-128c-4647-9f47-dc82f3a59e3b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:24.907422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0680500f-128c-4647-9f47-dc82f3a59e3b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:24.907853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0680500f-128c-4647-9f47-dc82f3a59e3b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:24.965549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0680500f-128c-4647-9f47-dc82f3a59e3b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:24.972772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0680500f-128c-4647-9f47-dc82f3a59e3b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077811 Mar 08 04:34:24.973409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 795/1645] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:24 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:25.551112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2360ad90-ba15-4dfc-a80d-1b4c49f981da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:25.552017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2360ad90-ba15-4dfc-a80d-1b4c49f981da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:25.558189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2360ad90-ba15-4dfc-a80d-1b4c49f981da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:25.558635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2360ad90-ba15-4dfc-a80d-1b4c49f981da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:25.559396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2360ad90-ba15-4dfc-a80d-1b4c49f981da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:25.559825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2360ad90-ba15-4dfc-a80d-1b4c49f981da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:25.587237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2360ad90-ba15-4dfc-a80d-1b4c49f981da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040184 Mar 08 04:34:25.587772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 851/1646] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:25.990438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d939a9a2-d47e-43c9-aae1-e767b644e7b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:25.991043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d939a9a2-d47e-43c9-aae1-e767b644e7b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:25.997892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d939a9a2-d47e-43c9-aae1-e767b644e7b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:25.998341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d939a9a2-d47e-43c9-aae1-e767b644e7b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:25.999099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d939a9a2-d47e-43c9-aae1-e767b644e7b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:25.999530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d939a9a2-d47e-43c9-aae1-e767b644e7b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:26.057103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d939a9a2-d47e-43c9-aae1-e767b644e7b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:26.064755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d939a9a2-d47e-43c9-aae1-e767b644e7b2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078193 Mar 08 04:34:26.065305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 796/1647] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:34:26.599561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a8f05e36-fcf9-484a-adf3-cb4acf4a9b7d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:26.600466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a8f05e36-fcf9-484a-adf3-cb4acf4a9b7d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:26.607386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f05e36-fcf9-484a-adf3-cb4acf4a9b7d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:26.607887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f05e36-fcf9-484a-adf3-cb4acf4a9b7d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:26.608646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f05e36-fcf9-484a-adf3-cb4acf4a9b7d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:26.609084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8f05e36-fcf9-484a-adf3-cb4acf4a9b7d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:26.639012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a8f05e36-fcf9-484a-adf3-cb4acf4a9b7d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 Mar 08 04:34:26.639555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 852/1648] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:26 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:27.081357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7542670f-3503-4492-8c77-a4882933f503 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:27.081982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7542670f-3503-4492-8c77-a4882933f503 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:27.088236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7542670f-3503-4492-8c77-a4882933f503 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:27.088683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7542670f-3503-4492-8c77-a4882933f503 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:27.089443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7542670f-3503-4492-8c77-a4882933f503 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:27.089908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7542670f-3503-4492-8c77-a4882933f503 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:27.156153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7542670f-3503-4492-8c77-a4882933f503 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:27.163464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7542670f-3503-4492-8c77-a4882933f503 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.085942 Mar 08 04:34:27.164017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 797/1649] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:27 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:27.650634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7235ecf6-a908-4974-ab52-9a1b12279a94 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:27.651548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7235ecf6-a908-4974-ab52-9a1b12279a94 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:27.658160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7235ecf6-a908-4974-ab52-9a1b12279a94 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:27.658610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7235ecf6-a908-4974-ab52-9a1b12279a94 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:27.659374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7235ecf6-a908-4974-ab52-9a1b12279a94 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:27.659812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7235ecf6-a908-4974-ab52-9a1b12279a94 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:27.687315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7235ecf6-a908-4974-ab52-9a1b12279a94 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040729 Mar 08 04:34:27.687852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 853/1650] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:27 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:28.180196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e996993a-7270-43dd-bbe9-1fa4dd3cd8ad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:28.180805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e996993a-7270-43dd-bbe9-1fa4dd3cd8ad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:28.188367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e996993a-7270-43dd-bbe9-1fa4dd3cd8ad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:28.188812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e996993a-7270-43dd-bbe9-1fa4dd3cd8ad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:28.189570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e996993a-7270-43dd-bbe9-1fa4dd3cd8ad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:28.190030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e996993a-7270-43dd-bbe9-1fa4dd3cd8ad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:28.247961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e996993a-7270-43dd-bbe9-1fa4dd3cd8ad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:28.255222 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e996993a-7270-43dd-bbe9-1fa4dd3cd8ad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078848 Mar 08 04:34:28.255779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 798/1651] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:28 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:28.698334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d130b188-0b44-436c-8132-38e4713bb15f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:28.699773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d130b188-0b44-436c-8132-38e4713bb15f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:28.706016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d130b188-0b44-436c-8132-38e4713bb15f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:28.706460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d130b188-0b44-436c-8132-38e4713bb15f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:28.707216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d130b188-0b44-436c-8132-38e4713bb15f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:28.707649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d130b188-0b44-436c-8132-38e4713bb15f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:28.735922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d130b188-0b44-436c-8132-38e4713bb15f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041508 Mar 08 04:34:28.736464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 854/1652] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:28 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:29.272433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0b28fdb2-5e2e-4091-b9c2-b72df62d40dc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:29.273041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0b28fdb2-5e2e-4091-b9c2-b72df62d40dc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:29.279741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b28fdb2-5e2e-4091-b9c2-b72df62d40dc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:29.280190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b28fdb2-5e2e-4091-b9c2-b72df62d40dc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:29.281069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b28fdb2-5e2e-4091-b9c2-b72df62d40dc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:29.281624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0b28fdb2-5e2e-4091-b9c2-b72df62d40dc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:29.345145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0b28fdb2-5e2e-4091-b9c2-b72df62d40dc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:29.352332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0b28fdb2-5e2e-4091-b9c2-b72df62d40dc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.083843 Mar 08 04:34:29.352887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 799/1653] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:29 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:29.751113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-67ac786f-2aea-4a7d-9734-c24290ab9e82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:29.752033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-67ac786f-2aea-4a7d-9734-c24290ab9e82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:29.758871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67ac786f-2aea-4a7d-9734-c24290ab9e82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:29.759316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67ac786f-2aea-4a7d-9734-c24290ab9e82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:29.760081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67ac786f-2aea-4a7d-9734-c24290ab9e82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:29.760514 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67ac786f-2aea-4a7d-9734-c24290ab9e82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:29.790111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-67ac786f-2aea-4a7d-9734-c24290ab9e82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046685 Mar 08 04:34:29.790659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 855/1654] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:30.369751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dfa09f58-d9c8-48db-ac77-fa5edd5381a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:30.370354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dfa09f58-d9c8-48db-ac77-fa5edd5381a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:30.376643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dfa09f58-d9c8-48db-ac77-fa5edd5381a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:30.377093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dfa09f58-d9c8-48db-ac77-fa5edd5381a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:30.377880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dfa09f58-d9c8-48db-ac77-fa5edd5381a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:30.378316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dfa09f58-d9c8-48db-ac77-fa5edd5381a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:30.438838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dfa09f58-d9c8-48db-ac77-fa5edd5381a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:30.446217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dfa09f58-d9c8-48db-ac77-fa5edd5381a8 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080364 Mar 08 04:34:30.446770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 800/1655] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:30 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:30.802378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-94a448fb-a0ec-4789-b6c3-92804cdb142b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:30.803285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-94a448fb-a0ec-4789-b6c3-92804cdb142b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:30.810566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94a448fb-a0ec-4789-b6c3-92804cdb142b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:30.811019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94a448fb-a0ec-4789-b6c3-92804cdb142b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:30.811808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94a448fb-a0ec-4789-b6c3-92804cdb142b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:30.812231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94a448fb-a0ec-4789-b6c3-92804cdb142b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:30.841527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-94a448fb-a0ec-4789-b6c3-92804cdb142b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Mar 08 04:34:30.842167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 856/1656] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:31.462937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-12cbd04c-99c2-4e84-9f28-148f20e3ead6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:31.463536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-12cbd04c-99c2-4e84-9f28-148f20e3ead6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:31.470340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12cbd04c-99c2-4e84-9f28-148f20e3ead6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:31.470782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12cbd04c-99c2-4e84-9f28-148f20e3ead6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:31.471531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12cbd04c-99c2-4e84-9f28-148f20e3ead6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:31.471962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12cbd04c-99c2-4e84-9f28-148f20e3ead6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:31.529652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-12cbd04c-99c2-4e84-9f28-148f20e3ead6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:31.536860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-12cbd04c-99c2-4e84-9f28-148f20e3ead6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077822 Mar 08 04:34:31.537418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 801/1657] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:31 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:31.853290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-79e260da-9699-441b-97ee-c54a69319976 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:31.854335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-79e260da-9699-441b-97ee-c54a69319976 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:31.860678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79e260da-9699-441b-97ee-c54a69319976 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:31.861103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79e260da-9699-441b-97ee-c54a69319976 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:31.861885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79e260da-9699-441b-97ee-c54a69319976 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:31.862317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79e260da-9699-441b-97ee-c54a69319976 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:31.890342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-79e260da-9699-441b-97ee-c54a69319976 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041085 Mar 08 04:34:31.890885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 857/1658] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:31 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:32.554156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a2d3b05d-c7d2-40fd-a179-45429e0abe9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:32.554755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a2d3b05d-c7d2-40fd-a179-45429e0abe9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:32.561538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2d3b05d-c7d2-40fd-a179-45429e0abe9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:32.562073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2d3b05d-c7d2-40fd-a179-45429e0abe9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:32.562832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2d3b05d-c7d2-40fd-a179-45429e0abe9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:32.563263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2d3b05d-c7d2-40fd-a179-45429e0abe9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:32.621760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a2d3b05d-c7d2-40fd-a179-45429e0abe9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:32.629248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a2d3b05d-c7d2-40fd-a179-45429e0abe9c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078950 Mar 08 04:34:32.629834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 802/1659] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:32 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:32.902051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7dcffa93-557f-452b-b729-f03065b4bfdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:32.903877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7dcffa93-557f-452b-b729-f03065b4bfdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:32.910189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7dcffa93-557f-452b-b729-f03065b4bfdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:32.910639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7dcffa93-557f-452b-b729-f03065b4bfdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:32.911414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7dcffa93-557f-452b-b729-f03065b4bfdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:32.911858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7dcffa93-557f-452b-b729-f03065b4bfdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:32.940577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7dcffa93-557f-452b-b729-f03065b4bfdd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042765 Mar 08 04:34:32.941122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 858/1660] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:32 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:33.645439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6896b620-b54e-4949-8a1e-481934feb6a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:33.646070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6896b620-b54e-4949-8a1e-481934feb6a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:33.653154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6896b620-b54e-4949-8a1e-481934feb6a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:33.653600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6896b620-b54e-4949-8a1e-481934feb6a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:33.654393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6896b620-b54e-4949-8a1e-481934feb6a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:33.654823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6896b620-b54e-4949-8a1e-481934feb6a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:33.714056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6896b620-b54e-4949-8a1e-481934feb6a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:33.721428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6896b620-b54e-4949-8a1e-481934feb6a1 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079906 Mar 08 04:34:33.722010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 803/1661] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:33 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:33.952380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9f951c49-1497-4614-a774-3bd6464dbd0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:33.953306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9f951c49-1497-4614-a774-3bd6464dbd0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:33.959593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f951c49-1497-4614-a774-3bd6464dbd0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:33.960046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f951c49-1497-4614-a774-3bd6464dbd0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:33.960817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f951c49-1497-4614-a774-3bd6464dbd0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:33.961258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9f951c49-1497-4614-a774-3bd6464dbd0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:33.989263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9f951c49-1497-4614-a774-3bd6464dbd0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041159 Mar 08 04:34:33.989830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 859/1662] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:34.738118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6eb35bce-655a-4461-88e9-19681a1f7227 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:34.738791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6eb35bce-655a-4461-88e9-19681a1f7227 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:34.744874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6eb35bce-655a-4461-88e9-19681a1f7227 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:34.745314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6eb35bce-655a-4461-88e9-19681a1f7227 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:34.746094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6eb35bce-655a-4461-88e9-19681a1f7227 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:34.746526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6eb35bce-655a-4461-88e9-19681a1f7227 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:34.806065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6eb35bce-655a-4461-88e9-19681a1f7227 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:34.813496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6eb35bce-655a-4461-88e9-19681a1f7227 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079210 Mar 08 04:34:34.814124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 804/1663] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:34 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:35.001143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c4e422e8-e31f-4080-99d6-7ebc14e1ee76 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:35.002019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c4e422e8-e31f-4080-99d6-7ebc14e1ee76 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:35.008321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4e422e8-e31f-4080-99d6-7ebc14e1ee76 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:35.008775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4e422e8-e31f-4080-99d6-7ebc14e1ee76 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:35.009544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4e422e8-e31f-4080-99d6-7ebc14e1ee76 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:35.010023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4e422e8-e31f-4080-99d6-7ebc14e1ee76 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:35.038478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c4e422e8-e31f-4080-99d6-7ebc14e1ee76 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041395 Mar 08 04:34:35.039017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 860/1664] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:35.830956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a2e1c7af-9aa6-427e-88b3-464768bf0519 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:35.831621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a2e1c7af-9aa6-427e-88b3-464768bf0519 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:35.837467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2e1c7af-9aa6-427e-88b3-464768bf0519 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:35.837947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2e1c7af-9aa6-427e-88b3-464768bf0519 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:35.838711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2e1c7af-9aa6-427e-88b3-464768bf0519 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:35.839148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2e1c7af-9aa6-427e-88b3-464768bf0519 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:35.901262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a2e1c7af-9aa6-427e-88b3-464768bf0519 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:35.909165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a2e1c7af-9aa6-427e-88b3-464768bf0519 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.082204 Mar 08 04:34:35.909826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 805/1665] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:35 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:36.049977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-70d5330f-1c32-47a7-ba5e-4aa107635a88 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:36.050880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-70d5330f-1c32-47a7-ba5e-4aa107635a88 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:36.056989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-70d5330f-1c32-47a7-ba5e-4aa107635a88 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:36.057436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-70d5330f-1c32-47a7-ba5e-4aa107635a88 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:36.058223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-70d5330f-1c32-47a7-ba5e-4aa107635a88 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:36.059162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-70d5330f-1c32-47a7-ba5e-4aa107635a88 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:36.089481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-70d5330f-1c32-47a7-ba5e-4aa107635a88 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043274 Mar 08 04:34:36.090319 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 861/1666] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:36 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:36.925298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1fb19826-2c22-49d9-a69e-90f56348ff3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:36.926013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1fb19826-2c22-49d9-a69e-90f56348ff3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:36.932262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fb19826-2c22-49d9-a69e-90f56348ff3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:36.932712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fb19826-2c22-49d9-a69e-90f56348ff3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:36.933481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fb19826-2c22-49d9-a69e-90f56348ff3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:36.934192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fb19826-2c22-49d9-a69e-90f56348ff3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:36.993689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1fb19826-2c22-49d9-a69e-90f56348ff3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:37.001204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1fb19826-2c22-49d9-a69e-90f56348ff3d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079872 Mar 08 04:34:37.001786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 806/1667] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:36 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:37.101615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f431d8c1-82f6-4a2b-8277-c91c1f429fd2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:37.102580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f431d8c1-82f6-4a2b-8277-c91c1f429fd2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:37.108901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f431d8c1-82f6-4a2b-8277-c91c1f429fd2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:37.109286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f431d8c1-82f6-4a2b-8277-c91c1f429fd2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:37.110087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f431d8c1-82f6-4a2b-8277-c91c1f429fd2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:37.110527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f431d8c1-82f6-4a2b-8277-c91c1f429fd2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:37.139026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f431d8c1-82f6-4a2b-8277-c91c1f429fd2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Mar 08 04:34:37.139578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 862/1668] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:37 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:38.017837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7380f27f-59d9-45d6-8487-1bb733b0ad47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:38.018449 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7380f27f-59d9-45d6-8487-1bb733b0ad47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:38.024706 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7380f27f-59d9-45d6-8487-1bb733b0ad47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:38.025150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7380f27f-59d9-45d6-8487-1bb733b0ad47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:38.025978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7380f27f-59d9-45d6-8487-1bb733b0ad47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:38.026420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7380f27f-59d9-45d6-8487-1bb733b0ad47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:38.084075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7380f27f-59d9-45d6-8487-1bb733b0ad47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:38.091775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7380f27f-59d9-45d6-8487-1bb733b0ad47 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077801 Mar 08 04:34:38.092328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 807/1669] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:38 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:38.150403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-afbbd994-f41c-451d-ac64-66b03736a3a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:38.151263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-afbbd994-f41c-451d-ac64-66b03736a3a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:38.158205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afbbd994-f41c-451d-ac64-66b03736a3a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:38.158653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afbbd994-f41c-451d-ac64-66b03736a3a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:38.159409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afbbd994-f41c-451d-ac64-66b03736a3a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:38.159841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afbbd994-f41c-451d-ac64-66b03736a3a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:38.187538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-afbbd994-f41c-451d-ac64-66b03736a3a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Mar 08 04:34:38.188080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 863/1670] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:38 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:39.108791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c90ebb67-49e4-4180-a090-93c42e5a6e1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:39.109371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c90ebb67-49e4-4180-a090-93c42e5a6e1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:39.115901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c90ebb67-49e4-4180-a090-93c42e5a6e1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:39.116352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c90ebb67-49e4-4180-a090-93c42e5a6e1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:39.117182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c90ebb67-49e4-4180-a090-93c42e5a6e1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:39.117622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c90ebb67-49e4-4180-a090-93c42e5a6e1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:39.176597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c90ebb67-49e4-4180-a090-93c42e5a6e1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:39.184197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c90ebb67-49e4-4180-a090-93c42e5a6e1c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079387 Mar 08 04:34:39.184763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 808/1671] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:39 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:39.198815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dcca75ac-a24b-4d9b-92b9-3bb39335c7e7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:39.200339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dcca75ac-a24b-4d9b-92b9-3bb39335c7e7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:39.206515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dcca75ac-a24b-4d9b-92b9-3bb39335c7e7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:39.206962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dcca75ac-a24b-4d9b-92b9-3bb39335c7e7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:39.207725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dcca75ac-a24b-4d9b-92b9-3bb39335c7e7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:39.208187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dcca75ac-a24b-4d9b-92b9-3bb39335c7e7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:39.238787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dcca75ac-a24b-4d9b-92b9-3bb39335c7e7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Mar 08 04:34:39.239645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 864/1672] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:39 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:40.200201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f167c31b-15fa-48a1-a059-e6a2c90ee68b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:40.200804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f167c31b-15fa-48a1-a059-e6a2c90ee68b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:40.206962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f167c31b-15fa-48a1-a059-e6a2c90ee68b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:40.207436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f167c31b-15fa-48a1-a059-e6a2c90ee68b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:40.208191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f167c31b-15fa-48a1-a059-e6a2c90ee68b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:40.208620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f167c31b-15fa-48a1-a059-e6a2c90ee68b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:40.250459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b0530fb7-f5e8-4ddc-a41b-a06267ce661c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:40.251366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b0530fb7-f5e8-4ddc-a41b-a06267ce661c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:40.257464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0530fb7-f5e8-4ddc-a41b-a06267ce661c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:40.257939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0530fb7-f5e8-4ddc-a41b-a06267ce661c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:40.258705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0530fb7-f5e8-4ddc-a41b-a06267ce661c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:40.259139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0530fb7-f5e8-4ddc-a41b-a06267ce661c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:40.266197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f167c31b-15fa-48a1-a059-e6a2c90ee68b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:40.273302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f167c31b-15fa-48a1-a059-e6a2c90ee68b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.076987 Mar 08 04:34:40.273884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 809/1673] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:40 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:40.287868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b0530fb7-f5e8-4ddc-a41b-a06267ce661c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 Mar 08 04:34:40.288407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 865/1674] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:34:41.291137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-975df81a-e91a-4655-8b19-86a74a7174ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:41.291741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-975df81a-e91a-4655-8b19-86a74a7174ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:41.298498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-975df81a-e91a-4655-8b19-86a74a7174ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:41.298944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-975df81a-e91a-4655-8b19-86a74a7174ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:41.299286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-175e3d30-7353-44b7-88c7-2b70e3f62c62 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:41.299719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-975df81a-e91a-4655-8b19-86a74a7174ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:41.300120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-975df81a-e91a-4655-8b19-86a74a7174ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:41.300256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-175e3d30-7353-44b7-88c7-2b70e3f62c62 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:41.306386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-175e3d30-7353-44b7-88c7-2b70e3f62c62 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:41.306836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-175e3d30-7353-44b7-88c7-2b70e3f62c62 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:41.307602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-175e3d30-7353-44b7-88c7-2b70e3f62c62 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:41.308038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-175e3d30-7353-44b7-88c7-2b70e3f62c62 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:41.337074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-175e3d30-7353-44b7-88c7-2b70e3f62c62 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041690 Mar 08 04:34:41.337629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 866/1675] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:41 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:34:41.358718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-975df81a-e91a-4655-8b19-86a74a7174ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:41.365941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-975df81a-e91a-4655-8b19-86a74a7174ac tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078635 Mar 08 04:34:41.366489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 810/1676] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:41 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:42.348627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-54e6508a-55ba-488d-9b07-9a7bd383992b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:42.349534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-54e6508a-55ba-488d-9b07-9a7bd383992b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:42.355749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-54e6508a-55ba-488d-9b07-9a7bd383992b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:42.356190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-54e6508a-55ba-488d-9b07-9a7bd383992b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:42.356943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-54e6508a-55ba-488d-9b07-9a7bd383992b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:42.357372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-54e6508a-55ba-488d-9b07-9a7bd383992b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:42.383086 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-76b94e23-ff0a-4119-ac96-28a1456e426d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:42.383714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-76b94e23-ff0a-4119-ac96-28a1456e426d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:42.384691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-54e6508a-55ba-488d-9b07-9a7bd383992b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040024 Mar 08 04:34:42.385364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 867/1677] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:42 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:42.390533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-76b94e23-ff0a-4119-ac96-28a1456e426d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:42.390976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-76b94e23-ff0a-4119-ac96-28a1456e426d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:42.391735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-76b94e23-ff0a-4119-ac96-28a1456e426d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:42.392168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-76b94e23-ff0a-4119-ac96-28a1456e426d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:42.453220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-76b94e23-ff0a-4119-ac96-28a1456e426d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:42.460360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-76b94e23-ff0a-4119-ac96-28a1456e426d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081082 Mar 08 04:34:42.460911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 811/1678] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:42 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:34:43.397287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a86a04ce-4f6a-4e88-a501-ac8c44076ff0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:43.398140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a86a04ce-4f6a-4e88-a501-ac8c44076ff0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:43.406549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a86a04ce-4f6a-4e88-a501-ac8c44076ff0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:43.407107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a86a04ce-4f6a-4e88-a501-ac8c44076ff0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:43.408468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a86a04ce-4f6a-4e88-a501-ac8c44076ff0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:43.409240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a86a04ce-4f6a-4e88-a501-ac8c44076ff0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:43.446571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a86a04ce-4f6a-4e88-a501-ac8c44076ff0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053456 Mar 08 04:34:43.447231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 868/1679] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:43.478152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3bb340f9-0c90-445a-833f-50633fc90cd2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:43.478781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3bb340f9-0c90-445a-833f-50633fc90cd2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:43.487697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3bb340f9-0c90-445a-833f-50633fc90cd2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:43.488153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3bb340f9-0c90-445a-833f-50633fc90cd2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:43.488935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3bb340f9-0c90-445a-833f-50633fc90cd2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:43.489375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3bb340f9-0c90-445a-833f-50633fc90cd2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:43.551525 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3bb340f9-0c90-445a-833f-50633fc90cd2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:43.561413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3bb340f9-0c90-445a-833f-50633fc90cd2 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.087670 Mar 08 04:34:43.562023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 812/1680] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:43 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:44.457685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f89d9b38-54f2-4113-8493-faf35d4bcb49 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:44.458650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f89d9b38-54f2-4113-8493-faf35d4bcb49 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:44.465009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f89d9b38-54f2-4113-8493-faf35d4bcb49 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:44.465381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f89d9b38-54f2-4113-8493-faf35d4bcb49 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:44.466169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f89d9b38-54f2-4113-8493-faf35d4bcb49 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:44.466600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f89d9b38-54f2-4113-8493-faf35d4bcb49 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:44.494974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f89d9b38-54f2-4113-8493-faf35d4bcb49 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041297 Mar 08 04:34:44.495513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 869/1681] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:44.578326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-782ce9c3-a30c-4c93-a750-f85bcd248404 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:44.578979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-782ce9c3-a30c-4c93-a750-f85bcd248404 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:44.585180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-782ce9c3-a30c-4c93-a750-f85bcd248404 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:44.585622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-782ce9c3-a30c-4c93-a750-f85bcd248404 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:44.586408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-782ce9c3-a30c-4c93-a750-f85bcd248404 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:44.586839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-782ce9c3-a30c-4c93-a750-f85bcd248404 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:44.645805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-782ce9c3-a30c-4c93-a750-f85bcd248404 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:44.653225 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-782ce9c3-a30c-4c93-a750-f85bcd248404 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079040 Mar 08 04:34:44.653802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 813/1682] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:44 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:45.507111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9512566b-a8a4-4d63-9068-2ec72964c784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:45.507882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9512566b-a8a4-4d63-9068-2ec72964c784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:45.514927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9512566b-a8a4-4d63-9068-2ec72964c784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:45.515372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9512566b-a8a4-4d63-9068-2ec72964c784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:45.516130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9512566b-a8a4-4d63-9068-2ec72964c784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:45.516620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9512566b-a8a4-4d63-9068-2ec72964c784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:45.544532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9512566b-a8a4-4d63-9068-2ec72964c784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041722 Mar 08 04:34:45.545060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 870/1683] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:45 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:45.669577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-49144321-2c8b-4e24-9370-d811cbbb67ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:45.670202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-49144321-2c8b-4e24-9370-d811cbbb67ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:45.676649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-49144321-2c8b-4e24-9370-d811cbbb67ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:45.677173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-49144321-2c8b-4e24-9370-d811cbbb67ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:45.677970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-49144321-2c8b-4e24-9370-d811cbbb67ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:45.678405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-49144321-2c8b-4e24-9370-d811cbbb67ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:45.739436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-49144321-2c8b-4e24-9370-d811cbbb67ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:45.747818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-49144321-2c8b-4e24-9370-d811cbbb67ba tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.082333 Mar 08 04:34:45.748383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 814/1684] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:45 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:34:46.556129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e3965dc6-7af4-43a0-a88a-d070ba64b818 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:46.557031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e3965dc6-7af4-43a0-a88a-d070ba64b818 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:46.564103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3965dc6-7af4-43a0-a88a-d070ba64b818 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:46.564552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3965dc6-7af4-43a0-a88a-d070ba64b818 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:46.565433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3965dc6-7af4-43a0-a88a-d070ba64b818 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:46.565903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3965dc6-7af4-43a0-a88a-d070ba64b818 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:46.599151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e3965dc6-7af4-43a0-a88a-d070ba64b818 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Mar 08 04:34:46.599712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 871/1685] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:46 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:46.764904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-deb0dd6c-7402-4178-90c8-fb32d4157f74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:46.765509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-deb0dd6c-7402-4178-90c8-fb32d4157f74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:46.771914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-deb0dd6c-7402-4178-90c8-fb32d4157f74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:46.772367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-deb0dd6c-7402-4178-90c8-fb32d4157f74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:46.773134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-deb0dd6c-7402-4178-90c8-fb32d4157f74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:46.773572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-deb0dd6c-7402-4178-90c8-fb32d4157f74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:46.834206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-deb0dd6c-7402-4178-90c8-fb32d4157f74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:46.842159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-deb0dd6c-7402-4178-90c8-fb32d4157f74 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081681 Mar 08 04:34:46.842710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 815/1686] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:46 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:47.611280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d047576a-ee99-40b3-be53-f132a6d2ea8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:47.612188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d047576a-ee99-40b3-be53-f132a6d2ea8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:47.618541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d047576a-ee99-40b3-be53-f132a6d2ea8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:47.618985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d047576a-ee99-40b3-be53-f132a6d2ea8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:47.619742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d047576a-ee99-40b3-be53-f132a6d2ea8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:47.620172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d047576a-ee99-40b3-be53-f132a6d2ea8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:47.648087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d047576a-ee99-40b3-be53-f132a6d2ea8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040775 Mar 08 04:34:47.648613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 872/1687] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:47 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:47.859455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8c8ab3de-d89a-4779-b0b5-2a435b499e9b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:47.860057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8c8ab3de-d89a-4779-b0b5-2a435b499e9b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:47.866342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c8ab3de-d89a-4779-b0b5-2a435b499e9b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:47.866734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c8ab3de-d89a-4779-b0b5-2a435b499e9b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:47.867514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c8ab3de-d89a-4779-b0b5-2a435b499e9b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:47.867942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c8ab3de-d89a-4779-b0b5-2a435b499e9b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:47.926156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8c8ab3de-d89a-4779-b0b5-2a435b499e9b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:47.933396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8c8ab3de-d89a-4779-b0b5-2a435b499e9b tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078417 Mar 08 04:34:47.933983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 816/1688] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:47 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:48.659750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e52d3224-0152-4f34-8b4c-24e7bd5556e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:48.660609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e52d3224-0152-4f34-8b4c-24e7bd5556e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:48.666602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e52d3224-0152-4f34-8b4c-24e7bd5556e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:48.667083 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e52d3224-0152-4f34-8b4c-24e7bd5556e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:48.668597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e52d3224-0152-4f34-8b4c-24e7bd5556e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:48.669042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e52d3224-0152-4f34-8b4c-24e7bd5556e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:48.696359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e52d3224-0152-4f34-8b4c-24e7bd5556e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040687 Mar 08 04:34:48.696903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 873/1689] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:48 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:48.950686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1044d07f-d09b-497f-96bc-34e37fce9da3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:48.951316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1044d07f-d09b-497f-96bc-34e37fce9da3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:48.957543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1044d07f-d09b-497f-96bc-34e37fce9da3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:48.958022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1044d07f-d09b-497f-96bc-34e37fce9da3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:48.958784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1044d07f-d09b-497f-96bc-34e37fce9da3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:48.959217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1044d07f-d09b-497f-96bc-34e37fce9da3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:49.020371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1044d07f-d09b-497f-96bc-34e37fce9da3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:49.028488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1044d07f-d09b-497f-96bc-34e37fce9da3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.082300 Mar 08 04:34:49.029041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 817/1690] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:48 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:49.708121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f4e3e64d-9ae2-43cb-82b8-f72627c192fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:49.709050 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f4e3e64d-9ae2-43cb-82b8-f72627c192fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:49.715560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4e3e64d-9ae2-43cb-82b8-f72627c192fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:49.716012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4e3e64d-9ae2-43cb-82b8-f72627c192fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:49.716787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4e3e64d-9ae2-43cb-82b8-f72627c192fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:49.717227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4e3e64d-9ae2-43cb-82b8-f72627c192fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:49.745350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f4e3e64d-9ae2-43cb-82b8-f72627c192fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041305 Mar 08 04:34:49.746503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 874/1691] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:49 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:50.044966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b0b321ea-e5e8-4a33-b623-ef7cf584768f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:50.045576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b0b321ea-e5e8-4a33-b623-ef7cf584768f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:50.051902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0b321ea-e5e8-4a33-b623-ef7cf584768f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:50.052352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0b321ea-e5e8-4a33-b623-ef7cf584768f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:50.053113 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0b321ea-e5e8-4a33-b623-ef7cf584768f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:50.053549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0b321ea-e5e8-4a33-b623-ef7cf584768f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:50.111420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b0b321ea-e5e8-4a33-b623-ef7cf584768f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:50.118615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b0b321ea-e5e8-4a33-b623-ef7cf584768f tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078223 Mar 08 04:34:50.119177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 818/1692] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:50 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:50.757767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bf9ab691-f752-4d5f-bc60-45d639624a3f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:50.758679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bf9ab691-f752-4d5f-bc60-45d639624a3f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:50.765098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf9ab691-f752-4d5f-bc60-45d639624a3f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:50.765551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf9ab691-f752-4d5f-bc60-45d639624a3f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:50.766348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf9ab691-f752-4d5f-bc60-45d639624a3f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:50.766789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf9ab691-f752-4d5f-bc60-45d639624a3f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:50.798582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bf9ab691-f752-4d5f-bc60-45d639624a3f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Mar 08 04:34:50.799175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 875/1693] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:50 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:51.135148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-58003f88-7946-450a-8f5e-c7f051bd1249 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:51.135691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-58003f88-7946-450a-8f5e-c7f051bd1249 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:51.142603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58003f88-7946-450a-8f5e-c7f051bd1249 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:51.143049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58003f88-7946-450a-8f5e-c7f051bd1249 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:51.143813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58003f88-7946-450a-8f5e-c7f051bd1249 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:51.144242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-58003f88-7946-450a-8f5e-c7f051bd1249 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:51.205479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-58003f88-7946-450a-8f5e-c7f051bd1249 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:51.212600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-58003f88-7946-450a-8f5e-c7f051bd1249 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081385 Mar 08 04:34:51.213152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 819/1694] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:51 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:51.809894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f791e9a3-c38d-420f-8840-c3c49a7730a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:51.810795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f791e9a3-c38d-420f-8840-c3c49a7730a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:51.817134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f791e9a3-c38d-420f-8840-c3c49a7730a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:51.817583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f791e9a3-c38d-420f-8840-c3c49a7730a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:51.818388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f791e9a3-c38d-420f-8840-c3c49a7730a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:51.818828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f791e9a3-c38d-420f-8840-c3c49a7730a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:51.848890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f791e9a3-c38d-420f-8840-c3c49a7730a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Mar 08 04:34:51.849729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 876/1695] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:51 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:52.230507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d43d709a-2957-4370-9677-5aa50f0fb333 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:52.231130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d43d709a-2957-4370-9677-5aa50f0fb333 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:52.237253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d43d709a-2957-4370-9677-5aa50f0fb333 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:52.237727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d43d709a-2957-4370-9677-5aa50f0fb333 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:52.238481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d43d709a-2957-4370-9677-5aa50f0fb333 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:52.238913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d43d709a-2957-4370-9677-5aa50f0fb333 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:52.296710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d43d709a-2957-4370-9677-5aa50f0fb333 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:52.303879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d43d709a-2957-4370-9677-5aa50f0fb333 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077844 Mar 08 04:34:52.304423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 820/1696] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:52 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:52.860270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4fdf1e1d-e5d0-46c2-b140-319a4c1878c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:52.861179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4fdf1e1d-e5d0-46c2-b140-319a4c1878c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:52.867425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4fdf1e1d-e5d0-46c2-b140-319a4c1878c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:52.867874 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4fdf1e1d-e5d0-46c2-b140-319a4c1878c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:52.868636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4fdf1e1d-e5d0-46c2-b140-319a4c1878c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:52.869078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4fdf1e1d-e5d0-46c2-b140-319a4c1878c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:52.900532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4fdf1e1d-e5d0-46c2-b140-319a4c1878c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Mar 08 04:34:52.901082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 877/1697] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:52 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:53.320888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a59dc4ac-45c4-4333-bd2f-9a9e9d568179 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:53.321511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a59dc4ac-45c4-4333-bd2f-9a9e9d568179 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:53.328423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a59dc4ac-45c4-4333-bd2f-9a9e9d568179 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:53.328868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a59dc4ac-45c4-4333-bd2f-9a9e9d568179 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:53.329633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a59dc4ac-45c4-4333-bd2f-9a9e9d568179 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:53.330094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a59dc4ac-45c4-4333-bd2f-9a9e9d568179 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:53.388141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a59dc4ac-45c4-4333-bd2f-9a9e9d568179 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:53.395336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a59dc4ac-45c4-4333-bd2f-9a9e9d568179 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078367 Mar 08 04:34:53.395962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 821/1698] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:53 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:53.912472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e1b85535-c1d3-475e-824d-a17a4b35e555 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:53.913383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e1b85535-c1d3-475e-824d-a17a4b35e555 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:53.919894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1b85535-c1d3-475e-824d-a17a4b35e555 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:53.920333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1b85535-c1d3-475e-824d-a17a4b35e555 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:53.921094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1b85535-c1d3-475e-824d-a17a4b35e555 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:53.921527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1b85535-c1d3-475e-824d-a17a4b35e555 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:53.951553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e1b85535-c1d3-475e-824d-a17a4b35e555 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042968 Mar 08 04:34:53.952101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 878/1699] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:53 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:54.412873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f0b8560a-2418-4767-8ab9-6263418b3103 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:54.413486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f0b8560a-2418-4767-8ab9-6263418b3103 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:54.420591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0b8560a-2418-4767-8ab9-6263418b3103 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:54.421044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0b8560a-2418-4767-8ab9-6263418b3103 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:54.421905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0b8560a-2418-4767-8ab9-6263418b3103 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:54.422347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0b8560a-2418-4767-8ab9-6263418b3103 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:54.480296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f0b8560a-2418-4767-8ab9-6263418b3103 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:54.488305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f0b8560a-2418-4767-8ab9-6263418b3103 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079451 Mar 08 04:34:54.488861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 822/1700] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:54 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:54.963191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-92eecede-8714-4eec-901e-6ea6955af578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:54.964094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-92eecede-8714-4eec-901e-6ea6955af578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:54.970968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92eecede-8714-4eec-901e-6ea6955af578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:54.971411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92eecede-8714-4eec-901e-6ea6955af578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:54.972165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92eecede-8714-4eec-901e-6ea6955af578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:54.972595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92eecede-8714-4eec-901e-6ea6955af578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:54.999839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-92eecede-8714-4eec-901e-6ea6955af578 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040528 Mar 08 04:34:55.000309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 879/1701] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:54 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:55.504763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-80b8d04f-42f4-46c0-be40-00e59ce8dcb4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:55.505366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-80b8d04f-42f4-46c0-be40-00e59ce8dcb4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:55.511698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80b8d04f-42f4-46c0-be40-00e59ce8dcb4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:55.512226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80b8d04f-42f4-46c0-be40-00e59ce8dcb4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:55.513649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80b8d04f-42f4-46c0-be40-00e59ce8dcb4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:55.514098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80b8d04f-42f4-46c0-be40-00e59ce8dcb4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:55.575355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-80b8d04f-42f4-46c0-be40-00e59ce8dcb4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:55.582743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-80b8d04f-42f4-46c0-be40-00e59ce8dcb4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081783 Mar 08 04:34:55.583306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 823/1702] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:55 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:56.011014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f514abb0-9521-4dc9-8589-734061150d93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:56.011839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f514abb0-9521-4dc9-8589-734061150d93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:56.018177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f514abb0-9521-4dc9-8589-734061150d93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:56.018620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f514abb0-9521-4dc9-8589-734061150d93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:56.019410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f514abb0-9521-4dc9-8589-734061150d93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:56.019844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f514abb0-9521-4dc9-8589-734061150d93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:56.048880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f514abb0-9521-4dc9-8589-734061150d93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Mar 08 04:34:56.049417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 880/1703] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:56 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:56.599319 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8cf81dd9-bde0-40f5-9362-ea86a43a0a88 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:56.599930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8cf81dd9-bde0-40f5-9362-ea86a43a0a88 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:56.606361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8cf81dd9-bde0-40f5-9362-ea86a43a0a88 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:56.606910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8cf81dd9-bde0-40f5-9362-ea86a43a0a88 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:56.607682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8cf81dd9-bde0-40f5-9362-ea86a43a0a88 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:56.608122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8cf81dd9-bde0-40f5-9362-ea86a43a0a88 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:56.666997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8cf81dd9-bde0-40f5-9362-ea86a43a0a88 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:56.674545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8cf81dd9-bde0-40f5-9362-ea86a43a0a88 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079102 Mar 08 04:34:56.675103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 824/1704] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:56 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:57.060427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-37e7b498-ce29-4aa2-96e4-94d62a6eed84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:57.061342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-37e7b498-ce29-4aa2-96e4-94d62a6eed84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:57.067581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37e7b498-ce29-4aa2-96e4-94d62a6eed84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:57.068034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37e7b498-ce29-4aa2-96e4-94d62a6eed84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:57.068825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37e7b498-ce29-4aa2-96e4-94d62a6eed84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:57.069265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37e7b498-ce29-4aa2-96e4-94d62a6eed84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:57.097907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-37e7b498-ce29-4aa2-96e4-94d62a6eed84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 Mar 08 04:34:57.098455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 881/1705] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:57 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:57.691866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4aa518de-9d08-49ee-87dd-f44628905e42 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:57.692455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4aa518de-9d08-49ee-87dd-f44628905e42 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:57.698686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4aa518de-9d08-49ee-87dd-f44628905e42 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:57.699131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4aa518de-9d08-49ee-87dd-f44628905e42 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:57.699893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4aa518de-9d08-49ee-87dd-f44628905e42 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:57.700378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4aa518de-9d08-49ee-87dd-f44628905e42 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:57.759014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4aa518de-9d08-49ee-87dd-f44628905e42 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:57.766909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4aa518de-9d08-49ee-87dd-f44628905e42 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078943 Mar 08 04:34:57.767465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 825/1706] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:57 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:58.109227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8ff86be1-0b13-4516-b789-523683019c8b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:58.110070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8ff86be1-0b13-4516-b789-523683019c8b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:58.116243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ff86be1-0b13-4516-b789-523683019c8b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:58.116684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ff86be1-0b13-4516-b789-523683019c8b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:58.117439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ff86be1-0b13-4516-b789-523683019c8b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:58.117925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ff86be1-0b13-4516-b789-523683019c8b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:58.145451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8ff86be1-0b13-4516-b789-523683019c8b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040291 Mar 08 04:34:58.146025 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 882/1707] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:58 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:58.783540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1fea20f7-e133-4654-84eb-c77bb67ccfda tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:58.784151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1fea20f7-e133-4654-84eb-c77bb67ccfda tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:58.790409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fea20f7-e133-4654-84eb-c77bb67ccfda tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:58.790855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fea20f7-e133-4654-84eb-c77bb67ccfda tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:58.791623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fea20f7-e133-4654-84eb-c77bb67ccfda tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:58.792057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1fea20f7-e133-4654-84eb-c77bb67ccfda tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:58.854550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1fea20f7-e133-4654-84eb-c77bb67ccfda tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:58.862758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1fea20f7-e133-4654-84eb-c77bb67ccfda tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.083049 Mar 08 04:34:58.863321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 826/1708] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:58 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:34:59.158656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-10ad5af0-f8ae-4ef5-901c-2388e69227fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:59.160227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-10ad5af0-f8ae-4ef5-901c-2388e69227fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:59.167200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10ad5af0-f8ae-4ef5-901c-2388e69227fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:59.167645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10ad5af0-f8ae-4ef5-901c-2388e69227fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:59.168410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10ad5af0-f8ae-4ef5-901c-2388e69227fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:59.168849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10ad5af0-f8ae-4ef5-901c-2388e69227fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:59.197302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-10ad5af0-f8ae-4ef5-901c-2388e69227fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Mar 08 04:34:59.197882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 883/1709] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:34:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:34:59.879660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3c850a9b-6627-494e-8852-c4b40d3fb08c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:34:59.880272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3c850a9b-6627-494e-8852-c4b40d3fb08c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:34:59.886507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c850a9b-6627-494e-8852-c4b40d3fb08c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:59.886956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c850a9b-6627-494e-8852-c4b40d3fb08c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:59.887755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c850a9b-6627-494e-8852-c4b40d3fb08c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:34:59.888377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c850a9b-6627-494e-8852-c4b40d3fb08c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:34:59.947255 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3c850a9b-6627-494e-8852-c4b40d3fb08c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:34:59.954432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3c850a9b-6627-494e-8852-c4b40d3fb08c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078700 Mar 08 04:34:59.954989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 827/1710] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:34:59 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:00.208543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3906ea06-3658-43e3-8647-54e4168d010d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:00.209454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3906ea06-3658-43e3-8647-54e4168d010d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:00.215770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3906ea06-3658-43e3-8647-54e4168d010d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:00.216787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3906ea06-3658-43e3-8647-54e4168d010d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:00.217551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3906ea06-3658-43e3-8647-54e4168d010d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:00.218011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3906ea06-3658-43e3-8647-54e4168d010d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:00.244955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3906ea06-3658-43e3-8647-54e4168d010d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040356 Mar 08 04:35:00.245490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 884/1711] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:00.971135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6a483c2c-e34f-4ec9-8333-c984bb9f4820 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:00.971743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6a483c2c-e34f-4ec9-8333-c984bb9f4820 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:00.977917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a483c2c-e34f-4ec9-8333-c984bb9f4820 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:00.978359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a483c2c-e34f-4ec9-8333-c984bb9f4820 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:00.979114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a483c2c-e34f-4ec9-8333-c984bb9f4820 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:00.979545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a483c2c-e34f-4ec9-8333-c984bb9f4820 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:01.039052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6a483c2c-e34f-4ec9-8333-c984bb9f4820 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:01.046805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6a483c2c-e34f-4ec9-8333-c984bb9f4820 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079547 Mar 08 04:35:01.047357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 828/1712] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:00 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:01.256436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f3c90396-6edf-4e80-b629-e3df5ad44c04 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:01.257391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f3c90396-6edf-4e80-b629-e3df5ad44c04 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:01.264132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f3c90396-6edf-4e80-b629-e3df5ad44c04 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:01.264574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f3c90396-6edf-4e80-b629-e3df5ad44c04 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:01.265334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f3c90396-6edf-4e80-b629-e3df5ad44c04 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:01.265790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f3c90396-6edf-4e80-b629-e3df5ad44c04 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:01.293256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f3c90396-6edf-4e80-b629-e3df5ad44c04 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040785 Mar 08 04:35:01.293809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 885/1713] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:02.062937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-71f9e5fe-adac-480f-89e2-fc39dcad809e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:02.063576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-71f9e5fe-adac-480f-89e2-fc39dcad809e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:02.069872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71f9e5fe-adac-480f-89e2-fc39dcad809e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:02.070325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71f9e5fe-adac-480f-89e2-fc39dcad809e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:02.071084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71f9e5fe-adac-480f-89e2-fc39dcad809e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:02.071520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71f9e5fe-adac-480f-89e2-fc39dcad809e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:02.133143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-71f9e5fe-adac-480f-89e2-fc39dcad809e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:02.141081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-71f9e5fe-adac-480f-89e2-fc39dcad809e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.082590 Mar 08 04:35:02.141636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 829/1714] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:02 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:02.304987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57ed208e-d429-45a2-aace-0810d950e152 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:02.305935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-57ed208e-d429-45a2-aace-0810d950e152 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:02.312728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57ed208e-d429-45a2-aace-0810d950e152 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:02.313174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57ed208e-d429-45a2-aace-0810d950e152 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:02.313960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57ed208e-d429-45a2-aace-0810d950e152 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:02.314396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57ed208e-d429-45a2-aace-0810d950e152 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:02.341403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-57ed208e-d429-45a2-aace-0810d950e152 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040509 Mar 08 04:35:02.341986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 886/1715] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:03.159305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a9b97560-8fd3-4e93-9d09-dc351b44f2f7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:03.159917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a9b97560-8fd3-4e93-9d09-dc351b44f2f7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:03.166133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9b97560-8fd3-4e93-9d09-dc351b44f2f7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:03.166585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9b97560-8fd3-4e93-9d09-dc351b44f2f7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:03.167348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9b97560-8fd3-4e93-9d09-dc351b44f2f7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:03.167784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9b97560-8fd3-4e93-9d09-dc351b44f2f7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:03.228284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a9b97560-8fd3-4e93-9d09-dc351b44f2f7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:03.236308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a9b97560-8fd3-4e93-9d09-dc351b44f2f7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081584 Mar 08 04:35:03.236863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 830/1716] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:03 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:03.352839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-822c7b47-aa4d-4b3a-8cc3-279a63b12557 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:03.353765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-822c7b47-aa4d-4b3a-8cc3-279a63b12557 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:03.360896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-822c7b47-aa4d-4b3a-8cc3-279a63b12557 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:03.361687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-822c7b47-aa4d-4b3a-8cc3-279a63b12557 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:03.362999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-822c7b47-aa4d-4b3a-8cc3-279a63b12557 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:03.363513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-822c7b47-aa4d-4b3a-8cc3-279a63b12557 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:03.391967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-822c7b47-aa4d-4b3a-8cc3-279a63b12557 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043017 Mar 08 04:35:03.392505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 887/1717] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:03 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:04.253343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-46391179-318b-4408-925d-1e8a0cedd6f5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:04.253979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-46391179-318b-4408-925d-1e8a0cedd6f5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:04.260232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46391179-318b-4408-925d-1e8a0cedd6f5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:04.260683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46391179-318b-4408-925d-1e8a0cedd6f5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:04.261449 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46391179-318b-4408-925d-1e8a0cedd6f5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:04.261924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46391179-318b-4408-925d-1e8a0cedd6f5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:04.321272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-46391179-318b-4408-925d-1e8a0cedd6f5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:04.329538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-46391179-318b-4408-925d-1e8a0cedd6f5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080143 Mar 08 04:35:04.330137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 831/1718] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:04 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:04.403516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-badf769d-a5b0-4dbd-8939-603ae647b1d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:04.404516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-badf769d-a5b0-4dbd-8939-603ae647b1d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:04.410678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-badf769d-a5b0-4dbd-8939-603ae647b1d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:04.411169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-badf769d-a5b0-4dbd-8939-603ae647b1d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:04.411878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-badf769d-a5b0-4dbd-8939-603ae647b1d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:04.412311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-badf769d-a5b0-4dbd-8939-603ae647b1d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:04.440231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-badf769d-a5b0-4dbd-8939-603ae647b1d9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Mar 08 04:35:04.440771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 888/1719] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:04 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:05.346349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a506aaa3-ef1c-4c48-a240-3a82fc45df6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:05.346983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a506aaa3-ef1c-4c48-a240-3a82fc45df6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:05.353047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a506aaa3-ef1c-4c48-a240-3a82fc45df6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:05.353489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a506aaa3-ef1c-4c48-a240-3a82fc45df6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:05.354526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a506aaa3-ef1c-4c48-a240-3a82fc45df6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:05.354990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a506aaa3-ef1c-4c48-a240-3a82fc45df6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:05.417944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a506aaa3-ef1c-4c48-a240-3a82fc45df6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:05.425717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a506aaa3-ef1c-4c48-a240-3a82fc45df6a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.083194 Mar 08 04:35:05.426265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 832/1720] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:05 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:05.495900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-170783bd-65cd-4822-8071-d438cd323023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:05.496844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-170783bd-65cd-4822-8071-d438cd323023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:05.503308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-170783bd-65cd-4822-8071-d438cd323023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:05.503756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-170783bd-65cd-4822-8071-d438cd323023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:05.504510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-170783bd-65cd-4822-8071-d438cd323023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:05.504944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-170783bd-65cd-4822-8071-d438cd323023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:05.532364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-170783bd-65cd-4822-8071-d438cd323023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084768 Mar 08 04:35:05.532907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 889/1721] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:06.443597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-405e5257-30cf-4d59-9430-9a1e9005a215 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:06.444205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-405e5257-30cf-4d59-9430-9a1e9005a215 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:06.451101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-405e5257-30cf-4d59-9430-9a1e9005a215 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:06.451565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-405e5257-30cf-4d59-9430-9a1e9005a215 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:06.452318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-405e5257-30cf-4d59-9430-9a1e9005a215 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:06.452747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-405e5257-30cf-4d59-9430-9a1e9005a215 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:06.510158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-405e5257-30cf-4d59-9430-9a1e9005a215 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:06.517897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-405e5257-30cf-4d59-9430-9a1e9005a215 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078141 Mar 08 04:35:06.518461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 833/1722] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:06 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:06.543892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2dbcc078-b4c4-4be9-bb33-3f9bca06fc90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:06.545423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2dbcc078-b4c4-4be9-bb33-3f9bca06fc90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:06.551632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2dbcc078-b4c4-4be9-bb33-3f9bca06fc90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:06.552075 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2dbcc078-b4c4-4be9-bb33-3f9bca06fc90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:06.552831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2dbcc078-b4c4-4be9-bb33-3f9bca06fc90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:06.553261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2dbcc078-b4c4-4be9-bb33-3f9bca06fc90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:06.580785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2dbcc078-b4c4-4be9-bb33-3f9bca06fc90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041054 Mar 08 04:35:06.581333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 890/1723] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:07.535230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cc412b8d-de54-4290-89ea-1191ae61a76d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:07.535844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cc412b8d-de54-4290-89ea-1191ae61a76d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:07.542087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc412b8d-de54-4290-89ea-1191ae61a76d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:07.542542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc412b8d-de54-4290-89ea-1191ae61a76d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:07.543311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc412b8d-de54-4290-89ea-1191ae61a76d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:07.543755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc412b8d-de54-4290-89ea-1191ae61a76d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:07.593350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-afdba355-584a-4dc7-a0fa-6f5495682a8f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:07.594897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-afdba355-584a-4dc7-a0fa-6f5495682a8f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:07.604542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afdba355-584a-4dc7-a0fa-6f5495682a8f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:07.605780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afdba355-584a-4dc7-a0fa-6f5495682a8f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:07.608402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afdba355-584a-4dc7-a0fa-6f5495682a8f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:07.609264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afdba355-584a-4dc7-a0fa-6f5495682a8f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:07.617365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cc412b8d-de54-4290-89ea-1191ae61a76d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:07.632338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cc412b8d-de54-4290-89ea-1191ae61a76d tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.100958 Mar 08 04:35:07.633610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 834/1724] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:07 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:07.646973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ea69b694-e66f-4e80-8c87-fd40476b4061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:07.648421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-afdba355-584a-4dc7-a0fa-6f5495682a8f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060060 Mar 08 04:35:07.648827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ea69b694-e66f-4e80-8c87-fd40476b4061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:07.649718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 891/1725] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:07 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:07.659331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ea69b694-e66f-4e80-8c87-fd40476b4061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:07.659782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ea69b694-e66f-4e80-8c87-fd40476b4061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:07.660564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ea69b694-e66f-4e80-8c87-fd40476b4061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:07.661179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ea69b694-e66f-4e80-8c87-fd40476b4061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:07.687481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ea69b694-e66f-4e80-8c87-fd40476b4061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:35:07.760942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ea69b694-e66f-4e80-8c87-fd40476b4061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 204 len: 0 microversion: 2.1 time: 0.126784 Mar 08 04:35:07.761600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 835/1726] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:35:07 2022] DELETE /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:35:07.770646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b59406c8-4ffb-4457-bd87-1d8fe51f51e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:07.771338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b59406c8-4ffb-4457-bd87-1d8fe51f51e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:07.777350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b59406c8-4ffb-4457-bd87-1d8fe51f51e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:07.777834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b59406c8-4ffb-4457-bd87-1d8fe51f51e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:07.779154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b59406c8-4ffb-4457-bd87-1d8fe51f51e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:07.779588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b59406c8-4ffb-4457-bd87-1d8fe51f51e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:07.913272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b59406c8-4ffb-4457-bd87-1d8fe51f51e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:07.921283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b59406c8-4ffb-4457-bd87-1d8fe51f51e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154715 Mar 08 04:35:07.921901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 892/1727] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:08.649559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-396acc01-62fc-4be0-a43d-9f70703341fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:08.650308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-396acc01-62fc-4be0-a43d-9f70703341fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:08.657418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-396acc01-62fc-4be0-a43d-9f70703341fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:08.657896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-396acc01-62fc-4be0-a43d-9f70703341fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:08.658667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-396acc01-62fc-4be0-a43d-9f70703341fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:08.659102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-396acc01-62fc-4be0-a43d-9f70703341fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:08.660318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dbd02a11-78ec-4a14-bad5-4e65ffc141ad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:08.661221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dbd02a11-78ec-4a14-bad5-4e65ffc141ad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:08.667898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbd02a11-78ec-4a14-bad5-4e65ffc141ad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:08.668342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbd02a11-78ec-4a14-bad5-4e65ffc141ad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:08.669741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbd02a11-78ec-4a14-bad5-4e65ffc141ad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:08.670181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbd02a11-78ec-4a14-bad5-4e65ffc141ad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:08.698385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dbd02a11-78ec-4a14-bad5-4e65ffc141ad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041916 Mar 08 04:35:08.698954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 893/1728] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:08 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:08.719438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-396acc01-62fc-4be0-a43d-9f70703341fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:08.726716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-396acc01-62fc-4be0-a43d-9f70703341fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081398 Mar 08 04:35:08.727275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 836/1729] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:08 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:08.938592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0ecb538c-bdef-44c8-af82-d53b9d247c15 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:08.939204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0ecb538c-bdef-44c8-af82-d53b9d247c15 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:08.945029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ecb538c-bdef-44c8-af82-d53b9d247c15 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:08.945476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ecb538c-bdef-44c8-af82-d53b9d247c15 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:08.946278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ecb538c-bdef-44c8-af82-d53b9d247c15 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:08.946714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ecb538c-bdef-44c8-af82-d53b9d247c15 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:09.077953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0ecb538c-bdef-44c8-af82-d53b9d247c15 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:09.085571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0ecb538c-bdef-44c8-af82-d53b9d247c15 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150894 Mar 08 04:35:09.086181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 894/1730] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:09.710223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d587476d-604c-4eb1-a2a9-15e05ca59da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:09.711131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d587476d-604c-4eb1-a2a9-15e05ca59da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:09.717424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d587476d-604c-4eb1-a2a9-15e05ca59da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:09.717908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d587476d-604c-4eb1-a2a9-15e05ca59da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:09.718674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d587476d-604c-4eb1-a2a9-15e05ca59da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:09.719106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d587476d-604c-4eb1-a2a9-15e05ca59da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:09.743813 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5a1efcd0-1323-4e76-89fb-bf3e57c3fcb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:09.744533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5a1efcd0-1323-4e76-89fb-bf3e57c3fcb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:09.746609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d587476d-604c-4eb1-a2a9-15e05ca59da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040344 Mar 08 04:35:09.747819 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 837/1731] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:09 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:09.751485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a1efcd0-1323-4e76-89fb-bf3e57c3fcb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:09.751931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a1efcd0-1323-4e76-89fb-bf3e57c3fcb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:09.752693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a1efcd0-1323-4e76-89fb-bf3e57c3fcb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:09.753123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a1efcd0-1323-4e76-89fb-bf3e57c3fcb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:09.811679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5a1efcd0-1323-4e76-89fb-bf3e57c3fcb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:09.820269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5a1efcd0-1323-4e76-89fb-bf3e57c3fcb5 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080168 Mar 08 04:35:09.821211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 895/1732] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:09 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:10.103221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-af128e70-a92f-49d9-b077-d4fdffef2e2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:10.103764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-af128e70-a92f-49d9-b077-d4fdffef2e2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:10.110277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-af128e70-a92f-49d9-b077-d4fdffef2e2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:10.110728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-af128e70-a92f-49d9-b077-d4fdffef2e2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:10.111484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-af128e70-a92f-49d9-b077-d4fdffef2e2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:10.111919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-af128e70-a92f-49d9-b077-d4fdffef2e2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:10.242312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-af128e70-a92f-49d9-b077-d4fdffef2e2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:10.250076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-af128e70-a92f-49d9-b077-d4fdffef2e2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150788 Mar 08 04:35:10.250636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 838/1733] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:10.758753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-549324c2-f760-4f25-91cb-d8c4ec46c5de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:10.759742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-549324c2-f760-4f25-91cb-d8c4ec46c5de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:10.766772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-549324c2-f760-4f25-91cb-d8c4ec46c5de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:10.767214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-549324c2-f760-4f25-91cb-d8c4ec46c5de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:10.767969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-549324c2-f760-4f25-91cb-d8c4ec46c5de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:10.768402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-549324c2-f760-4f25-91cb-d8c4ec46c5de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:10.797224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-549324c2-f760-4f25-91cb-d8c4ec46c5de tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042359 Mar 08 04:35:10.797802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 896/1734] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:10 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:10.836651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b4f5a417-dba5-41d7-beca-611fed8b1274 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:10.837254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b4f5a417-dba5-41d7-beca-611fed8b1274 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:10.844086 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4f5a417-dba5-41d7-beca-611fed8b1274 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:10.844529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4f5a417-dba5-41d7-beca-611fed8b1274 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:10.845284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4f5a417-dba5-41d7-beca-611fed8b1274 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:10.845744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4f5a417-dba5-41d7-beca-611fed8b1274 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:10.904087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b4f5a417-dba5-41d7-beca-611fed8b1274 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:10.911199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b4f5a417-dba5-41d7-beca-611fed8b1274 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078358 Mar 08 04:35:10.911748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 839/1735] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:10 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:11.267405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1028e556-8d56-43c2-8803-7514cb2c7803 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:11.268043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1028e556-8d56-43c2-8803-7514cb2c7803 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:11.273883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1028e556-8d56-43c2-8803-7514cb2c7803 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:11.274332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1028e556-8d56-43c2-8803-7514cb2c7803 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:11.275087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1028e556-8d56-43c2-8803-7514cb2c7803 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:11.275516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1028e556-8d56-43c2-8803-7514cb2c7803 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:11.407908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1028e556-8d56-43c2-8803-7514cb2c7803 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:11.415554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1028e556-8d56-43c2-8803-7514cb2c7803 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152018 Mar 08 04:35:11.416113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 897/1736] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:11.808444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1cd609ca-dc9c-4186-880d-dd2f2fd4ac45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:11.809476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1cd609ca-dc9c-4186-880d-dd2f2fd4ac45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:11.815602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1cd609ca-dc9c-4186-880d-dd2f2fd4ac45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:11.816048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1cd609ca-dc9c-4186-880d-dd2f2fd4ac45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:11.816808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1cd609ca-dc9c-4186-880d-dd2f2fd4ac45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:11.817243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1cd609ca-dc9c-4186-880d-dd2f2fd4ac45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:11.846847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1cd609ca-dc9c-4186-880d-dd2f2fd4ac45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042422 Mar 08 04:35:11.847494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 840/1737] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:11.927774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-304a0f7c-ae77-40ef-b842-027ce7a69990 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:11.928383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-304a0f7c-ae77-40ef-b842-027ce7a69990 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:11.934785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-304a0f7c-ae77-40ef-b842-027ce7a69990 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:11.935225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-304a0f7c-ae77-40ef-b842-027ce7a69990 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:11.935983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-304a0f7c-ae77-40ef-b842-027ce7a69990 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:11.936414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-304a0f7c-ae77-40ef-b842-027ce7a69990 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:11.994271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-304a0f7c-ae77-40ef-b842-027ce7a69990 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:12.001877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-304a0f7c-ae77-40ef-b842-027ce7a69990 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077965 Mar 08 04:35:12.002434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 898/1738] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:11 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:12.433711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-95ac345d-7b6d-43df-a95e-09106e0989aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:12.434456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-95ac345d-7b6d-43df-a95e-09106e0989aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:12.440409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95ac345d-7b6d-43df-a95e-09106e0989aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:12.440853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95ac345d-7b6d-43df-a95e-09106e0989aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:12.441635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95ac345d-7b6d-43df-a95e-09106e0989aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:12.442093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95ac345d-7b6d-43df-a95e-09106e0989aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:12.572091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-95ac345d-7b6d-43df-a95e-09106e0989aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:12.580048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-95ac345d-7b6d-43df-a95e-09106e0989aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150212 Mar 08 04:35:12.580633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 841/1739] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:12.859368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-61a8d026-375e-4995-9854-d97f7eea1d5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:12.860339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-61a8d026-375e-4995-9854-d97f7eea1d5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:12.866232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61a8d026-375e-4995-9854-d97f7eea1d5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:12.866677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61a8d026-375e-4995-9854-d97f7eea1d5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:12.867434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61a8d026-375e-4995-9854-d97f7eea1d5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:12.867866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61a8d026-375e-4995-9854-d97f7eea1d5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:12.895989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-61a8d026-375e-4995-9854-d97f7eea1d5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Mar 08 04:35:12.897236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 899/1740] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:13.018497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-06592df7-ee94-473d-8fd9-c7e7a8c826a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:13.019091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-06592df7-ee94-473d-8fd9-c7e7a8c826a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:13.025173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-06592df7-ee94-473d-8fd9-c7e7a8c826a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:13.025619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-06592df7-ee94-473d-8fd9-c7e7a8c826a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:13.026465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-06592df7-ee94-473d-8fd9-c7e7a8c826a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:13.027153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-06592df7-ee94-473d-8fd9-c7e7a8c826a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:13.088066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-06592df7-ee94-473d-8fd9-c7e7a8c826a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:13.095293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-06592df7-ee94-473d-8fd9-c7e7a8c826a9 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080659 Mar 08 04:35:13.095846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 842/1741] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:13 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:13.597294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-428c3731-cd73-44ce-987d-ce4b227a537c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:13.597937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-428c3731-cd73-44ce-987d-ce4b227a537c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:13.604154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-428c3731-cd73-44ce-987d-ce4b227a537c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:13.604604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-428c3731-cd73-44ce-987d-ce4b227a537c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:13.605367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-428c3731-cd73-44ce-987d-ce4b227a537c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:13.605828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-428c3731-cd73-44ce-987d-ce4b227a537c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:13.735687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-428c3731-cd73-44ce-987d-ce4b227a537c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:13.743346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-428c3731-cd73-44ce-987d-ce4b227a537c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149869 Mar 08 04:35:13.743910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 900/1742] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:13.908538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-95ae4ccd-307f-4071-8ef1-855b427b489a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:13.909615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-95ae4ccd-307f-4071-8ef1-855b427b489a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:13.915681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95ae4ccd-307f-4071-8ef1-855b427b489a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:13.916125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95ae4ccd-307f-4071-8ef1-855b427b489a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:13.916879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95ae4ccd-307f-4071-8ef1-855b427b489a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:13.917308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95ae4ccd-307f-4071-8ef1-855b427b489a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:13.945492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-95ae4ccd-307f-4071-8ef1-855b427b489a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040910 Mar 08 04:35:13.946054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 843/1743] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:13 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:14.112101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7c1fb569-a656-4704-998a-646665e6cf56 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:14.112641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7c1fb569-a656-4704-998a-646665e6cf56 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:14.118497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c1fb569-a656-4704-998a-646665e6cf56 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:14.118947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c1fb569-a656-4704-998a-646665e6cf56 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:14.119710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c1fb569-a656-4704-998a-646665e6cf56 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:14.120149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c1fb569-a656-4704-998a-646665e6cf56 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:14.179716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7c1fb569-a656-4704-998a-646665e6cf56 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:14.187607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7c1fb569-a656-4704-998a-646665e6cf56 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079537 Mar 08 04:35:14.188172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 901/1744] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:14 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:14.761382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-31ef3448-549a-4051-b4e9-edff50dab22e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:14.762010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-31ef3448-549a-4051-b4e9-edff50dab22e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:14.768788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ef3448-549a-4051-b4e9-edff50dab22e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:14.769224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ef3448-549a-4051-b4e9-edff50dab22e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:14.769996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ef3448-549a-4051-b4e9-edff50dab22e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:14.770424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ef3448-549a-4051-b4e9-edff50dab22e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:14.904555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-31ef3448-549a-4051-b4e9-edff50dab22e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:14.912173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-31ef3448-549a-4051-b4e9-edff50dab22e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154612 Mar 08 04:35:14.912727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 844/1745] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:14.956819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0341decf-b29d-4f89-8041-9ca70db4e219 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:14.957770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0341decf-b29d-4f89-8041-9ca70db4e219 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:14.963949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0341decf-b29d-4f89-8041-9ca70db4e219 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:14.964403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0341decf-b29d-4f89-8041-9ca70db4e219 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:14.965197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0341decf-b29d-4f89-8041-9ca70db4e219 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:14.965637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0341decf-b29d-4f89-8041-9ca70db4e219 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:14.992823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0341decf-b29d-4f89-8041-9ca70db4e219 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039946 Mar 08 04:35:14.993355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 902/1746] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:15.204328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8c72db06-527d-4945-a44f-371cb38727c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:15.204948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8c72db06-527d-4945-a44f-371cb38727c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:15.210799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c72db06-527d-4945-a44f-371cb38727c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:15.211251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c72db06-527d-4945-a44f-371cb38727c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:15.212008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c72db06-527d-4945-a44f-371cb38727c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:15.212443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c72db06-527d-4945-a44f-371cb38727c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:15.273549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8c72db06-527d-4945-a44f-371cb38727c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:15.281083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8c72db06-527d-4945-a44f-371cb38727c4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080645 Mar 08 04:35:15.281636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 845/1747] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:15 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:15.929014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-41e5c5ed-3496-45fc-9c3b-3d81eecd3f72 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:15.929624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-41e5c5ed-3496-45fc-9c3b-3d81eecd3f72 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:15.935896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41e5c5ed-3496-45fc-9c3b-3d81eecd3f72 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:15.936347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41e5c5ed-3496-45fc-9c3b-3d81eecd3f72 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:15.937125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41e5c5ed-3496-45fc-9c3b-3d81eecd3f72 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:15.937566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41e5c5ed-3496-45fc-9c3b-3d81eecd3f72 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:16.004562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fd564732-fd21-4099-a04e-fd0c53242b06 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:16.005505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fd564732-fd21-4099-a04e-fd0c53242b06 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:16.011712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fd564732-fd21-4099-a04e-fd0c53242b06 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:16.012158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fd564732-fd21-4099-a04e-fd0c53242b06 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:16.013424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fd564732-fd21-4099-a04e-fd0c53242b06 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:16.013890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fd564732-fd21-4099-a04e-fd0c53242b06 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:16.042863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fd564732-fd21-4099-a04e-fd0c53242b06 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 Mar 08 04:35:16.043418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 846/1748] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:15 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:16.067957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-41e5c5ed-3496-45fc-9c3b-3d81eecd3f72 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:16.079289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-41e5c5ed-3496-45fc-9c3b-3d81eecd3f72 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154165 Mar 08 04:35:16.079877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 903/1749] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:16.297779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2ff57d46-1e69-42db-af0e-95db10f966d0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:16.298410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2ff57d46-1e69-42db-af0e-95db10f966d0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:16.304213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ff57d46-1e69-42db-af0e-95db10f966d0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:16.304666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ff57d46-1e69-42db-af0e-95db10f966d0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:16.305426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ff57d46-1e69-42db-af0e-95db10f966d0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:16.305909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ff57d46-1e69-42db-af0e-95db10f966d0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:16.367877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ff57d46-1e69-42db-af0e-95db10f966d0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:16.375220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2ff57d46-1e69-42db-af0e-95db10f966d0 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081306 Mar 08 04:35:16.375775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 847/1750] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:16 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:17.054386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-30b90302-07c5-4aaf-ad13-b414ade61dc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:17.055312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-30b90302-07c5-4aaf-ad13-b414ade61dc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:17.061790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30b90302-07c5-4aaf-ad13-b414ade61dc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:17.062248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30b90302-07c5-4aaf-ad13-b414ade61dc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:17.063026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30b90302-07c5-4aaf-ad13-b414ade61dc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:17.063469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-30b90302-07c5-4aaf-ad13-b414ade61dc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:17.091729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-30b90302-07c5-4aaf-ad13-b414ade61dc6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041307 Mar 08 04:35:17.093959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 904/1751] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:17.097147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-70323cb5-2add-4446-aa8d-663c066fd645 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:17.097797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-70323cb5-2add-4446-aa8d-663c066fd645 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:17.104232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-70323cb5-2add-4446-aa8d-663c066fd645 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:17.104647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-70323cb5-2add-4446-aa8d-663c066fd645 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:17.105410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-70323cb5-2add-4446-aa8d-663c066fd645 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:17.105889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-70323cb5-2add-4446-aa8d-663c066fd645 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:17.235083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-70323cb5-2add-4446-aa8d-663c066fd645 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:17.242745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-70323cb5-2add-4446-aa8d-663c066fd645 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149561 Mar 08 04:35:17.243310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 848/1752] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:17.392425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a9d48579-e9b7-45eb-821f-e7f79300a82e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:17.392968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a9d48579-e9b7-45eb-821f-e7f79300a82e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:17.398752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a9d48579-e9b7-45eb-821f-e7f79300a82e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:17.399191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a9d48579-e9b7-45eb-821f-e7f79300a82e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:17.399943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a9d48579-e9b7-45eb-821f-e7f79300a82e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:17.400373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a9d48579-e9b7-45eb-821f-e7f79300a82e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:17.458244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a9d48579-e9b7-45eb-821f-e7f79300a82e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:17.466445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a9d48579-e9b7-45eb-821f-e7f79300a82e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077052 Mar 08 04:35:17.467079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 905/1753] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:17 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:18.103170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2cb99bbb-33f4-4674-8654-cb8f901b1958 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:18.104005 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2cb99bbb-33f4-4674-8654-cb8f901b1958 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:18.110554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2cb99bbb-33f4-4674-8654-cb8f901b1958 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:18.111006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2cb99bbb-33f4-4674-8654-cb8f901b1958 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:18.111772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2cb99bbb-33f4-4674-8654-cb8f901b1958 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:18.112207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2cb99bbb-33f4-4674-8654-cb8f901b1958 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:18.141441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2cb99bbb-33f4-4674-8654-cb8f901b1958 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042247 Mar 08 04:35:18.142015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 849/1754] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:18 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:18.260842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5dfe54f2-01cd-4e58-8099-12ee19956214 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:18.261552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5dfe54f2-01cd-4e58-8099-12ee19956214 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:18.268120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dfe54f2-01cd-4e58-8099-12ee19956214 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:18.268549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dfe54f2-01cd-4e58-8099-12ee19956214 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:18.269305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dfe54f2-01cd-4e58-8099-12ee19956214 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:18.269767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dfe54f2-01cd-4e58-8099-12ee19956214 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:18.406285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5dfe54f2-01cd-4e58-8099-12ee19956214 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:18.414053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5dfe54f2-01cd-4e58-8099-12ee19956214 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.157163 Mar 08 04:35:18.414623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 906/1755] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:18.483674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-efc46fec-7e75-430a-a42d-a4e2b6e2f2fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:18.484439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-efc46fec-7e75-430a-a42d-a4e2b6e2f2fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:18.490255 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-efc46fec-7e75-430a-a42d-a4e2b6e2f2fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:18.490710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-efc46fec-7e75-430a-a42d-a4e2b6e2f2fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:18.491471 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-efc46fec-7e75-430a-a42d-a4e2b6e2f2fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:18.491904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-efc46fec-7e75-430a-a42d-a4e2b6e2f2fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:18.550365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-efc46fec-7e75-430a-a42d-a4e2b6e2f2fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:18.557628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-efc46fec-7e75-430a-a42d-a4e2b6e2f2fd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078460 Mar 08 04:35:18.558208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 850/1756] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:18 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:19.153768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2c1b81b5-acf6-4399-97ee-0bf1d2ebad16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:19.154609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2c1b81b5-acf6-4399-97ee-0bf1d2ebad16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:19.160562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c1b81b5-acf6-4399-97ee-0bf1d2ebad16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:19.161030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c1b81b5-acf6-4399-97ee-0bf1d2ebad16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:19.161794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c1b81b5-acf6-4399-97ee-0bf1d2ebad16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:19.162241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c1b81b5-acf6-4399-97ee-0bf1d2ebad16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:19.190461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2c1b81b5-acf6-4399-97ee-0bf1d2ebad16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041688 Mar 08 04:35:19.191007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 907/1757] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:19 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:19.431158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ec34cff2-0d41-4bba-a161-61b1b82e23b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:19.431776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ec34cff2-0d41-4bba-a161-61b1b82e23b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:19.438161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec34cff2-0d41-4bba-a161-61b1b82e23b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:19.438613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec34cff2-0d41-4bba-a161-61b1b82e23b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:19.439384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec34cff2-0d41-4bba-a161-61b1b82e23b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:19.439822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec34cff2-0d41-4bba-a161-61b1b82e23b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:19.568954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ec34cff2-0d41-4bba-a161-61b1b82e23b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:19.574429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-014991a7-ce12-4de6-aa60-eddc80812dc4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:19.575858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-014991a7-ce12-4de6-aa60-eddc80812dc4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:19.577407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ec34cff2-0d41-4bba-a161-61b1b82e23b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150114 Mar 08 04:35:19.578166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 851/1758] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:19.582181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-014991a7-ce12-4de6-aa60-eddc80812dc4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:19.582630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-014991a7-ce12-4de6-aa60-eddc80812dc4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:19.583397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-014991a7-ce12-4de6-aa60-eddc80812dc4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:19.583828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-014991a7-ce12-4de6-aa60-eddc80812dc4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:19.645949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-014991a7-ce12-4de6-aa60-eddc80812dc4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:19.654317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-014991a7-ce12-4de6-aa60-eddc80812dc4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.083484 Mar 08 04:35:19.654874 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 908/1759] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:19 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:20.202278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fa694caf-a0eb-455f-bd05-69b20274dea1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:20.203188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fa694caf-a0eb-455f-bd05-69b20274dea1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:20.209070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa694caf-a0eb-455f-bd05-69b20274dea1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:20.209544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa694caf-a0eb-455f-bd05-69b20274dea1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:20.210335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa694caf-a0eb-455f-bd05-69b20274dea1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:20.210773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa694caf-a0eb-455f-bd05-69b20274dea1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:20.238326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fa694caf-a0eb-455f-bd05-69b20274dea1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040560 Mar 08 04:35:20.238869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 852/1760] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:20.595149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d5804eec-1be1-4849-8407-0bd1b86ef702 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:20.595722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d5804eec-1be1-4849-8407-0bd1b86ef702 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:20.601926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5804eec-1be1-4849-8407-0bd1b86ef702 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:20.602373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5804eec-1be1-4849-8407-0bd1b86ef702 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:20.603154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5804eec-1be1-4849-8407-0bd1b86ef702 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:20.603587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5804eec-1be1-4849-8407-0bd1b86ef702 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:20.670919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-509f30cb-ea94-4908-bcbc-c2440743adad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:20.671522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-509f30cb-ea94-4908-bcbc-c2440743adad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:20.677963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-509f30cb-ea94-4908-bcbc-c2440743adad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:20.678410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-509f30cb-ea94-4908-bcbc-c2440743adad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:20.679165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-509f30cb-ea94-4908-bcbc-c2440743adad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:20.679595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-509f30cb-ea94-4908-bcbc-c2440743adad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:20.747259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-509f30cb-ea94-4908-bcbc-c2440743adad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:20.755745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-509f30cb-ea94-4908-bcbc-c2440743adad tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.088623 Mar 08 04:35:20.756313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 853/1761] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:20 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:20.761366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d5804eec-1be1-4849-8407-0bd1b86ef702 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:20.769285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d5804eec-1be1-4849-8407-0bd1b86ef702 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.178185 Mar 08 04:35:20.769862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 909/1762] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:21.250606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-46ca0388-317e-4964-98ac-00b0219856ed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:21.251514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-46ca0388-317e-4964-98ac-00b0219856ed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:21.257337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46ca0388-317e-4964-98ac-00b0219856ed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:21.257808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46ca0388-317e-4964-98ac-00b0219856ed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:21.258568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46ca0388-317e-4964-98ac-00b0219856ed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:21.258995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46ca0388-317e-4964-98ac-00b0219856ed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:21.287598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-46ca0388-317e-4964-98ac-00b0219856ed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041566 Mar 08 04:35:21.288145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 854/1763] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:21 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:21.772352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bfd370af-490b-4040-8c05-e59258ba71ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:21.772967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bfd370af-490b-4040-8c05-e59258ba71ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:21.779743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bfd370af-490b-4040-8c05-e59258ba71ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:21.780192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bfd370af-490b-4040-8c05-e59258ba71ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:21.780960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bfd370af-490b-4040-8c05-e59258ba71ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:21.781480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bfd370af-490b-4040-8c05-e59258ba71ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:21.786468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e0156b80-ab87-4347-a325-e4030fd77b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:21.787076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e0156b80-ab87-4347-a325-e4030fd77b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:21.793916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0156b80-ab87-4347-a325-e4030fd77b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:21.794365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0156b80-ab87-4347-a325-e4030fd77b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:21.795133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0156b80-ab87-4347-a325-e4030fd77b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:21.795562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0156b80-ab87-4347-a325-e4030fd77b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:21.852581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bfd370af-490b-4040-8c05-e59258ba71ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:21.860662 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bfd370af-490b-4040-8c05-e59258ba71ca tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.092122 Mar 08 04:35:21.861229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 910/1764] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:21 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:21.946812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e0156b80-ab87-4347-a325-e4030fd77b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:21.955260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e0156b80-ab87-4347-a325-e4030fd77b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.172641 Mar 08 04:35:21.955816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 855/1765] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:22.299119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5e9c8b04-e78e-4881-a203-584245e617c5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:22.300024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5e9c8b04-e78e-4881-a203-584245e617c5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:22.305986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e9c8b04-e78e-4881-a203-584245e617c5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:22.306458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e9c8b04-e78e-4881-a203-584245e617c5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:22.307261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e9c8b04-e78e-4881-a203-584245e617c5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:22.307692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5e9c8b04-e78e-4881-a203-584245e617c5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:22.335281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5e9c8b04-e78e-4881-a203-584245e617c5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040246 Mar 08 04:35:22.335821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 911/1766] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:22.876971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-83a6f666-972e-49b2-b457-68a636931d07 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:22.877575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-83a6f666-972e-49b2-b457-68a636931d07 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:22.883794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83a6f666-972e-49b2-b457-68a636931d07 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:22.884235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83a6f666-972e-49b2-b457-68a636931d07 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:22.884987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83a6f666-972e-49b2-b457-68a636931d07 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:22.885420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83a6f666-972e-49b2-b457-68a636931d07 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:22.943626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-83a6f666-972e-49b2-b457-68a636931d07 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:22.951347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-83a6f666-972e-49b2-b457-68a636931d07 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078283 Mar 08 04:35:22.951903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 856/1767] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:22 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:22.972105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b1b8f39a-2c7e-4d87-ba7f-e50186c6debe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:22.972715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b1b8f39a-2c7e-4d87-ba7f-e50186c6debe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:22.978980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1b8f39a-2c7e-4d87-ba7f-e50186c6debe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:22.979427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1b8f39a-2c7e-4d87-ba7f-e50186c6debe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:22.980192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1b8f39a-2c7e-4d87-ba7f-e50186c6debe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:22.980641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1b8f39a-2c7e-4d87-ba7f-e50186c6debe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:23.109519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b1b8f39a-2c7e-4d87-ba7f-e50186c6debe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:23.117174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b1b8f39a-2c7e-4d87-ba7f-e50186c6debe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148915 Mar 08 04:35:23.117755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 912/1768] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:23.347425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-683622f6-89bb-4f27-b413-74736e80e1b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:23.348336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-683622f6-89bb-4f27-b413-74736e80e1b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:23.354224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-683622f6-89bb-4f27-b413-74736e80e1b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:23.354674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-683622f6-89bb-4f27-b413-74736e80e1b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:23.355430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-683622f6-89bb-4f27-b413-74736e80e1b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:23.355918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-683622f6-89bb-4f27-b413-74736e80e1b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:23.388761 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-683622f6-89bb-4f27-b413-74736e80e1b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Mar 08 04:35:23.389231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 857/1769] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:23.968741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5d659abc-6f50-400e-b551-4f40badbe8fc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:23.969336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5d659abc-6f50-400e-b551-4f40badbe8fc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:23.975218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d659abc-6f50-400e-b551-4f40badbe8fc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:23.975770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d659abc-6f50-400e-b551-4f40badbe8fc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:23.976403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d659abc-6f50-400e-b551-4f40badbe8fc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:23.976834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5d659abc-6f50-400e-b551-4f40badbe8fc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:24.037812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5d659abc-6f50-400e-b551-4f40badbe8fc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:24.045216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5d659abc-6f50-400e-b551-4f40badbe8fc tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081009 Mar 08 04:35:24.045793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 913/1770] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:23 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:24.133995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-40359448-63d8-45c8-8e36-b8ac3b561830 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:24.134520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-40359448-63d8-45c8-8e36-b8ac3b561830 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:24.141643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-40359448-63d8-45c8-8e36-b8ac3b561830 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:24.142127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-40359448-63d8-45c8-8e36-b8ac3b561830 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:24.142894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-40359448-63d8-45c8-8e36-b8ac3b561830 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:24.143334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-40359448-63d8-45c8-8e36-b8ac3b561830 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:24.274105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-40359448-63d8-45c8-8e36-b8ac3b561830 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:24.282022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-40359448-63d8-45c8-8e36-b8ac3b561830 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151956 Mar 08 04:35:24.282604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 858/1771] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:24.400562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4281259c-dff1-4765-84ea-5111e7f8dc07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:24.401498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4281259c-dff1-4765-84ea-5111e7f8dc07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:24.408410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4281259c-dff1-4765-84ea-5111e7f8dc07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:24.408865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4281259c-dff1-4765-84ea-5111e7f8dc07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:24.409636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4281259c-dff1-4765-84ea-5111e7f8dc07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:24.410103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4281259c-dff1-4765-84ea-5111e7f8dc07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:24.438284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4281259c-dff1-4765-84ea-5111e7f8dc07 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 Mar 08 04:35:24.438829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 914/1772] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:25.063107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ccf17fa0-198c-4867-9ed6-424ffdee4e46 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:25.063635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ccf17fa0-198c-4867-9ed6-424ffdee4e46 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:25.069448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccf17fa0-198c-4867-9ed6-424ffdee4e46 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:25.069919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccf17fa0-198c-4867-9ed6-424ffdee4e46 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:25.070676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccf17fa0-198c-4867-9ed6-424ffdee4e46 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:25.071105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccf17fa0-198c-4867-9ed6-424ffdee4e46 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:25.130248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ccf17fa0-198c-4867-9ed6-424ffdee4e46 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:25.138193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ccf17fa0-198c-4867-9ed6-424ffdee4e46 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078905 Mar 08 04:35:25.138746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 859/1773] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:25 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:25.299843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b9612f80-bf4f-4438-81d4-c6edc319e413 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:25.300453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b9612f80-bf4f-4438-81d4-c6edc319e413 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:25.307036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b9612f80-bf4f-4438-81d4-c6edc319e413 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:25.307560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b9612f80-bf4f-4438-81d4-c6edc319e413 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:25.308339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b9612f80-bf4f-4438-81d4-c6edc319e413 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:25.308801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b9612f80-bf4f-4438-81d4-c6edc319e413 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:25.440820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b9612f80-bf4f-4438-81d4-c6edc319e413 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:25.448652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b9612f80-bf4f-4438-81d4-c6edc319e413 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152801 Mar 08 04:35:25.449225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 915/1774] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:25.450365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b4083c35-9f16-4e09-9fa2-269aead77b3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:25.451353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b4083c35-9f16-4e09-9fa2-269aead77b3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:25.457751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4083c35-9f16-4e09-9fa2-269aead77b3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:25.458206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4083c35-9f16-4e09-9fa2-269aead77b3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:25.459055 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4083c35-9f16-4e09-9fa2-269aead77b3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:25.459529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4083c35-9f16-4e09-9fa2-269aead77b3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:25.487965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b4083c35-9f16-4e09-9fa2-269aead77b3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 Mar 08 04:35:25.488518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 860/1775] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:26.155281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-39f6c5f9-02ef-4355-b318-589de92f829c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:26.155809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-39f6c5f9-02ef-4355-b318-589de92f829c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:26.161651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39f6c5f9-02ef-4355-b318-589de92f829c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:26.162129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39f6c5f9-02ef-4355-b318-589de92f829c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:26.162882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39f6c5f9-02ef-4355-b318-589de92f829c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:26.163312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39f6c5f9-02ef-4355-b318-589de92f829c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:26.220707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-39f6c5f9-02ef-4355-b318-589de92f829c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:26.227852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-39f6c5f9-02ef-4355-b318-589de92f829c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.076817 Mar 08 04:35:26.228410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 916/1776] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:26 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:26.469277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-98ff5319-33b5-467f-a133-597b2643cfb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:26.469920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-98ff5319-33b5-467f-a133-597b2643cfb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:26.476196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98ff5319-33b5-467f-a133-597b2643cfb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:26.476650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98ff5319-33b5-467f-a133-597b2643cfb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:26.477421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98ff5319-33b5-467f-a133-597b2643cfb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:26.478011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-98ff5319-33b5-467f-a133-597b2643cfb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:26.500022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-910d4916-0ab1-4e22-a9fd-0050d144c043 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:26.500929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-910d4916-0ab1-4e22-a9fd-0050d144c043 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:26.507144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-910d4916-0ab1-4e22-a9fd-0050d144c043 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:26.507590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-910d4916-0ab1-4e22-a9fd-0050d144c043 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:26.508354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-910d4916-0ab1-4e22-a9fd-0050d144c043 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:26.508785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-910d4916-0ab1-4e22-a9fd-0050d144c043 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:26.538026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-910d4916-0ab1-4e22-a9fd-0050d144c043 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Mar 08 04:35:26.538578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 917/1777] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:26 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:26.606665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-98ff5319-33b5-467f-a133-597b2643cfb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:26.614689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-98ff5319-33b5-467f-a133-597b2643cfb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151773 Mar 08 04:35:26.615375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 861/1778] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:27.244791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9264833c-f357-4e07-afe6-99a769ce12f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:27.245391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9264833c-f357-4e07-afe6-99a769ce12f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:27.251341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9264833c-f357-4e07-afe6-99a769ce12f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:27.251783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9264833c-f357-4e07-afe6-99a769ce12f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:27.252542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9264833c-f357-4e07-afe6-99a769ce12f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:27.252974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9264833c-f357-4e07-afe6-99a769ce12f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:27.311016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9264833c-f357-4e07-afe6-99a769ce12f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:27.318295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9264833c-f357-4e07-afe6-99a769ce12f3 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077387 Mar 08 04:35:27.318851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 918/1779] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:27 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:27.549705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a3f3d1f1-8235-4619-81fd-196387eab1db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:27.550518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a3f3d1f1-8235-4619-81fd-196387eab1db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:27.556993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3f3d1f1-8235-4619-81fd-196387eab1db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:27.557437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3f3d1f1-8235-4619-81fd-196387eab1db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:27.558224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3f3d1f1-8235-4619-81fd-196387eab1db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:27.558902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3f3d1f1-8235-4619-81fd-196387eab1db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:27.586662 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a3f3d1f1-8235-4619-81fd-196387eab1db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041194 Mar 08 04:35:27.587195 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 862/1780] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:27 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:27.632977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d7460cc0-3dc0-4923-bcb4-85899588b835 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:27.633591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d7460cc0-3dc0-4923-bcb4-85899588b835 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:27.640462 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7460cc0-3dc0-4923-bcb4-85899588b835 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:27.640910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7460cc0-3dc0-4923-bcb4-85899588b835 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:27.641694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7460cc0-3dc0-4923-bcb4-85899588b835 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:27.642134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7460cc0-3dc0-4923-bcb4-85899588b835 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:27.775760 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d7460cc0-3dc0-4923-bcb4-85899588b835 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:27.783735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d7460cc0-3dc0-4923-bcb4-85899588b835 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154580 Mar 08 04:35:27.784293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 919/1781] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:28.335099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-538cda5e-1e58-47e9-84ae-b675f40647b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:28.335714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-538cda5e-1e58-47e9-84ae-b675f40647b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:28.341688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-538cda5e-1e58-47e9-84ae-b675f40647b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:28.342144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-538cda5e-1e58-47e9-84ae-b675f40647b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:28.342904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-538cda5e-1e58-47e9-84ae-b675f40647b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:28.343343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-538cda5e-1e58-47e9-84ae-b675f40647b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:28.409343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-538cda5e-1e58-47e9-84ae-b675f40647b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:28.416670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-538cda5e-1e58-47e9-84ae-b675f40647b4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.085427 Mar 08 04:35:28.417221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 863/1782] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:28 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:28.598801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7d5cb932-545b-4e24-b91c-69e4cc4e4421 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:28.599627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7d5cb932-545b-4e24-b91c-69e4cc4e4421 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:28.605413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d5cb932-545b-4e24-b91c-69e4cc4e4421 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:28.606501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d5cb932-545b-4e24-b91c-69e4cc4e4421 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:28.607429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d5cb932-545b-4e24-b91c-69e4cc4e4421 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:28.607870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d5cb932-545b-4e24-b91c-69e4cc4e4421 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:28.635866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7d5cb932-545b-4e24-b91c-69e4cc4e4421 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 Mar 08 04:35:28.636440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 920/1783] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:28 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:28.800739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bd0af2b0-a7ce-4e50-8d15-85549eeca501 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:28.801342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bd0af2b0-a7ce-4e50-8d15-85549eeca501 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:28.807568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd0af2b0-a7ce-4e50-8d15-85549eeca501 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:28.808012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd0af2b0-a7ce-4e50-8d15-85549eeca501 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:28.809202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd0af2b0-a7ce-4e50-8d15-85549eeca501 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:28.809640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd0af2b0-a7ce-4e50-8d15-85549eeca501 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:28.941440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bd0af2b0-a7ce-4e50-8d15-85549eeca501 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:28.949092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bd0af2b0-a7ce-4e50-8d15-85549eeca501 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152145 Mar 08 04:35:28.950431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 864/1784] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:29.433540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a7663284-536e-4e3d-9102-52b7d49eb8a6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:29.434109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a7663284-536e-4e3d-9102-52b7d49eb8a6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:29.440450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7663284-536e-4e3d-9102-52b7d49eb8a6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:29.440901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7663284-536e-4e3d-9102-52b7d49eb8a6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:29.441677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7663284-536e-4e3d-9102-52b7d49eb8a6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:29.442117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a7663284-536e-4e3d-9102-52b7d49eb8a6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:29.500073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a7663284-536e-4e3d-9102-52b7d49eb8a6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:29.507288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a7663284-536e-4e3d-9102-52b7d49eb8a6 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077683 Mar 08 04:35:29.507850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 921/1785] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:29 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:29.647474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2f3623ca-92eb-4dcb-93d4-46b3eeb80f77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:29.648380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2f3623ca-92eb-4dcb-93d4-46b3eeb80f77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:29.654994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2f3623ca-92eb-4dcb-93d4-46b3eeb80f77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:29.655433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2f3623ca-92eb-4dcb-93d4-46b3eeb80f77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:29.656188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2f3623ca-92eb-4dcb-93d4-46b3eeb80f77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:29.656619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2f3623ca-92eb-4dcb-93d4-46b3eeb80f77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:29.688046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2f3623ca-92eb-4dcb-93d4-46b3eeb80f77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Mar 08 04:35:29.688512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 865/1786] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:29.967652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-453ba34e-4851-4b30-87e3-d368e43dcaa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:29.968199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-453ba34e-4851-4b30-87e3-d368e43dcaa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:29.974280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-453ba34e-4851-4b30-87e3-d368e43dcaa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:29.974736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-453ba34e-4851-4b30-87e3-d368e43dcaa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:29.975511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-453ba34e-4851-4b30-87e3-d368e43dcaa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:29.975951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-453ba34e-4851-4b30-87e3-d368e43dcaa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:30.103435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-453ba34e-4851-4b30-87e3-d368e43dcaa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:30.111167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-453ba34e-4851-4b30-87e3-d368e43dcaa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148187 Mar 08 04:35:30.111727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 922/1787] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:30.523582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0116ec99-c63a-4198-a134-c3710eefc743 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:30.524191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0116ec99-c63a-4198-a134-c3710eefc743 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:30.530849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0116ec99-c63a-4198-a134-c3710eefc743 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:30.531300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0116ec99-c63a-4198-a134-c3710eefc743 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:30.532064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0116ec99-c63a-4198-a134-c3710eefc743 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:30.532502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0116ec99-c63a-4198-a134-c3710eefc743 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:30.592451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0116ec99-c63a-4198-a134-c3710eefc743 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:30.599680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0116ec99-c63a-4198-a134-c3710eefc743 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080006 Mar 08 04:35:30.600238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 866/1788] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:30 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:30.699865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c2520cd2-4b8b-4d2b-93f7-ae183c8418bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:30.700796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c2520cd2-4b8b-4d2b-93f7-ae183c8418bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:30.707023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c2520cd2-4b8b-4d2b-93f7-ae183c8418bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:30.707468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c2520cd2-4b8b-4d2b-93f7-ae183c8418bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:30.708227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c2520cd2-4b8b-4d2b-93f7-ae183c8418bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:30.708661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c2520cd2-4b8b-4d2b-93f7-ae183c8418bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:30.736409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c2520cd2-4b8b-4d2b-93f7-ae183c8418bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040976 Mar 08 04:35:30.736939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 923/1789] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:31.128327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0cbdc635-b258-49ad-a4b9-a3b102d0a393 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:31.128855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0cbdc635-b258-49ad-a4b9-a3b102d0a393 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:31.135530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cbdc635-b258-49ad-a4b9-a3b102d0a393 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:31.135530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cbdc635-b258-49ad-a4b9-a3b102d0a393 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:31.135855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cbdc635-b258-49ad-a4b9-a3b102d0a393 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:31.136286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cbdc635-b258-49ad-a4b9-a3b102d0a393 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:31.266650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0cbdc635-b258-49ad-a4b9-a3b102d0a393 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:31.274260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0cbdc635-b258-49ad-a4b9-a3b102d0a393 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149970 Mar 08 04:35:31.274813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 867/1790] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:31.616315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-32ba251d-c6a9-4620-bb1c-968af70ceb2c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:31.616915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-32ba251d-c6a9-4620-bb1c-968af70ceb2c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:31.623434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32ba251d-c6a9-4620-bb1c-968af70ceb2c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:31.623874 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32ba251d-c6a9-4620-bb1c-968af70ceb2c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:31.624627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32ba251d-c6a9-4620-bb1c-968af70ceb2c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:31.625058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32ba251d-c6a9-4620-bb1c-968af70ceb2c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:31.687484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-32ba251d-c6a9-4620-bb1c-968af70ceb2c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:31.694916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-32ba251d-c6a9-4620-bb1c-968af70ceb2c tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.082457 Mar 08 04:35:31.695475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 924/1791] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:31 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:31.748318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c422d07d-44a6-4328-9d12-757f2567160a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:31.749264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c422d07d-44a6-4328-9d12-757f2567160a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:31.755391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c422d07d-44a6-4328-9d12-757f2567160a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:31.755864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c422d07d-44a6-4328-9d12-757f2567160a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:31.756619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c422d07d-44a6-4328-9d12-757f2567160a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:31.757047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c422d07d-44a6-4328-9d12-757f2567160a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:31.785757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c422d07d-44a6-4328-9d12-757f2567160a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041985 Mar 08 04:35:31.786307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 868/1792] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:31 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:32.292147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-64bcc71f-781b-4f6d-a39b-9a9a2553786c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:32.292754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-64bcc71f-781b-4f6d-a39b-9a9a2553786c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:32.299575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64bcc71f-781b-4f6d-a39b-9a9a2553786c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:32.300030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64bcc71f-781b-4f6d-a39b-9a9a2553786c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:32.300799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64bcc71f-781b-4f6d-a39b-9a9a2553786c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:32.301237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64bcc71f-781b-4f6d-a39b-9a9a2553786c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:32.428474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-64bcc71f-781b-4f6d-a39b-9a9a2553786c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:32.436636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-64bcc71f-781b-4f6d-a39b-9a9a2553786c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148377 Mar 08 04:35:32.437193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 925/1793] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:32.712928 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c1455ac9-2a6c-4cd7-93fe-8c05db652143 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:32.713564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c1455ac9-2a6c-4cd7-93fe-8c05db652143 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:32.719560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1455ac9-2a6c-4cd7-93fe-8c05db652143 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:32.720009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1455ac9-2a6c-4cd7-93fe-8c05db652143 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:32.720797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1455ac9-2a6c-4cd7-93fe-8c05db652143 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:32.721233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1455ac9-2a6c-4cd7-93fe-8c05db652143 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:32.786927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c1455ac9-2a6c-4cd7-93fe-8c05db652143 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:32.794754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c1455ac9-2a6c-4cd7-93fe-8c05db652143 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.086079 Mar 08 04:35:32.795495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 869/1794] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:32 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:32.797459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1666bf82-5f8a-4bd3-9ff8-07352bd871fb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:32.798621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1666bf82-5f8a-4bd3-9ff8-07352bd871fb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:32.804419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1666bf82-5f8a-4bd3-9ff8-07352bd871fb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:32.804872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1666bf82-5f8a-4bd3-9ff8-07352bd871fb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:32.805637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1666bf82-5f8a-4bd3-9ff8-07352bd871fb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:32.806097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1666bf82-5f8a-4bd3-9ff8-07352bd871fb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:32.834504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1666bf82-5f8a-4bd3-9ff8-07352bd871fb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041927 Mar 08 04:35:32.835047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 926/1795] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:32 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:33.453641 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7617adcb-3c81-454f-8ea3-0851f7b67aa8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:33.454276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7617adcb-3c81-454f-8ea3-0851f7b67aa8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:33.460213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7617adcb-3c81-454f-8ea3-0851f7b67aa8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:33.460660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7617adcb-3c81-454f-8ea3-0851f7b67aa8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:33.461419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7617adcb-3c81-454f-8ea3-0851f7b67aa8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:33.461887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7617adcb-3c81-454f-8ea3-0851f7b67aa8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:33.591594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7617adcb-3c81-454f-8ea3-0851f7b67aa8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:33.599323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7617adcb-3c81-454f-8ea3-0851f7b67aa8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149518 Mar 08 04:35:33.599879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 870/1796] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:33.811713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ece5f14c-85a2-4ce0-bc55-8872d274168e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:33.812240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ece5f14c-85a2-4ce0-bc55-8872d274168e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:33.818612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece5f14c-85a2-4ce0-bc55-8872d274168e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:33.819317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece5f14c-85a2-4ce0-bc55-8872d274168e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:33.820092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece5f14c-85a2-4ce0-bc55-8872d274168e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:33.820526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece5f14c-85a2-4ce0-bc55-8872d274168e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:33.847075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5e076c20-528f-4ff6-aca6-4083a2a126dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:33.848138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5e076c20-528f-4ff6-aca6-4083a2a126dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:33.860063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e076c20-528f-4ff6-aca6-4083a2a126dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:33.860616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e076c20-528f-4ff6-aca6-4083a2a126dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:33.861396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e076c20-528f-4ff6-aca6-4083a2a126dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:33.861919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e076c20-528f-4ff6-aca6-4083a2a126dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:33.883348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ece5f14c-85a2-4ce0-bc55-8872d274168e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:33.891946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ece5f14c-85a2-4ce0-bc55-8872d274168e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.084970 Mar 08 04:35:33.892752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 927/1797] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:33 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:33.892886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5e076c20-528f-4ff6-aca6-4083a2a126dc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049714 Mar 08 04:35:33.893420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 871/1798] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:34.616292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-75d49180-5955-4789-b50d-4160bf931074 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:34.616956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-75d49180-5955-4789-b50d-4160bf931074 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:34.622878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-75d49180-5955-4789-b50d-4160bf931074 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:34.623322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-75d49180-5955-4789-b50d-4160bf931074 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:34.624082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-75d49180-5955-4789-b50d-4160bf931074 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:34.624519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-75d49180-5955-4789-b50d-4160bf931074 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:34.762741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-75d49180-5955-4789-b50d-4160bf931074 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:34.770472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-75d49180-5955-4789-b50d-4160bf931074 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.158048 Mar 08 04:35:34.771044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 928/1799] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:34.905238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3a9d8ae0-a1d8-4584-9d4b-0eb20494aeee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:34.906100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3a9d8ae0-a1d8-4584-9d4b-0eb20494aeee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:34.908903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9c326766-a9ed-4b1a-9086-cebb69c63d7a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:34.909513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9c326766-a9ed-4b1a-9086-cebb69c63d7a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:34.912361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a9d8ae0-a1d8-4584-9d4b-0eb20494aeee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:34.912807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a9d8ae0-a1d8-4584-9d4b-0eb20494aeee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:34.913568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a9d8ae0-a1d8-4584-9d4b-0eb20494aeee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:34.914025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a9d8ae0-a1d8-4584-9d4b-0eb20494aeee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:34.915708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9c326766-a9ed-4b1a-9086-cebb69c63d7a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:34.916152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9c326766-a9ed-4b1a-9086-cebb69c63d7a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:34.916912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9c326766-a9ed-4b1a-9086-cebb69c63d7a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:34.917348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9c326766-a9ed-4b1a-9086-cebb69c63d7a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:34.943033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3a9d8ae0-a1d8-4584-9d4b-0eb20494aeee tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042527 Mar 08 04:35:34.943603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 872/1800] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:34.976270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9c326766-a9ed-4b1a-9086-cebb69c63d7a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:34.985402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9c326766-a9ed-4b1a-9086-cebb69c63d7a tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080503 Mar 08 04:35:34.986010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 929/1801] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:34 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:35.788019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0df24cfe-57e1-441a-8d10-789ed5386c3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:35.788631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0df24cfe-57e1-441a-8d10-789ed5386c3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:35.794744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0df24cfe-57e1-441a-8d10-789ed5386c3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:35.795190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0df24cfe-57e1-441a-8d10-789ed5386c3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:35.795956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0df24cfe-57e1-441a-8d10-789ed5386c3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:35.796580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0df24cfe-57e1-441a-8d10-789ed5386c3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:35.931607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0df24cfe-57e1-441a-8d10-789ed5386c3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:35.940165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0df24cfe-57e1-441a-8d10-789ed5386c3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.155991 Mar 08 04:35:35.940725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 873/1802] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:35.954504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d7cea478-8548-4e80-8b85-3ba3366762b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:35.955409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d7cea478-8548-4e80-8b85-3ba3366762b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:35.962017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7cea478-8548-4e80-8b85-3ba3366762b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:35.962513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7cea478-8548-4e80-8b85-3ba3366762b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:35.963281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7cea478-8548-4e80-8b85-3ba3366762b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:35.963718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7cea478-8548-4e80-8b85-3ba3366762b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:35.992267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d7cea478-8548-4e80-8b85-3ba3366762b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041772 Mar 08 04:35:35.992809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 930/1803] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:35 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:36.002328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8db6cf14-bac7-4fee-b396-7229583737aa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:36.002956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8db6cf14-bac7-4fee-b396-7229583737aa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:36.008655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8db6cf14-bac7-4fee-b396-7229583737aa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:36.009098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8db6cf14-bac7-4fee-b396-7229583737aa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:36.009932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8db6cf14-bac7-4fee-b396-7229583737aa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:36.010313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8db6cf14-bac7-4fee-b396-7229583737aa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:36.071000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8db6cf14-bac7-4fee-b396-7229583737aa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:36.078333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8db6cf14-bac7-4fee-b396-7229583737aa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079807 Mar 08 04:35:36.078889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 874/1804] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:35 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:36.957987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ee661155-d237-400c-8cd0-375218c13d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:36.958596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ee661155-d237-400c-8cd0-375218c13d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:36.965282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee661155-d237-400c-8cd0-375218c13d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:36.965922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee661155-d237-400c-8cd0-375218c13d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:36.966692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee661155-d237-400c-8cd0-375218c13d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:36.967131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee661155-d237-400c-8cd0-375218c13d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:37.005156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e8d2d1e1-ff60-456a-afc4-b95d82ed12c3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:37.006734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e8d2d1e1-ff60-456a-afc4-b95d82ed12c3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:37.013931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8d2d1e1-ff60-456a-afc4-b95d82ed12c3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:37.014389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8d2d1e1-ff60-456a-afc4-b95d82ed12c3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:37.015185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8d2d1e1-ff60-456a-afc4-b95d82ed12c3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:37.015635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8d2d1e1-ff60-456a-afc4-b95d82ed12c3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:37.050173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e8d2d1e1-ff60-456a-afc4-b95d82ed12c3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049608 Mar 08 04:35:37.051002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 875/1805] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:36 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:37.095356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-12ed8fb9-9823-4a5a-89e3-1f4a0704707e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:37.095968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-12ed8fb9-9823-4a5a-89e3-1f4a0704707e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:37.102017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12ed8fb9-9823-4a5a-89e3-1f4a0704707e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:37.102474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12ed8fb9-9823-4a5a-89e3-1f4a0704707e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:37.103245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12ed8fb9-9823-4a5a-89e3-1f4a0704707e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:37.103730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12ed8fb9-9823-4a5a-89e3-1f4a0704707e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:37.110068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ee661155-d237-400c-8cd0-375218c13d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:37.117672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ee661155-d237-400c-8cd0-375218c13d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.163562 Mar 08 04:35:37.118527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 931/1806] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:37.162248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-12ed8fb9-9823-4a5a-89e3-1f4a0704707e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:37.170169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-12ed8fb9-9823-4a5a-89e3-1f4a0704707e tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078610 Mar 08 04:35:37.170707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 876/1807] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:37 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:38.061926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-04331ec1-44ca-4fc5-afaf-b9c8dbd207a9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:38.062831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-04331ec1-44ca-4fc5-afaf-b9c8dbd207a9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:38.069037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04331ec1-44ca-4fc5-afaf-b9c8dbd207a9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:38.069478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04331ec1-44ca-4fc5-afaf-b9c8dbd207a9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:38.070259 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04331ec1-44ca-4fc5-afaf-b9c8dbd207a9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:38.070689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04331ec1-44ca-4fc5-afaf-b9c8dbd207a9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:38.099080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-04331ec1-44ca-4fc5-afaf-b9c8dbd207a9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041316 Mar 08 04:35:38.099612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 932/1808] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:38 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:38.134779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-897e18b7-d560-4485-ab5a-c96c15131644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:38.135348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-897e18b7-d560-4485-ab5a-c96c15131644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:38.142213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-897e18b7-d560-4485-ab5a-c96c15131644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:38.142665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-897e18b7-d560-4485-ab5a-c96c15131644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:38.143429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-897e18b7-d560-4485-ab5a-c96c15131644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:38.143863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-897e18b7-d560-4485-ab5a-c96c15131644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:38.186856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-179650ea-fe99-465c-95e9-2bd2a17018a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:38.187570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-179650ea-fe99-465c-95e9-2bd2a17018a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:38.193450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-179650ea-fe99-465c-95e9-2bd2a17018a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:38.194001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-179650ea-fe99-465c-95e9-2bd2a17018a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:38.194830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-179650ea-fe99-465c-95e9-2bd2a17018a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:38.195336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-179650ea-fe99-465c-95e9-2bd2a17018a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:38.266899 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-179650ea-fe99-465c-95e9-2bd2a17018a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:38.274048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-179650ea-fe99-465c-95e9-2bd2a17018a4 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.091167 Mar 08 04:35:38.274609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 933/1809] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:38 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:38.295027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-897e18b7-d560-4485-ab5a-c96c15131644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:38.302599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-897e18b7-d560-4485-ab5a-c96c15131644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.171764 Mar 08 04:35:38.303148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 877/1810] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:39.111155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-898b4308-30a5-440e-8fd9-fbdf3db7fb24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:39.111998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-898b4308-30a5-440e-8fd9-fbdf3db7fb24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:39.118222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-898b4308-30a5-440e-8fd9-fbdf3db7fb24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:39.118670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-898b4308-30a5-440e-8fd9-fbdf3db7fb24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:39.119429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-898b4308-30a5-440e-8fd9-fbdf3db7fb24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:39.119860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-898b4308-30a5-440e-8fd9-fbdf3db7fb24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:39.147654 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-898b4308-30a5-440e-8fd9-fbdf3db7fb24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040578 Mar 08 04:35:39.148199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 934/1811] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:39 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:39.291118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a88dbd09-502b-474f-a63d-d7f8e52bf8ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:39.291730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a88dbd09-502b-474f-a63d-d7f8e52bf8ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:39.298629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a88dbd09-502b-474f-a63d-d7f8e52bf8ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:39.299078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a88dbd09-502b-474f-a63d-d7f8e52bf8ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:39.299843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a88dbd09-502b-474f-a63d-d7f8e52bf8ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:39.300278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a88dbd09-502b-474f-a63d-d7f8e52bf8ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:39.320086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-73787c68-eca4-49ce-8eb5-c6fe7304d694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:39.320696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-73787c68-eca4-49ce-8eb5-c6fe7304d694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:39.326472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73787c68-eca4-49ce-8eb5-c6fe7304d694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:39.326916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73787c68-eca4-49ce-8eb5-c6fe7304d694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:39.327690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73787c68-eca4-49ce-8eb5-c6fe7304d694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:39.328127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73787c68-eca4-49ce-8eb5-c6fe7304d694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:39.358667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a88dbd09-502b-474f-a63d-d7f8e52bf8ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:39.368808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a88dbd09-502b-474f-a63d-d7f8e52bf8ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.081382 Mar 08 04:35:39.369343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 878/1812] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:39 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:39.459062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-73787c68-eca4-49ce-8eb5-c6fe7304d694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:39.466925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-73787c68-eca4-49ce-8eb5-c6fe7304d694 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150681 Mar 08 04:35:39.467502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 935/1813] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:40.158703 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b65fd715-6d07-4752-a7c3-f990e5ce5ed0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:40.159536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b65fd715-6d07-4752-a7c3-f990e5ce5ed0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:40.165346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b65fd715-6d07-4752-a7c3-f990e5ce5ed0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:40.165832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b65fd715-6d07-4752-a7c3-f990e5ce5ed0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:40.166588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b65fd715-6d07-4752-a7c3-f990e5ce5ed0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:40.167021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b65fd715-6d07-4752-a7c3-f990e5ce5ed0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:40.194425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b65fd715-6d07-4752-a7c3-f990e5ce5ed0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039845 Mar 08 04:35:40.194957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 879/1814] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:40.385378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fc0ddbf2-4487-4bf1-ba62-ff61c2d0f0fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:40.386003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fc0ddbf2-4487-4bf1-ba62-ff61c2d0f0fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:40.392895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc0ddbf2-4487-4bf1-ba62-ff61c2d0f0fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:40.393352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc0ddbf2-4487-4bf1-ba62-ff61c2d0f0fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:40.394156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc0ddbf2-4487-4bf1-ba62-ff61c2d0f0fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:40.394600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc0ddbf2-4487-4bf1-ba62-ff61c2d0f0fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:40.452721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fc0ddbf2-4487-4bf1-ba62-ff61c2d0f0fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:40.459981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fc0ddbf2-4487-4bf1-ba62-ff61c2d0f0fa tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078415 Mar 08 04:35:40.460548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 936/1815] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:40 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:40.484478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ef4510cd-09cc-4ea1-9135-64a95d131dd5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:40.485091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ef4510cd-09cc-4ea1-9135-64a95d131dd5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:40.491423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef4510cd-09cc-4ea1-9135-64a95d131dd5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:40.491875 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef4510cd-09cc-4ea1-9135-64a95d131dd5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:40.492642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef4510cd-09cc-4ea1-9135-64a95d131dd5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:40.493080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef4510cd-09cc-4ea1-9135-64a95d131dd5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:40.619925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ef4510cd-09cc-4ea1-9135-64a95d131dd5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:40.629057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ef4510cd-09cc-4ea1-9135-64a95d131dd5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149032 Mar 08 04:35:40.629620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 880/1816] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:41.206059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8182df84-2196-4f20-ad50-a7faafc72ba2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:41.206961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8182df84-2196-4f20-ad50-a7faafc72ba2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:41.212707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8182df84-2196-4f20-ad50-a7faafc72ba2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:41.213146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8182df84-2196-4f20-ad50-a7faafc72ba2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:41.213949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8182df84-2196-4f20-ad50-a7faafc72ba2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:41.215126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8182df84-2196-4f20-ad50-a7faafc72ba2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:41.244265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8182df84-2196-4f20-ad50-a7faafc72ba2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042154 Mar 08 04:35:41.244798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 937/1817] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:41 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:41.476230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7d3d207c-f546-449e-ba27-94f590bd5ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:41.476760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7d3d207c-f546-449e-ba27-94f590bd5ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:41.483617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7d3d207c-f546-449e-ba27-94f590bd5ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:41.484065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7d3d207c-f546-449e-ba27-94f590bd5ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:41.484833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7d3d207c-f546-449e-ba27-94f590bd5ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:41.485367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7d3d207c-f546-449e-ba27-94f590bd5ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:41.543536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7d3d207c-f546-449e-ba27-94f590bd5ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:41.550757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7d3d207c-f546-449e-ba27-94f590bd5ef7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.078405 Mar 08 04:35:41.551317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 881/1818] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:41 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:41.646151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-218c3275-c261-40da-a3f5-600daae1a5cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:41.646758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-218c3275-c261-40da-a3f5-600daae1a5cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:41.653157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-218c3275-c261-40da-a3f5-600daae1a5cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:41.653600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-218c3275-c261-40da-a3f5-600daae1a5cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:41.654381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-218c3275-c261-40da-a3f5-600daae1a5cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:41.654810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-218c3275-c261-40da-a3f5-600daae1a5cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:41.784224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-218c3275-c261-40da-a3f5-600daae1a5cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:41.791864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-218c3275-c261-40da-a3f5-600daae1a5cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149495 Mar 08 04:35:41.792431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 938/1819] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:42.256291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-96353ee6-f012-420c-a1b2-4b51bd54250c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:42.257198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-96353ee6-f012-420c-a1b2-4b51bd54250c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:42.263028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-96353ee6-f012-420c-a1b2-4b51bd54250c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:42.263469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-96353ee6-f012-420c-a1b2-4b51bd54250c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:42.264217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-96353ee6-f012-420c-a1b2-4b51bd54250c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:42.264648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-96353ee6-f012-420c-a1b2-4b51bd54250c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:42.292092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-96353ee6-f012-420c-a1b2-4b51bd54250c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039772 Mar 08 04:35:42.293295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 882/1820] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:42 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:42.567509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-645bb8d7-cb86-4681-b80d-7033b214a9cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:42.568034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-645bb8d7-cb86-4681-b80d-7033b214a9cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:42.574392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-645bb8d7-cb86-4681-b80d-7033b214a9cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:42.574846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-645bb8d7-cb86-4681-b80d-7033b214a9cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:42.575610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-645bb8d7-cb86-4681-b80d-7033b214a9cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:42.576041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-645bb8d7-cb86-4681-b80d-7033b214a9cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:42.633547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-645bb8d7-cb86-4681-b80d-7033b214a9cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:42.641387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-645bb8d7-cb86-4681-b80d-7033b214a9cd tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077860 Mar 08 04:35:42.641983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 939/1821] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:42 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:42.809847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0cc54676-c56d-42d0-a6df-0b78363f454c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:42.810463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0cc54676-c56d-42d0-a6df-0b78363f454c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:42.816861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cc54676-c56d-42d0-a6df-0b78363f454c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:42.817307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cc54676-c56d-42d0-a6df-0b78363f454c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:42.818178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cc54676-c56d-42d0-a6df-0b78363f454c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:42.818546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cc54676-c56d-42d0-a6df-0b78363f454c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:42.947792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0cc54676-c56d-42d0-a6df-0b78363f454c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:42.955575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0cc54676-c56d-42d0-a6df-0b78363f454c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149875 Mar 08 04:35:42.956131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 883/1822] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:43.304123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-faea92ca-87f4-4d96-b7ba-afea0b948317 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:43.305038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-faea92ca-87f4-4d96-b7ba-afea0b948317 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:43.311925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-faea92ca-87f4-4d96-b7ba-afea0b948317 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:43.312374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-faea92ca-87f4-4d96-b7ba-afea0b948317 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:43.313148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-faea92ca-87f4-4d96-b7ba-afea0b948317 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:43.313582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-faea92ca-87f4-4d96-b7ba-afea0b948317 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:43.343248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-faea92ca-87f4-4d96-b7ba-afea0b948317 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Mar 08 04:35:43.343808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 940/1823] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:43.659122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8c617e81-ca76-4310-a826-a004c62a0c44 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:43.659641 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8c617e81-ca76-4310-a826-a004c62a0c44 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:43.665907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c617e81-ca76-4310-a826-a004c62a0c44 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:43.666360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c617e81-ca76-4310-a826-a004c62a0c44 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:43.667108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c617e81-ca76-4310-a826-a004c62a0c44 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:43.667597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c617e81-ca76-4310-a826-a004c62a0c44 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:43.735313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8c617e81-ca76-4310-a826-a004c62a0c44 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:43.742675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8c617e81-ca76-4310-a826-a004c62a0c44 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.087563 Mar 08 04:35:43.743249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 884/1824] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:43 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:43.973499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3c08ad7c-a959-493b-af8b-cb5e1b1561aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:43.974125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3c08ad7c-a959-493b-af8b-cb5e1b1561aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:43.980518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c08ad7c-a959-493b-af8b-cb5e1b1561aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:43.980980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c08ad7c-a959-493b-af8b-cb5e1b1561aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:43.981773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c08ad7c-a959-493b-af8b-cb5e1b1561aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:43.982213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3c08ad7c-a959-493b-af8b-cb5e1b1561aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:44.115214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3c08ad7c-a959-493b-af8b-cb5e1b1561aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:44.123611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3c08ad7c-a959-493b-af8b-cb5e1b1561aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154064 Mar 08 04:35:44.124169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 941/1825] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:44.355460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3c24732e-72ed-437c-ba46-16c687e84310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:44.356286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3c24732e-72ed-437c-ba46-16c687e84310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:44.362525 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c24732e-72ed-437c-ba46-16c687e84310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:44.362976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c24732e-72ed-437c-ba46-16c687e84310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:44.363751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c24732e-72ed-437c-ba46-16c687e84310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:44.364172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c24732e-72ed-437c-ba46-16c687e84310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:44.391869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3c24732e-72ed-437c-ba46-16c687e84310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040927 Mar 08 04:35:44.392408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 885/1826] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:44.759639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e666dcf7-b53c-4579-84b4-ffd8d8f07635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:44.760241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e666dcf7-b53c-4579-84b4-ffd8d8f07635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:44.766510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e666dcf7-b53c-4579-84b4-ffd8d8f07635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:44.766953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e666dcf7-b53c-4579-84b4-ffd8d8f07635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:44.767709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e666dcf7-b53c-4579-84b4-ffd8d8f07635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:44.768146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e666dcf7-b53c-4579-84b4-ffd8d8f07635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:44.826143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e666dcf7-b53c-4579-84b4-ffd8d8f07635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:44.833453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e666dcf7-b53c-4579-84b4-ffd8d8f07635 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.077644 Mar 08 04:35:44.834042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 942/1827] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:44 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:45.140325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-08690f29-b952-44bc-a6ab-1cea1195eba2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:45.140855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-08690f29-b952-44bc-a6ab-1cea1195eba2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:45.146828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08690f29-b952-44bc-a6ab-1cea1195eba2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:45.147199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:35:45.147324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08690f29-b952-44bc-a6ab-1cea1195eba2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:45.147424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:35:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:35:45.148718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08690f29-b952-44bc-a6ab-1cea1195eba2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:45.149201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08690f29-b952-44bc-a6ab-1cea1195eba2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:45.282610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-08690f29-b952-44bc-a6ab-1cea1195eba2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:45.290218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-08690f29-b952-44bc-a6ab-1cea1195eba2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153855 Mar 08 04:35:45.290774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 886/1828] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:45.403794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-74b5b640-b5c8-4dfb-b5b7-aeb9f96585f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:45.404624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-74b5b640-b5c8-4dfb-b5b7-aeb9f96585f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:45.411904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74b5b640-b5c8-4dfb-b5b7-aeb9f96585f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:45.412360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74b5b640-b5c8-4dfb-b5b7-aeb9f96585f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:45.413140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74b5b640-b5c8-4dfb-b5b7-aeb9f96585f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:45.413610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-74b5b640-b5c8-4dfb-b5b7-aeb9f96585f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:45.441973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-74b5b640-b5c8-4dfb-b5b7-aeb9f96585f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043112 Mar 08 04:35:45.442522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 943/1829] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:45 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:45.850694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f629304f-a19b-464a-9bae-25c60fa116ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:45.851313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f629304f-a19b-464a-9bae-25c60fa116ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:45.857767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f629304f-a19b-464a-9bae-25c60fa116ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:45.858217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f629304f-a19b-464a-9bae-25c60fa116ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:45.858984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f629304f-a19b-464a-9bae-25c60fa116ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:45.859417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f629304f-a19b-464a-9bae-25c60fa116ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:45.919658 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f629304f-a19b-464a-9bae-25c60fa116ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:45.926960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f629304f-a19b-464a-9bae-25c60fa116ab tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.080155 Mar 08 04:35:45.927529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 887/1830] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:45 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:46.308144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-94e13288-a625-42a6-8a9b-ede3df71ac4b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:46.309253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-94e13288-a625-42a6-8a9b-ede3df71ac4b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:46.315536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94e13288-a625-42a6-8a9b-ede3df71ac4b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:46.315981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94e13288-a625-42a6-8a9b-ede3df71ac4b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:46.316738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94e13288-a625-42a6-8a9b-ede3df71ac4b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:46.317189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94e13288-a625-42a6-8a9b-ede3df71ac4b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:46.444640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-94e13288-a625-42a6-8a9b-ede3df71ac4b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:46.453072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-94e13288-a625-42a6-8a9b-ede3df71ac4b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148959 Mar 08 04:35:46.453269 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8847c896-5956-4be6-ba11-84be59fe4cef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:46.453631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 944/1831] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:46.454133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8847c896-5956-4be6-ba11-84be59fe4cef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:46.459773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8847c896-5956-4be6-ba11-84be59fe4cef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:46.460214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8847c896-5956-4be6-ba11-84be59fe4cef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:46.460969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8847c896-5956-4be6-ba11-84be59fe4cef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:46.461401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8847c896-5956-4be6-ba11-84be59fe4cef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:46.489312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8847c896-5956-4be6-ba11-84be59fe4cef tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 Mar 08 04:35:46.489864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 888/1832] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:46 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:46.943736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ac308777-e773-4c16-9243-e5d388c4efee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:46.944365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ac308777-e773-4c16-9243-e5d388c4efee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] [instance: 4208bcea-e0a6-4c9d-956c-477a87d388ca] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:46.950317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ac308777-e773-4c16-9243-e5d388c4efee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:46.950765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ac308777-e773-4c16-9243-e5d388c4efee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:46.951523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ac308777-e773-4c16-9243-e5d388c4efee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:46.951991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ac308777-e773-4c16-9243-e5d388c4efee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:47.012039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ac308777-e773-4c16-9243-e5d388c4efee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4b172419974ce9a929d4df7d3c5380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109ff95df0941709c7e20284930ec61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:47.019279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ac308777-e773-4c16-9243-e5d388c4efee tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca" status: 200 len: 1214 microversion: 2.1 time: 0.079448 Mar 08 04:35:47.019840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 945/1833] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:46 2022] GET /compute/v2.1/servers/4208bcea-e0a6-4c9d-956c-477a87d388ca => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:47.178718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-83edb9c5-bce1-46ec-9f66-e905ee4ac0a7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] Calling method '.version_select at 0x7fe8371054c0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:47.200730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-83edb9c5-bce1-46ec-9f66-e905ee4ac0a7 tempest-TestShelveInstance-1476461049 tempest-TestShelveInstance-1476461049-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1894826000" status: 202 len: 0 microversion: 2.1 time: 0.026594 Mar 08 04:35:47.201311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 889/1834] 10.222.0.30 () {58 vars in 1253 bytes} [Tue Mar 8 04:35:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1894826000 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:35:47.469848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d111d20d-7c8d-4684-a7d8-6f55778b197b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:47.470460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d111d20d-7c8d-4684-a7d8-6f55778b197b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:47.476800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d111d20d-7c8d-4684-a7d8-6f55778b197b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:47.477246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d111d20d-7c8d-4684-a7d8-6f55778b197b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:47.478048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d111d20d-7c8d-4684-a7d8-6f55778b197b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:47.478488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d111d20d-7c8d-4684-a7d8-6f55778b197b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:47.501100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1a613488-8349-4f72-837a-5325b1500acd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:47.502039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1a613488-8349-4f72-837a-5325b1500acd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:47.508542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a613488-8349-4f72-837a-5325b1500acd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:47.508988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a613488-8349-4f72-837a-5325b1500acd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:47.509773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a613488-8349-4f72-837a-5325b1500acd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:47.510206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a613488-8349-4f72-837a-5325b1500acd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:47.540997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1a613488-8349-4f72-837a-5325b1500acd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Mar 08 04:35:47.541778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 890/1835] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:47 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:47.615494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d111d20d-7c8d-4684-a7d8-6f55778b197b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:47.624009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d111d20d-7c8d-4684-a7d8-6f55778b197b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.158008 Mar 08 04:35:47.624903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 946/1836] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:35:48.552523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-480ec45c-fc31-45f7-9583-6ada200501b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:48.554101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-480ec45c-fc31-45f7-9583-6ada200501b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:48.561188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-480ec45c-fc31-45f7-9583-6ada200501b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:48.561915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-480ec45c-fc31-45f7-9583-6ada200501b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:48.562964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-480ec45c-fc31-45f7-9583-6ada200501b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:48.563502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-480ec45c-fc31-45f7-9583-6ada200501b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:48.597182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-480ec45c-fc31-45f7-9583-6ada200501b1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048590 Mar 08 04:35:48.597764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 891/1837] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:48 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:48.643593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-360fdda2-a690-42e5-a22b-c6da89271f9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:48.644343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-360fdda2-a690-42e5-a22b-c6da89271f9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:48.650203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-360fdda2-a690-42e5-a22b-c6da89271f9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:48.650603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-360fdda2-a690-42e5-a22b-c6da89271f9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:48.651375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-360fdda2-a690-42e5-a22b-c6da89271f9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:48.653361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-360fdda2-a690-42e5-a22b-c6da89271f9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:48.793550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-360fdda2-a690-42e5-a22b-c6da89271f9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:48.801224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-360fdda2-a690-42e5-a22b-c6da89271f9c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.161694 Mar 08 04:35:48.802108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 947/1838] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:49.609144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4408d6eb-0e01-4b9a-877b-0ae856e5a65e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:49.610238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4408d6eb-0e01-4b9a-877b-0ae856e5a65e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:49.616661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4408d6eb-0e01-4b9a-877b-0ae856e5a65e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:49.617106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4408d6eb-0e01-4b9a-877b-0ae856e5a65e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:49.617904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4408d6eb-0e01-4b9a-877b-0ae856e5a65e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:49.618336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4408d6eb-0e01-4b9a-877b-0ae856e5a65e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:49.648707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4408d6eb-0e01-4b9a-877b-0ae856e5a65e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Mar 08 04:35:49.649643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 892/1839] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:49 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:49.819183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-303ebb40-382c-4ead-9bef-2a4cdd523526 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:49.819892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-303ebb40-382c-4ead-9bef-2a4cdd523526 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:49.826666 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-303ebb40-382c-4ead-9bef-2a4cdd523526 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:49.827125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-303ebb40-382c-4ead-9bef-2a4cdd523526 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:49.827905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-303ebb40-382c-4ead-9bef-2a4cdd523526 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:49.828346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-303ebb40-382c-4ead-9bef-2a4cdd523526 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:50.139963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-303ebb40-382c-4ead-9bef-2a4cdd523526 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:50.148664 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-303ebb40-382c-4ead-9bef-2a4cdd523526 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.333068 Mar 08 04:35:50.149304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 948/1840] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:50.663649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-11560617-9511-4d4d-a550-3a91cfde033d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:50.664647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-11560617-9511-4d4d-a550-3a91cfde033d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:50.671970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11560617-9511-4d4d-a550-3a91cfde033d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:50.672533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11560617-9511-4d4d-a550-3a91cfde033d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:50.673485 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11560617-9511-4d4d-a550-3a91cfde033d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:50.674071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11560617-9511-4d4d-a550-3a91cfde033d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:50.704896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-11560617-9511-4d4d-a550-3a91cfde033d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 Mar 08 04:35:50.705469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 893/1841] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:50 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:51.167889 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-697a8c8c-87ef-4abd-a024-d32b87ca5950 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:51.168682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-697a8c8c-87ef-4abd-a024-d32b87ca5950 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:51.174903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-697a8c8c-87ef-4abd-a024-d32b87ca5950 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:51.175555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-697a8c8c-87ef-4abd-a024-d32b87ca5950 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:51.176333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-697a8c8c-87ef-4abd-a024-d32b87ca5950 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:51.176768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-697a8c8c-87ef-4abd-a024-d32b87ca5950 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:51.387523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-697a8c8c-87ef-4abd-a024-d32b87ca5950 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:51.395492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-697a8c8c-87ef-4abd-a024-d32b87ca5950 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.232096 Mar 08 04:35:51.396054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 949/1842] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:51.717051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-60a39e0a-3f18-4c08-a046-e9193682c1ec tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:51.717987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-60a39e0a-3f18-4c08-a046-e9193682c1ec tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:51.724409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-60a39e0a-3f18-4c08-a046-e9193682c1ec tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:51.724853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-60a39e0a-3f18-4c08-a046-e9193682c1ec tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:51.725627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-60a39e0a-3f18-4c08-a046-e9193682c1ec tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:51.726093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-60a39e0a-3f18-4c08-a046-e9193682c1ec tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:51.756308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-60a39e0a-3f18-4c08-a046-e9193682c1ec tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044093 Mar 08 04:35:51.756859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 894/1843] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:51 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:52.415558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b56968d7-0a6e-4df6-b321-b9df7225ce90 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:52.416160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b56968d7-0a6e-4df6-b321-b9df7225ce90 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:52.423038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b56968d7-0a6e-4df6-b321-b9df7225ce90 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:52.423482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b56968d7-0a6e-4df6-b321-b9df7225ce90 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:52.424253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b56968d7-0a6e-4df6-b321-b9df7225ce90 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:52.424683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b56968d7-0a6e-4df6-b321-b9df7225ce90 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:52.658821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b56968d7-0a6e-4df6-b321-b9df7225ce90 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:52.666574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b56968d7-0a6e-4df6-b321-b9df7225ce90 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.254948 Mar 08 04:35:52.667132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 950/1844] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:52.767964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9de23d1c-a19f-4f91-925a-56cbab0d0c8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:52.768872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9de23d1c-a19f-4f91-925a-56cbab0d0c8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:52.775561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9de23d1c-a19f-4f91-925a-56cbab0d0c8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:52.775661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9de23d1c-a19f-4f91-925a-56cbab0d0c8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:52.776384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9de23d1c-a19f-4f91-925a-56cbab0d0c8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:52.777751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9de23d1c-a19f-4f91-925a-56cbab0d0c8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:52.809164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9de23d1c-a19f-4f91-925a-56cbab0d0c8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Mar 08 04:35:52.809772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 895/1845] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:52 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:53.683975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1b2b6d98-4e53-47c1-830c-2ff07cb49a1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:53.685104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1b2b6d98-4e53-47c1-830c-2ff07cb49a1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:53.691472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b2b6d98-4e53-47c1-830c-2ff07cb49a1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:53.691916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b2b6d98-4e53-47c1-830c-2ff07cb49a1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:53.692685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b2b6d98-4e53-47c1-830c-2ff07cb49a1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:53.693121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b2b6d98-4e53-47c1-830c-2ff07cb49a1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:53.823097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3cc69c79-f0e7-49b4-a008-1a6e2102c7eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:53.824773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3cc69c79-f0e7-49b4-a008-1a6e2102c7eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:53.831520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3cc69c79-f0e7-49b4-a008-1a6e2102c7eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:53.832048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3cc69c79-f0e7-49b4-a008-1a6e2102c7eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:53.832897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3cc69c79-f0e7-49b4-a008-1a6e2102c7eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:53.833395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3cc69c79-f0e7-49b4-a008-1a6e2102c7eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:53.864845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3cc69c79-f0e7-49b4-a008-1a6e2102c7eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Mar 08 04:35:53.865985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 896/1846] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:53 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:53.866708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1b2b6d98-4e53-47c1-830c-2ff07cb49a1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:53.875586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1b2b6d98-4e53-47c1-830c-2ff07cb49a1f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.195651 Mar 08 04:35:53.877700 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 951/1847] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:54.877198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-62ebf9ec-623d-42b6-9d75-2a81a3ce77bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:54.878229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-62ebf9ec-623d-42b6-9d75-2a81a3ce77bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:54.885380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62ebf9ec-623d-42b6-9d75-2a81a3ce77bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:54.887892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62ebf9ec-623d-42b6-9d75-2a81a3ce77bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:54.888722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62ebf9ec-623d-42b6-9d75-2a81a3ce77bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:54.889203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62ebf9ec-623d-42b6-9d75-2a81a3ce77bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:54.893284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-61eb3955-923c-4fad-8b77-dec3cf060ab5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:54.893910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-61eb3955-923c-4fad-8b77-dec3cf060ab5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:54.900397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61eb3955-923c-4fad-8b77-dec3cf060ab5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:54.900850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61eb3955-923c-4fad-8b77-dec3cf060ab5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:54.904195 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61eb3955-923c-4fad-8b77-dec3cf060ab5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:54.904548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61eb3955-923c-4fad-8b77-dec3cf060ab5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:54.920858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-62ebf9ec-623d-42b6-9d75-2a81a3ce77bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046116 Mar 08 04:35:54.920858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 897/1848] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:54 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:35:55.060833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-61eb3955-923c-4fad-8b77-dec3cf060ab5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:55.068651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-61eb3955-923c-4fad-8b77-dec3cf060ab5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.179527 Mar 08 04:35:55.069226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 952/1849] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:55.931022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9f99cf64-d7f9-4c9c-817b-dd1bd381db68 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:55.931990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9f99cf64-d7f9-4c9c-817b-dd1bd381db68 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:55.937941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f99cf64-d7f9-4c9c-817b-dd1bd381db68 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:55.938387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f99cf64-d7f9-4c9c-817b-dd1bd381db68 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:55.939149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f99cf64-d7f9-4c9c-817b-dd1bd381db68 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:55.939678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f99cf64-d7f9-4c9c-817b-dd1bd381db68 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:55.968505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9f99cf64-d7f9-4c9c-817b-dd1bd381db68 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041368 Mar 08 04:35:55.969144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 898/1850] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:55 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:56.085982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1ebf798a-29eb-429e-a33f-b12987e4893c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:56.086533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1ebf798a-29eb-429e-a33f-b12987e4893c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:56.093536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ebf798a-29eb-429e-a33f-b12987e4893c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:56.094024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ebf798a-29eb-429e-a33f-b12987e4893c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:56.094801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ebf798a-29eb-429e-a33f-b12987e4893c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:56.095240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ebf798a-29eb-429e-a33f-b12987e4893c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:56.230317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1ebf798a-29eb-429e-a33f-b12987e4893c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:56.238216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1ebf798a-29eb-429e-a33f-b12987e4893c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.156289 Mar 08 04:35:56.238791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 953/1851] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:56.980142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7a9513e9-ba99-4666-9975-2d2bc38ec27f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:56.981042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7a9513e9-ba99-4666-9975-2d2bc38ec27f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:56.987733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a9513e9-ba99-4666-9975-2d2bc38ec27f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:56.988182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a9513e9-ba99-4666-9975-2d2bc38ec27f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:56.988950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a9513e9-ba99-4666-9975-2d2bc38ec27f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:56.989385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a9513e9-ba99-4666-9975-2d2bc38ec27f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:57.022108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7a9513e9-ba99-4666-9975-2d2bc38ec27f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046207 Mar 08 04:35:57.022820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 899/1852] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:35:56 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:35:57.134395 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:35:57.134956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:35:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:35:57.255192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8822d89e-1ed2-429e-9ade-efce0bb0d7c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:57.255949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8822d89e-1ed2-429e-9ade-efce0bb0d7c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:57.262471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8822d89e-1ed2-429e-9ade-efce0bb0d7c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:57.263037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8822d89e-1ed2-429e-9ade-efce0bb0d7c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:57.263918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8822d89e-1ed2-429e-9ade-efce0bb0d7c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:57.264458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8822d89e-1ed2-429e-9ade-efce0bb0d7c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:57.742994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8822d89e-1ed2-429e-9ade-efce0bb0d7c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:57.751179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8822d89e-1ed2-429e-9ade-efce0bb0d7c6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.499590 Mar 08 04:35:57.751690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 954/1853] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:58.034146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5c23a2f4-c1ae-49d7-aa7d-d1aabf03ef8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:35:58.035881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5c23a2f4-c1ae-49d7-aa7d-d1aabf03ef8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:58.042527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c23a2f4-c1ae-49d7-aa7d-d1aabf03ef8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:58.043257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c23a2f4-c1ae-49d7-aa7d-d1aabf03ef8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:58.044042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c23a2f4-c1ae-49d7-aa7d-d1aabf03ef8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:58.044472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5c23a2f4-c1ae-49d7-aa7d-d1aabf03ef8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:58.127872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5c23a2f4-c1ae-49d7-aa7d-d1aabf03ef8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/action" status: 200 len: 76341 microversion: 2.1 time: 0.097408 Mar 08 04:35:58.128958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 900/1854] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:35:58 2022] POST /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f/action => generated 76341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:35:58.769325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-073fef4b-b31d-43d3-b5f2-e68958042af1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:58.770677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-073fef4b-b31d-43d3-b5f2-e68958042af1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:58.780578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-073fef4b-b31d-43d3-b5f2-e68958042af1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:58.781536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-073fef4b-b31d-43d3-b5f2-e68958042af1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:58.782716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-073fef4b-b31d-43d3-b5f2-e68958042af1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:58.783268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-073fef4b-b31d-43d3-b5f2-e68958042af1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:58.939480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-073fef4b-b31d-43d3-b5f2-e68958042af1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:35:58.952010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-073fef4b-b31d-43d3-b5f2-e68958042af1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.186837 Mar 08 04:35:58.952856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 955/1855] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:35:59.971453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f95ed0ae-31af-480d-838a-8b96f492f370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:35:59.972729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f95ed0ae-31af-480d-838a-8b96f492f370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:35:59.979888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f95ed0ae-31af-480d-838a-8b96f492f370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:59.980340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f95ed0ae-31af-480d-838a-8b96f492f370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:35:59.981190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f95ed0ae-31af-480d-838a-8b96f492f370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:35:59.981631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f95ed0ae-31af-480d-838a-8b96f492f370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:00.153457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f95ed0ae-31af-480d-838a-8b96f492f370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:00.174955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f95ed0ae-31af-480d-838a-8b96f492f370 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.207770 Mar 08 04:36:00.175547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 901/1856] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:35:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:01.193315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5bbb9969-a20a-4534-9ccf-89b30dab7056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:01.194165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5bbb9969-a20a-4534-9ccf-89b30dab7056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:01.207421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bbb9969-a20a-4534-9ccf-89b30dab7056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:01.209919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bbb9969-a20a-4534-9ccf-89b30dab7056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:01.210836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bbb9969-a20a-4534-9ccf-89b30dab7056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:01.212784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5bbb9969-a20a-4534-9ccf-89b30dab7056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:01.397094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5bbb9969-a20a-4534-9ccf-89b30dab7056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:01.406994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5bbb9969-a20a-4534-9ccf-89b30dab7056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.217455 Mar 08 04:36:01.417758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 956/1857] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:01 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:02.424705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b03c41a1-592e-44c9-9ce6-005a19413fd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:02.426287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b03c41a1-592e-44c9-9ce6-005a19413fd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:02.433045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b03c41a1-592e-44c9-9ce6-005a19413fd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:02.433981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b03c41a1-592e-44c9-9ce6-005a19413fd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:02.434784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b03c41a1-592e-44c9-9ce6-005a19413fd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:02.435403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b03c41a1-592e-44c9-9ce6-005a19413fd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:02.580879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b03c41a1-592e-44c9-9ce6-005a19413fd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:02.589572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b03c41a1-592e-44c9-9ce6-005a19413fd6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.168206 Mar 08 04:36:02.590249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 902/1858] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:03.608154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-933ee5dd-0f64-4bbc-9690-3d81ffb62b6b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:03.609387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-933ee5dd-0f64-4bbc-9690-3d81ffb62b6b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:03.626895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-933ee5dd-0f64-4bbc-9690-3d81ffb62b6b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:03.627624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-933ee5dd-0f64-4bbc-9690-3d81ffb62b6b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:03.628436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-933ee5dd-0f64-4bbc-9690-3d81ffb62b6b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:03.628875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-933ee5dd-0f64-4bbc-9690-3d81ffb62b6b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:03.865876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-933ee5dd-0f64-4bbc-9690-3d81ffb62b6b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:03.875239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-933ee5dd-0f64-4bbc-9690-3d81ffb62b6b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.271853 Mar 08 04:36:03.886608 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 957/1859] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:04.893965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dabbd93b-d60a-4e39-baa0-1db0d578a9e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:04.894587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dabbd93b-d60a-4e39-baa0-1db0d578a9e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:04.906253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dabbd93b-d60a-4e39-baa0-1db0d578a9e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:04.908120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dabbd93b-d60a-4e39-baa0-1db0d578a9e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:04.908962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dabbd93b-d60a-4e39-baa0-1db0d578a9e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:04.913029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dabbd93b-d60a-4e39-baa0-1db0d578a9e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:05.124738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dabbd93b-d60a-4e39-baa0-1db0d578a9e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:05.137430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dabbd93b-d60a-4e39-baa0-1db0d578a9e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.247705 Mar 08 04:36:05.138156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 903/1860] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:05.855538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a2669160-b09d-470e-b69b-98baed95c36e tempest-TestVolumeBootPattern-601865887 tempest-TestVolumeBootPattern-601865887-project] Action: 'create', calling method: .version_select at 0x7fe8324b0310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-928865511"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:36:05.872158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-a2669160-b09d-470e-b69b-98baed95c36e tempest-TestVolumeBootPattern-601865887 tempest-TestVolumeBootPattern-601865887-project] Getting quotas for project cbb04485381e4d2e9bf38042cec39869. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:36:05.876342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-a2669160-b09d-470e-b69b-98baed95c36e tempest-TestVolumeBootPattern-601865887 tempest-TestVolumeBootPattern-601865887-project] Getting quotas for user 608515e4bb6d4a76bf3f1da352cc7386 and project cbb04485381e4d2e9bf38042cec39869. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:36:05.977710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-a2669160-b09d-470e-b69b-98baed95c36e tempest-TestVolumeBootPattern-601865887 tempest-TestVolumeBootPattern-601865887-project] Getting quotas for project cbb04485381e4d2e9bf38042cec39869. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:36:05.983124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-a2669160-b09d-470e-b69b-98baed95c36e tempest-TestVolumeBootPattern-601865887 tempest-TestVolumeBootPattern-601865887-project] Getting quotas for user 608515e4bb6d4a76bf3f1da352cc7386 and project cbb04485381e4d2e9bf38042cec39869. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:36:05.997522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a2669160-b09d-470e-b69b-98baed95c36e tempest-TestVolumeBootPattern-601865887 tempest-TestVolumeBootPattern-601865887-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.350191 Mar 08 04:36:05.998524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 958/1861] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 04:36:05 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:06.154735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-62bef3db-569b-45b3-b807-f8ceec63b2f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:06.155376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-62bef3db-569b-45b3-b807-f8ceec63b2f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:06.161681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62bef3db-569b-45b3-b807-f8ceec63b2f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:06.162138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62bef3db-569b-45b3-b807-f8ceec63b2f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:06.162900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62bef3db-569b-45b3-b807-f8ceec63b2f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:06.163329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62bef3db-569b-45b3-b807-f8ceec63b2f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:06.301270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-62bef3db-569b-45b3-b807-f8ceec63b2f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:06.309636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-62bef3db-569b-45b3-b807-f8ceec63b2f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.159071 Mar 08 04:36:06.310233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 904/1862] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:07.327857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0f135014-3233-48c3-a40a-6d89ada23e95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:07.328447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0f135014-3233-48c3-a40a-6d89ada23e95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:07.335002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f135014-3233-48c3-a40a-6d89ada23e95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:07.335735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f135014-3233-48c3-a40a-6d89ada23e95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:07.336458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f135014-3233-48c3-a40a-6d89ada23e95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:07.336887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f135014-3233-48c3-a40a-6d89ada23e95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:07.475611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0f135014-3233-48c3-a40a-6d89ada23e95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:07.484262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0f135014-3233-48c3-a40a-6d89ada23e95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.161310 Mar 08 04:36:07.484826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 959/1863] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:08.501476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-03d34dc6-cdfb-4542-8c05-7ddb4af96c8e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:08.502194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-03d34dc6-cdfb-4542-8c05-7ddb4af96c8e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:08.508255 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-03d34dc6-cdfb-4542-8c05-7ddb4af96c8e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:08.508775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-03d34dc6-cdfb-4542-8c05-7ddb4af96c8e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:08.509643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-03d34dc6-cdfb-4542-8c05-7ddb4af96c8e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:08.510170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-03d34dc6-cdfb-4542-8c05-7ddb4af96c8e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:08.644825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-03d34dc6-cdfb-4542-8c05-7ddb4af96c8e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:08.654213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-03d34dc6-cdfb-4542-8c05-7ddb4af96c8e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.156502 Mar 08 04:36:08.663768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 905/1864] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:09.671325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-29ddd587-3f8a-416e-b2b0-3e4c5bce958e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:09.671947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-29ddd587-3f8a-416e-b2b0-3e4c5bce958e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:09.678290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29ddd587-3f8a-416e-b2b0-3e4c5bce958e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:09.678742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29ddd587-3f8a-416e-b2b0-3e4c5bce958e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:09.679515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29ddd587-3f8a-416e-b2b0-3e4c5bce958e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:09.679955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29ddd587-3f8a-416e-b2b0-3e4c5bce958e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:09.815078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-29ddd587-3f8a-416e-b2b0-3e4c5bce958e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:09.822998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-29ddd587-3f8a-416e-b2b0-3e4c5bce958e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.155520 Mar 08 04:36:09.823782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 960/1865] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:10.841055 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cf15da0a-1462-4ba4-9a5e-713d56d76292 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:10.841842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cf15da0a-1462-4ba4-9a5e-713d56d76292 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:10.848321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf15da0a-1462-4ba4-9a5e-713d56d76292 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:10.848771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf15da0a-1462-4ba4-9a5e-713d56d76292 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:10.849791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf15da0a-1462-4ba4-9a5e-713d56d76292 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:10.850229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf15da0a-1462-4ba4-9a5e-713d56d76292 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:10.985104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cf15da0a-1462-4ba4-9a5e-713d56d76292 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:10.992753 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cf15da0a-1462-4ba4-9a5e-713d56d76292 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.156265 Mar 08 04:36:10.993309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 906/1866] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:12.009638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-05cc78eb-fa0a-4852-8c88-4fa2c4cd864f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:12.010751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-05cc78eb-fa0a-4852-8c88-4fa2c4cd864f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:12.017063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05cc78eb-fa0a-4852-8c88-4fa2c4cd864f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:12.017506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05cc78eb-fa0a-4852-8c88-4fa2c4cd864f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:12.018298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05cc78eb-fa0a-4852-8c88-4fa2c4cd864f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:12.018729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05cc78eb-fa0a-4852-8c88-4fa2c4cd864f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:12.149557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-05cc78eb-fa0a-4852-8c88-4fa2c4cd864f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:12.157605 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-05cc78eb-fa0a-4852-8c88-4fa2c4cd864f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151819 Mar 08 04:36:12.158196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 961/1867] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:13.174589 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d1b1c6f2-696c-4951-a850-c92a7702c63e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:13.175242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d1b1c6f2-696c-4951-a850-c92a7702c63e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:13.181651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1b1c6f2-696c-4951-a850-c92a7702c63e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:13.182130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1b1c6f2-696c-4951-a850-c92a7702c63e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:13.182901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1b1c6f2-696c-4951-a850-c92a7702c63e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:13.183336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1b1c6f2-696c-4951-a850-c92a7702c63e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:13.314392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d1b1c6f2-696c-4951-a850-c92a7702c63e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:13.322068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d1b1c6f2-696c-4951-a850-c92a7702c63e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151242 Mar 08 04:36:13.322627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 907/1868] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:14.340335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6312db6c-e4cd-436f-a0b3-a52106366aff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:14.340939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6312db6c-e4cd-436f-a0b3-a52106366aff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:14.347144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6312db6c-e4cd-436f-a0b3-a52106366aff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:14.347587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6312db6c-e4cd-436f-a0b3-a52106366aff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:14.348349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6312db6c-e4cd-436f-a0b3-a52106366aff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:14.348777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6312db6c-e4cd-436f-a0b3-a52106366aff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:14.495138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6312db6c-e4cd-436f-a0b3-a52106366aff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:14.503165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6312db6c-e4cd-436f-a0b3-a52106366aff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.167284 Mar 08 04:36:14.503764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 962/1869] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:15.520924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-907c9d28-6be5-4188-81e7-ddc3731fa5d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:15.521463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-907c9d28-6be5-4188-81e7-ddc3731fa5d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:15.528227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-907c9d28-6be5-4188-81e7-ddc3731fa5d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:15.528679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-907c9d28-6be5-4188-81e7-ddc3731fa5d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:15.529452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-907c9d28-6be5-4188-81e7-ddc3731fa5d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:15.529916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-907c9d28-6be5-4188-81e7-ddc3731fa5d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:15.662661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-907c9d28-6be5-4188-81e7-ddc3731fa5d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:15.670825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-907c9d28-6be5-4188-81e7-ddc3731fa5d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153852 Mar 08 04:36:15.671389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 908/1870] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:16.688325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dd540384-ab00-414f-8a53-e16be2cb98d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:16.688927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dd540384-ab00-414f-8a53-e16be2cb98d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:16.695109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd540384-ab00-414f-8a53-e16be2cb98d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:16.695580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd540384-ab00-414f-8a53-e16be2cb98d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:16.696335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd540384-ab00-414f-8a53-e16be2cb98d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:16.696769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd540384-ab00-414f-8a53-e16be2cb98d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:16.829069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dd540384-ab00-414f-8a53-e16be2cb98d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:16.836755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dd540384-ab00-414f-8a53-e16be2cb98d4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152312 Mar 08 04:36:16.837307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 963/1871] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:17.854556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fe22babe-ddda-4486-9eb4-63c68193b396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:17.854947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fe22babe-ddda-4486-9eb4-63c68193b396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:17.863340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe22babe-ddda-4486-9eb4-63c68193b396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:17.863799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe22babe-ddda-4486-9eb4-63c68193b396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:17.864570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe22babe-ddda-4486-9eb4-63c68193b396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:17.865007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe22babe-ddda-4486-9eb4-63c68193b396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:17.992827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fe22babe-ddda-4486-9eb4-63c68193b396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:18.000588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fe22babe-ddda-4486-9eb4-63c68193b396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150569 Mar 08 04:36:18.001144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 909/1872] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:19.017639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-61b33051-1b20-42c9-89c1-769bef1e31de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:19.018275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-61b33051-1b20-42c9-89c1-769bef1e31de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:19.024136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61b33051-1b20-42c9-89c1-769bef1e31de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:19.024578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61b33051-1b20-42c9-89c1-769bef1e31de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:19.025333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61b33051-1b20-42c9-89c1-769bef1e31de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:19.026589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61b33051-1b20-42c9-89c1-769bef1e31de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:19.157412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-61b33051-1b20-42c9-89c1-769bef1e31de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:19.165300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-61b33051-1b20-42c9-89c1-769bef1e31de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151518 Mar 08 04:36:19.165908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 964/1873] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:20.183394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-208af7ad-cb60-464d-9ebe-293b9da38701 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:20.184011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-208af7ad-cb60-464d-9ebe-293b9da38701 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:20.190265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-208af7ad-cb60-464d-9ebe-293b9da38701 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:20.190693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-208af7ad-cb60-464d-9ebe-293b9da38701 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:20.191456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-208af7ad-cb60-464d-9ebe-293b9da38701 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:20.191893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-208af7ad-cb60-464d-9ebe-293b9da38701 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:20.326241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-208af7ad-cb60-464d-9ebe-293b9da38701 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:20.333964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-208af7ad-cb60-464d-9ebe-293b9da38701 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154585 Mar 08 04:36:20.334520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 910/1874] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:21.351292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fcaaea04-e8e4-4961-8a81-26ed7b541748 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:21.351928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fcaaea04-e8e4-4961-8a81-26ed7b541748 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:21.358389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fcaaea04-e8e4-4961-8a81-26ed7b541748 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:21.358827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fcaaea04-e8e4-4961-8a81-26ed7b541748 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:21.359580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fcaaea04-e8e4-4961-8a81-26ed7b541748 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:21.360012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fcaaea04-e8e4-4961-8a81-26ed7b541748 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:21.491224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fcaaea04-e8e4-4961-8a81-26ed7b541748 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:21.499844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fcaaea04-e8e4-4961-8a81-26ed7b541748 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152420 Mar 08 04:36:21.500407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 965/1875] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:22.516987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-99936310-f6f7-4534-aa49-72c9b7bec549 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:22.517591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-99936310-f6f7-4534-aa49-72c9b7bec549 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:22.523789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99936310-f6f7-4534-aa49-72c9b7bec549 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:22.524231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99936310-f6f7-4534-aa49-72c9b7bec549 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:22.524988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99936310-f6f7-4534-aa49-72c9b7bec549 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:22.525419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99936310-f6f7-4534-aa49-72c9b7bec549 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:22.658840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-99936310-f6f7-4534-aa49-72c9b7bec549 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:22.666571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-99936310-f6f7-4534-aa49-72c9b7bec549 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153458 Mar 08 04:36:22.667279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 911/1876] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:23.684320 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-367df219-9983-4262-9842-f4070812f8b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:23.684911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-367df219-9983-4262-9842-f4070812f8b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:23.691262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-367df219-9983-4262-9842-f4070812f8b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:23.691720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-367df219-9983-4262-9842-f4070812f8b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:23.692487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-367df219-9983-4262-9842-f4070812f8b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:23.692926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-367df219-9983-4262-9842-f4070812f8b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:23.826793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-367df219-9983-4262-9842-f4070812f8b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:23.834390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-367df219-9983-4262-9842-f4070812f8b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154450 Mar 08 04:36:23.834943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 966/1877] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:24.851993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b8968191-825b-4b6d-bb1f-3150991bd594 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:24.852642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b8968191-825b-4b6d-bb1f-3150991bd594 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:24.859031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8968191-825b-4b6d-bb1f-3150991bd594 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:24.859478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8968191-825b-4b6d-bb1f-3150991bd594 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:24.860244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8968191-825b-4b6d-bb1f-3150991bd594 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:24.860682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8968191-825b-4b6d-bb1f-3150991bd594 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:24.994629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b8968191-825b-4b6d-bb1f-3150991bd594 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:25.002325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b8968191-825b-4b6d-bb1f-3150991bd594 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154432 Mar 08 04:36:25.002821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 912/1878] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:26.019526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-31b335c6-a704-4b2b-a034-55fb084ba061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:26.020139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-31b335c6-a704-4b2b-a034-55fb084ba061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:26.027292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31b335c6-a704-4b2b-a034-55fb084ba061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:26.027749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31b335c6-a704-4b2b-a034-55fb084ba061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:26.028524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31b335c6-a704-4b2b-a034-55fb084ba061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:26.028968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31b335c6-a704-4b2b-a034-55fb084ba061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:26.159138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-31b335c6-a704-4b2b-a034-55fb084ba061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:26.166834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-31b335c6-a704-4b2b-a034-55fb084ba061 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151265 Mar 08 04:36:26.167400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 967/1879] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:27.183940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-97aa6439-096d-4c25-8af6-e55ffdfdbbb5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:27.184547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-97aa6439-096d-4c25-8af6-e55ffdfdbbb5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:27.190760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97aa6439-096d-4c25-8af6-e55ffdfdbbb5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:27.191203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97aa6439-096d-4c25-8af6-e55ffdfdbbb5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:27.191957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97aa6439-096d-4c25-8af6-e55ffdfdbbb5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:27.192388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97aa6439-096d-4c25-8af6-e55ffdfdbbb5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:27.319531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-97aa6439-096d-4c25-8af6-e55ffdfdbbb5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:27.327246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-97aa6439-096d-4c25-8af6-e55ffdfdbbb5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.147174 Mar 08 04:36:27.327821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 913/1880] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:28.345073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f4fd30e7-8693-4b41-b5c5-3fcddb74bae1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:28.345716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f4fd30e7-8693-4b41-b5c5-3fcddb74bae1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:28.351962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4fd30e7-8693-4b41-b5c5-3fcddb74bae1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:28.352415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4fd30e7-8693-4b41-b5c5-3fcddb74bae1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:28.353181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4fd30e7-8693-4b41-b5c5-3fcddb74bae1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:28.353627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4fd30e7-8693-4b41-b5c5-3fcddb74bae1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:28.485061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f4fd30e7-8693-4b41-b5c5-3fcddb74bae1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:28.492880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f4fd30e7-8693-4b41-b5c5-3fcddb74bae1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151685 Mar 08 04:36:28.493436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 968/1881] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:29.510700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-53d1850a-5b21-405c-8db6-7c9b2d0e8b24 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:29.511237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-53d1850a-5b21-405c-8db6-7c9b2d0e8b24 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:29.517482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53d1850a-5b21-405c-8db6-7c9b2d0e8b24 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:29.517954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53d1850a-5b21-405c-8db6-7c9b2d0e8b24 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:29.518710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53d1850a-5b21-405c-8db6-7c9b2d0e8b24 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:29.519137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-53d1850a-5b21-405c-8db6-7c9b2d0e8b24 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:29.649621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-53d1850a-5b21-405c-8db6-7c9b2d0e8b24 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:29.658120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-53d1850a-5b21-405c-8db6-7c9b2d0e8b24 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151894 Mar 08 04:36:29.658684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 914/1882] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:30.675109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dd1b2d97-b240-4846-94d6-99eb160db056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:30.675721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dd1b2d97-b240-4846-94d6-99eb160db056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:30.682071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd1b2d97-b240-4846-94d6-99eb160db056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:30.682525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd1b2d97-b240-4846-94d6-99eb160db056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:30.683294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd1b2d97-b240-4846-94d6-99eb160db056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:30.683736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd1b2d97-b240-4846-94d6-99eb160db056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:30.816381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dd1b2d97-b240-4846-94d6-99eb160db056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:30.824222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dd1b2d97-b240-4846-94d6-99eb160db056 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152958 Mar 08 04:36:30.824781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 969/1883] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:31.840849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c068b5ce-c9aa-45fb-9e1f-a458b0d30f91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:31.841457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c068b5ce-c9aa-45fb-9e1f-a458b0d30f91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:31.847727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c068b5ce-c9aa-45fb-9e1f-a458b0d30f91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:31.848205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c068b5ce-c9aa-45fb-9e1f-a458b0d30f91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:31.848976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c068b5ce-c9aa-45fb-9e1f-a458b0d30f91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:31.849407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c068b5ce-c9aa-45fb-9e1f-a458b0d30f91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:31.979774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c068b5ce-c9aa-45fb-9e1f-a458b0d30f91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:31.989206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c068b5ce-c9aa-45fb-9e1f-a458b0d30f91 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152799 Mar 08 04:36:31.989798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 915/1884] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:33.006865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e3a0e910-2682-45dc-b461-1dd0f3a2e610 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:33.007471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e3a0e910-2682-45dc-b461-1dd0f3a2e610 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:33.014522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3a0e910-2682-45dc-b461-1dd0f3a2e610 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:33.014966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3a0e910-2682-45dc-b461-1dd0f3a2e610 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:33.015721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3a0e910-2682-45dc-b461-1dd0f3a2e610 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:33.016161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3a0e910-2682-45dc-b461-1dd0f3a2e610 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:33.147408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e3a0e910-2682-45dc-b461-1dd0f3a2e610 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:33.155815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e3a0e910-2682-45dc-b461-1dd0f3a2e610 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152680 Mar 08 04:36:33.156406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 970/1885] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:34.172164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ef670bfb-1a36-44b4-9ed1-2472012c7e01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:34.172768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ef670bfb-1a36-44b4-9ed1-2472012c7e01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:34.179051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef670bfb-1a36-44b4-9ed1-2472012c7e01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:34.179491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef670bfb-1a36-44b4-9ed1-2472012c7e01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:34.180250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef670bfb-1a36-44b4-9ed1-2472012c7e01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:34.180678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef670bfb-1a36-44b4-9ed1-2472012c7e01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:34.310712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ef670bfb-1a36-44b4-9ed1-2472012c7e01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:34.318334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ef670bfb-1a36-44b4-9ed1-2472012c7e01 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149976 Mar 08 04:36:34.318892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 916/1886] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:35.334426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e2bab504-ee09-477d-ba43-cd7c00eadc95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:35.335008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e2bab504-ee09-477d-ba43-cd7c00eadc95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:35.342097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2bab504-ee09-477d-ba43-cd7c00eadc95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:35.342541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2bab504-ee09-477d-ba43-cd7c00eadc95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:35.343329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2bab504-ee09-477d-ba43-cd7c00eadc95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:35.343763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2bab504-ee09-477d-ba43-cd7c00eadc95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:35.471735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e2bab504-ee09-477d-ba43-cd7c00eadc95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:35.479498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e2bab504-ee09-477d-ba43-cd7c00eadc95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148891 Mar 08 04:36:35.480051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 971/1887] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:36.497202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b5258142-a195-43f7-9e9c-58c955bfca5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:36.497849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b5258142-a195-43f7-9e9c-58c955bfca5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:36.503761 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5258142-a195-43f7-9e9c-58c955bfca5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:36.504209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5258142-a195-43f7-9e9c-58c955bfca5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:36.504969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5258142-a195-43f7-9e9c-58c955bfca5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:36.505404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5258142-a195-43f7-9e9c-58c955bfca5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:36.643226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b5258142-a195-43f7-9e9c-58c955bfca5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:36.651191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b5258142-a195-43f7-9e9c-58c955bfca5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.158574 Mar 08 04:36:36.652019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 917/1888] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:37.670223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-96566759-86e3-4539-8fd7-126f51fdcfa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:37.670894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-96566759-86e3-4539-8fd7-126f51fdcfa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:37.677715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96566759-86e3-4539-8fd7-126f51fdcfa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:37.678165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96566759-86e3-4539-8fd7-126f51fdcfa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:37.678926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96566759-86e3-4539-8fd7-126f51fdcfa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:37.679358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96566759-86e3-4539-8fd7-126f51fdcfa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:37.817590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-96566759-86e3-4539-8fd7-126f51fdcfa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:37.825768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-96566759-86e3-4539-8fd7-126f51fdcfa5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.159531 Mar 08 04:36:37.826337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 972/1889] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:38.843587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9582f328-c021-475b-9243-bba02c696c28 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:38.844186 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9582f328-c021-475b-9243-bba02c696c28 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:38.850437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9582f328-c021-475b-9243-bba02c696c28 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:38.850879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9582f328-c021-475b-9243-bba02c696c28 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:38.851630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9582f328-c021-475b-9243-bba02c696c28 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:38.852058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9582f328-c021-475b-9243-bba02c696c28 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:38.983348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9582f328-c021-475b-9243-bba02c696c28 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:38.990962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9582f328-c021-475b-9243-bba02c696c28 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151216 Mar 08 04:36:38.991522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 918/1890] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:36:40.008133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-39a7c8f8-c83b-46ae-9fde-ada9fe65b544 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:40.008732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-39a7c8f8-c83b-46ae-9fde-ada9fe65b544 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:40.015162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39a7c8f8-c83b-46ae-9fde-ada9fe65b544 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:40.015606 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39a7c8f8-c83b-46ae-9fde-ada9fe65b544 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:40.016366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39a7c8f8-c83b-46ae-9fde-ada9fe65b544 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:40.016798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39a7c8f8-c83b-46ae-9fde-ada9fe65b544 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:40.144070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-39a7c8f8-c83b-46ae-9fde-ada9fe65b544 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:40.152727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-39a7c8f8-c83b-46ae-9fde-ada9fe65b544 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148431 Mar 08 04:36:40.153289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 973/1891] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:41.169818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-551f492b-aab7-4037-908c-1e0e91b3bbfa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:41.170413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-551f492b-aab7-4037-908c-1e0e91b3bbfa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:41.176558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-551f492b-aab7-4037-908c-1e0e91b3bbfa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:41.177000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-551f492b-aab7-4037-908c-1e0e91b3bbfa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:41.177779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-551f492b-aab7-4037-908c-1e0e91b3bbfa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:41.178214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-551f492b-aab7-4037-908c-1e0e91b3bbfa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:41.306866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-551f492b-aab7-4037-908c-1e0e91b3bbfa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:41.314552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-551f492b-aab7-4037-908c-1e0e91b3bbfa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148710 Mar 08 04:36:41.315110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 919/1892] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:42.332135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-19622b49-db5e-4589-a00e-a745096f2d40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:42.332722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-19622b49-db5e-4589-a00e-a745096f2d40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:42.339659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19622b49-db5e-4589-a00e-a745096f2d40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:42.340102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19622b49-db5e-4589-a00e-a745096f2d40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:42.340856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19622b49-db5e-4589-a00e-a745096f2d40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:42.341287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19622b49-db5e-4589-a00e-a745096f2d40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:42.473275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-19622b49-db5e-4589-a00e-a745096f2d40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:42.481858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-19622b49-db5e-4589-a00e-a745096f2d40 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153546 Mar 08 04:36:42.482426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 974/1893] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:43.499281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bf772870-589e-4d1e-b10a-806ace54681c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:43.500096 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bf772870-589e-4d1e-b10a-806ace54681c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:43.506461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf772870-589e-4d1e-b10a-806ace54681c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:43.506907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf772870-589e-4d1e-b10a-806ace54681c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:43.507770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf772870-589e-4d1e-b10a-806ace54681c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:43.508199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf772870-589e-4d1e-b10a-806ace54681c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:43.660593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bf772870-589e-4d1e-b10a-806ace54681c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:43.669701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bf772870-589e-4d1e-b10a-806ace54681c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.175232 Mar 08 04:36:43.670278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 920/1894] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:44.690515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-39b9eeab-884d-4d43-9dc5-ebe6810294cf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:44.691121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-39b9eeab-884d-4d43-9dc5-ebe6810294cf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:44.698054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39b9eeab-884d-4d43-9dc5-ebe6810294cf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:44.698504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39b9eeab-884d-4d43-9dc5-ebe6810294cf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:44.699289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39b9eeab-884d-4d43-9dc5-ebe6810294cf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:44.699728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39b9eeab-884d-4d43-9dc5-ebe6810294cf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:44.830354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-39b9eeab-884d-4d43-9dc5-ebe6810294cf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:44.838407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-39b9eeab-884d-4d43-9dc5-ebe6810294cf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151695 Mar 08 04:36:44.838974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 975/1895] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:45.856461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ad9e79a2-a2b6-40e1-a72c-8dbde67a8731 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:45.857066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ad9e79a2-a2b6-40e1-a72c-8dbde67a8731 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:45.863372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad9e79a2-a2b6-40e1-a72c-8dbde67a8731 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:45.863812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad9e79a2-a2b6-40e1-a72c-8dbde67a8731 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:45.864565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad9e79a2-a2b6-40e1-a72c-8dbde67a8731 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:45.864993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad9e79a2-a2b6-40e1-a72c-8dbde67a8731 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:45.994344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ad9e79a2-a2b6-40e1-a72c-8dbde67a8731 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:46.002377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ad9e79a2-a2b6-40e1-a72c-8dbde67a8731 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150169 Mar 08 04:36:46.002982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 921/1896] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:47.020349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-de0823b5-2855-44c0-9e30-b4d8f0d0a08b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:47.020951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-de0823b5-2855-44c0-9e30-b4d8f0d0a08b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:47.028092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de0823b5-2855-44c0-9e30-b4d8f0d0a08b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:47.028543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de0823b5-2855-44c0-9e30-b4d8f0d0a08b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:47.029309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de0823b5-2855-44c0-9e30-b4d8f0d0a08b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:47.029773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de0823b5-2855-44c0-9e30-b4d8f0d0a08b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:47.162688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-de0823b5-2855-44c0-9e30-b4d8f0d0a08b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:47.170722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-de0823b5-2855-44c0-9e30-b4d8f0d0a08b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154246 Mar 08 04:36:47.171288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 976/1897] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:48.188182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-655cbb8f-4c89-4980-87f7-a2d9aa7a1737 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:48.188802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-655cbb8f-4c89-4980-87f7-a2d9aa7a1737 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:48.195066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-655cbb8f-4c89-4980-87f7-a2d9aa7a1737 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:48.195510 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-655cbb8f-4c89-4980-87f7-a2d9aa7a1737 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:48.196265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-655cbb8f-4c89-4980-87f7-a2d9aa7a1737 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:48.197321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-655cbb8f-4c89-4980-87f7-a2d9aa7a1737 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:48.324823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-655cbb8f-4c89-4980-87f7-a2d9aa7a1737 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:48.332576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-655cbb8f-4c89-4980-87f7-a2d9aa7a1737 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148271 Mar 08 04:36:48.333136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 922/1898] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:49.350642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3602907c-d74c-43ba-b783-1f443392e976 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:49.351251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3602907c-d74c-43ba-b783-1f443392e976 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:49.357342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3602907c-d74c-43ba-b783-1f443392e976 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:49.357816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3602907c-d74c-43ba-b783-1f443392e976 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:49.358597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3602907c-d74c-43ba-b783-1f443392e976 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:49.359038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3602907c-d74c-43ba-b783-1f443392e976 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:49.515469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3602907c-d74c-43ba-b783-1f443392e976 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:49.523076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3602907c-d74c-43ba-b783-1f443392e976 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.176376 Mar 08 04:36:49.523637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 977/1899] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:36:50.540295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-91ab607c-5d0b-4e19-b3b8-ead1faae079c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:50.540892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-91ab607c-5d0b-4e19-b3b8-ead1faae079c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:50.547159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91ab607c-5d0b-4e19-b3b8-ead1faae079c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:50.547603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91ab607c-5d0b-4e19-b3b8-ead1faae079c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:50.548353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91ab607c-5d0b-4e19-b3b8-ead1faae079c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:50.548783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91ab607c-5d0b-4e19-b3b8-ead1faae079c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:50.934273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-91ab607c-5d0b-4e19-b3b8-ead1faae079c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:50.941912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-91ab607c-5d0b-4e19-b3b8-ead1faae079c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.405399 Mar 08 04:36:50.942467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 923/1900] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:50 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:51.959583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c89eb820-0aab-4e04-8bb6-66b37258af5e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:51.960195 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c89eb820-0aab-4e04-8bb6-66b37258af5e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:51.967112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c89eb820-0aab-4e04-8bb6-66b37258af5e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:51.967559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c89eb820-0aab-4e04-8bb6-66b37258af5e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:51.968326 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c89eb820-0aab-4e04-8bb6-66b37258af5e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:51.968760 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c89eb820-0aab-4e04-8bb6-66b37258af5e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:52.098776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c89eb820-0aab-4e04-8bb6-66b37258af5e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:52.107262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c89eb820-0aab-4e04-8bb6-66b37258af5e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151589 Mar 08 04:36:52.107833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 978/1901] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:53.124458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-419dde4f-29e6-4c18-b6c1-fe6555c77f65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:53.125031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-419dde4f-29e6-4c18-b6c1-fe6555c77f65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:53.131683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-419dde4f-29e6-4c18-b6c1-fe6555c77f65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:53.132131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-419dde4f-29e6-4c18-b6c1-fe6555c77f65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:53.132974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-419dde4f-29e6-4c18-b6c1-fe6555c77f65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:53.133405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-419dde4f-29e6-4c18-b6c1-fe6555c77f65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:53.266499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-419dde4f-29e6-4c18-b6c1-fe6555c77f65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:53.274175 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-419dde4f-29e6-4c18-b6c1-fe6555c77f65 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153717 Mar 08 04:36:53.275325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 924/1902] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:54.292589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9eece9fa-61b8-4bb9-9706-72844b49a1e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:54.293194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9eece9fa-61b8-4bb9-9706-72844b49a1e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:54.299405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9eece9fa-61b8-4bb9-9706-72844b49a1e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:54.299848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9eece9fa-61b8-4bb9-9706-72844b49a1e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:54.300603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9eece9fa-61b8-4bb9-9706-72844b49a1e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:54.301033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9eece9fa-61b8-4bb9-9706-72844b49a1e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:54.428809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9eece9fa-61b8-4bb9-9706-72844b49a1e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:54.436698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9eece9fa-61b8-4bb9-9706-72844b49a1e3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148556 Mar 08 04:36:54.437256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 979/1903] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:55.453314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-95fa4a2f-c6be-4ce7-8d7c-5ac9a9789efc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:55.453947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-95fa4a2f-c6be-4ce7-8d7c-5ac9a9789efc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:55.460239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95fa4a2f-c6be-4ce7-8d7c-5ac9a9789efc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:55.460635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95fa4a2f-c6be-4ce7-8d7c-5ac9a9789efc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:55.461415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95fa4a2f-c6be-4ce7-8d7c-5ac9a9789efc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:55.461873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95fa4a2f-c6be-4ce7-8d7c-5ac9a9789efc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:55.593210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-95fa4a2f-c6be-4ce7-8d7c-5ac9a9789efc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:55.601029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-95fa4a2f-c6be-4ce7-8d7c-5ac9a9789efc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151585 Mar 08 04:36:55.601590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 925/1904] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:56.619135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-28c5f368-ead6-4f37-af7a-7a18106a878e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:56.619767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-28c5f368-ead6-4f37-af7a-7a18106a878e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:56.625998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-28c5f368-ead6-4f37-af7a-7a18106a878e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:56.626449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-28c5f368-ead6-4f37-af7a-7a18106a878e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:56.627210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-28c5f368-ead6-4f37-af7a-7a18106a878e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:56.627650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-28c5f368-ead6-4f37-af7a-7a18106a878e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:56.755549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-28c5f368-ead6-4f37-af7a-7a18106a878e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:56.764121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-28c5f368-ead6-4f37-af7a-7a18106a878e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149612 Mar 08 04:36:56.764686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 980/1905] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:36:57.781649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1a9e8a49-a20b-40c9-b8c0-dd60a3603e88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:57.782285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1a9e8a49-a20b-40c9-b8c0-dd60a3603e88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:57.788555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a9e8a49-a20b-40c9-b8c0-dd60a3603e88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:57.789008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a9e8a49-a20b-40c9-b8c0-dd60a3603e88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:57.789869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a9e8a49-a20b-40c9-b8c0-dd60a3603e88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:57.791104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a9e8a49-a20b-40c9-b8c0-dd60a3603e88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:57.923657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1a9e8a49-a20b-40c9-b8c0-dd60a3603e88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:57.931287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1a9e8a49-a20b-40c9-b8c0-dd60a3603e88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153502 Mar 08 04:36:57.931838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 926/1906] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:36:58.948708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4ba193fd-ef4c-472c-b2dc-dd076ffa88d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:36:58.949323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4ba193fd-ef4c-472c-b2dc-dd076ffa88d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:36:58.955582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ba193fd-ef4c-472c-b2dc-dd076ffa88d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:58.956034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ba193fd-ef4c-472c-b2dc-dd076ffa88d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:58.956802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ba193fd-ef4c-472c-b2dc-dd076ffa88d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:36:58.957238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4ba193fd-ef4c-472c-b2dc-dd076ffa88d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:36:59.091402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4ba193fd-ef4c-472c-b2dc-dd076ffa88d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:36:59.099063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4ba193fd-ef4c-472c-b2dc-dd076ffa88d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154562 Mar 08 04:36:59.099626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 981/1907] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:36:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:00.116333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b2b70ff4-9d38-4ec4-9e34-bdc1d044a86f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:00.116887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b2b70ff4-9d38-4ec4-9e34-bdc1d044a86f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:00.125866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2b70ff4-9d38-4ec4-9e34-bdc1d044a86f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:00.126630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2b70ff4-9d38-4ec4-9e34-bdc1d044a86f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:00.127762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2b70ff4-9d38-4ec4-9e34-bdc1d044a86f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:00.128205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2b70ff4-9d38-4ec4-9e34-bdc1d044a86f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:00.256559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b2b70ff4-9d38-4ec4-9e34-bdc1d044a86f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:00.264897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b2b70ff4-9d38-4ec4-9e34-bdc1d044a86f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152514 Mar 08 04:37:00.265453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 927/1908] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:01.281610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-af7a1249-987e-4ae0-bf8d-872b31ad2d97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:01.282237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-af7a1249-987e-4ae0-bf8d-872b31ad2d97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:01.288405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af7a1249-987e-4ae0-bf8d-872b31ad2d97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:01.288845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af7a1249-987e-4ae0-bf8d-872b31ad2d97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:01.289602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af7a1249-987e-4ae0-bf8d-872b31ad2d97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:01.290091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af7a1249-987e-4ae0-bf8d-872b31ad2d97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:01.422471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-af7a1249-987e-4ae0-bf8d-872b31ad2d97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:01.432549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-af7a1249-987e-4ae0-bf8d-872b31ad2d97 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154737 Mar 08 04:37:01.433120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 982/1909] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:01 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:02.449529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8d919f52-2913-4c2f-b8bd-3f3b2f45affd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:02.450161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8d919f52-2913-4c2f-b8bd-3f3b2f45affd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:02.456392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d919f52-2913-4c2f-b8bd-3f3b2f45affd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:02.456837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d919f52-2913-4c2f-b8bd-3f3b2f45affd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:02.457590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d919f52-2913-4c2f-b8bd-3f3b2f45affd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:02.458042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d919f52-2913-4c2f-b8bd-3f3b2f45affd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:02.587665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8d919f52-2913-4c2f-b8bd-3f3b2f45affd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:02.595320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8d919f52-2913-4c2f-b8bd-3f3b2f45affd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149911 Mar 08 04:37:02.595884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 928/1910] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:03.613551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-522f658f-c455-4ff6-bb44-b98a5099c475 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:03.614128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-522f658f-c455-4ff6-bb44-b98a5099c475 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:03.621062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-522f658f-c455-4ff6-bb44-b98a5099c475 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:03.621497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-522f658f-c455-4ff6-bb44-b98a5099c475 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:03.622285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-522f658f-c455-4ff6-bb44-b98a5099c475 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:03.622722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-522f658f-c455-4ff6-bb44-b98a5099c475 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:03.749621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-522f658f-c455-4ff6-bb44-b98a5099c475 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:03.757224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-522f658f-c455-4ff6-bb44-b98a5099c475 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.147660 Mar 08 04:37:03.757801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 983/1911] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:04.774964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-630650fc-a40e-43f4-82d2-3e2abf057b12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:04.775569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-630650fc-a40e-43f4-82d2-3e2abf057b12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:04.782107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-630650fc-a40e-43f4-82d2-3e2abf057b12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:04.782554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-630650fc-a40e-43f4-82d2-3e2abf057b12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:04.783310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-630650fc-a40e-43f4-82d2-3e2abf057b12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:04.783739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-630650fc-a40e-43f4-82d2-3e2abf057b12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:04.916321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-630650fc-a40e-43f4-82d2-3e2abf057b12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:04.922766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-630650fc-a40e-43f4-82d2-3e2abf057b12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151727 Mar 08 04:37:04.923342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 929/1912] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:05.940165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-03427d06-685a-4cf9-848d-5fc1bf368ff9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:05.940777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-03427d06-685a-4cf9-848d-5fc1bf368ff9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:05.947006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-03427d06-685a-4cf9-848d-5fc1bf368ff9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:05.947448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-03427d06-685a-4cf9-848d-5fc1bf368ff9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:05.948232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-03427d06-685a-4cf9-848d-5fc1bf368ff9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:05.948662 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-03427d06-685a-4cf9-848d-5fc1bf368ff9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:06.079257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-03427d06-685a-4cf9-848d-5fc1bf368ff9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:06.088059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-03427d06-685a-4cf9-848d-5fc1bf368ff9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151854 Mar 08 04:37:06.088631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 984/1913] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:07.107508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a362975f-7c3f-4c92-8e25-e7b29af673fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:07.108167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a362975f-7c3f-4c92-8e25-e7b29af673fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:07.114164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a362975f-7c3f-4c92-8e25-e7b29af673fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:07.114621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a362975f-7c3f-4c92-8e25-e7b29af673fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:07.115444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a362975f-7c3f-4c92-8e25-e7b29af673fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:07.115915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a362975f-7c3f-4c92-8e25-e7b29af673fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:07.155947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e303bac0-08b5-45de-a08d-8b35140b2f2b tempest-TestVolumeBootPattern-601865887 tempest-TestVolumeBootPattern-601865887-project] Calling method '.version_select at 0x7fe8325ff550>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:07.174049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e303bac0-08b5-45de-a08d-8b35140b2f2b tempest-TestVolumeBootPattern-601865887 tempest-TestVolumeBootPattern-601865887-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-928865511" status: 202 len: 0 microversion: 2.1 time: 0.021806 Mar 08 04:37:07.174909 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 985/1914] 10.222.0.30 () {58 vars in 1259 bytes} [Tue Mar 8 04:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-928865511 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 04:37:07.279921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a362975f-7c3f-4c92-8e25-e7b29af673fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:07.289972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a362975f-7c3f-4c92-8e25-e7b29af673fd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.188422 Mar 08 04:37:07.290686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 930/1915] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:08.309085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a87ecfd1-d9a4-43d5-91b2-6177ddb10f70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:08.309720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a87ecfd1-d9a4-43d5-91b2-6177ddb10f70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:08.317223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a87ecfd1-d9a4-43d5-91b2-6177ddb10f70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:08.317916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a87ecfd1-d9a4-43d5-91b2-6177ddb10f70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:08.318868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a87ecfd1-d9a4-43d5-91b2-6177ddb10f70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:08.319380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a87ecfd1-d9a4-43d5-91b2-6177ddb10f70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:08.520405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a87ecfd1-d9a4-43d5-91b2-6177ddb10f70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:08.530004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a87ecfd1-d9a4-43d5-91b2-6177ddb10f70 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.226378 Mar 08 04:37:08.532249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 986/1916] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:09.549539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-934ca058-ede1-46ae-a289-1caf634f223f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:09.550102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-934ca058-ede1-46ae-a289-1caf634f223f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:09.556189 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-934ca058-ede1-46ae-a289-1caf634f223f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:09.556628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-934ca058-ede1-46ae-a289-1caf634f223f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:09.557392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-934ca058-ede1-46ae-a289-1caf634f223f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:09.557867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-934ca058-ede1-46ae-a289-1caf634f223f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:09.825468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-934ca058-ede1-46ae-a289-1caf634f223f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:09.836876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-934ca058-ede1-46ae-a289-1caf634f223f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.291102 Mar 08 04:37:09.837835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 931/1917] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:10.854842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9d039a7e-543c-4cfc-850a-24e4fc912e4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:10.855449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9d039a7e-543c-4cfc-850a-24e4fc912e4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:10.861728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d039a7e-543c-4cfc-850a-24e4fc912e4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:10.862172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d039a7e-543c-4cfc-850a-24e4fc912e4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:10.863622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d039a7e-543c-4cfc-850a-24e4fc912e4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:10.864076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9d039a7e-543c-4cfc-850a-24e4fc912e4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:11.002405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9d039a7e-543c-4cfc-850a-24e4fc912e4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:11.010582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9d039a7e-543c-4cfc-850a-24e4fc912e4d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.160237 Mar 08 04:37:11.011166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 987/1918] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:12.029641 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-43785088-1eb2-4139-9834-02547c87fb75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:12.030474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-43785088-1eb2-4139-9834-02547c87fb75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:12.036999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-43785088-1eb2-4139-9834-02547c87fb75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:12.037442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-43785088-1eb2-4139-9834-02547c87fb75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:12.038437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-43785088-1eb2-4139-9834-02547c87fb75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:12.038870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-43785088-1eb2-4139-9834-02547c87fb75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:12.190800 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-43785088-1eb2-4139-9834-02547c87fb75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:12.200348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-43785088-1eb2-4139-9834-02547c87fb75 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.175699 Mar 08 04:37:12.200952 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 932/1919] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:13.218573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b817d5cc-82c9-4a2c-b1da-5179ec3e54ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:13.219179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b817d5cc-82c9-4a2c-b1da-5179ec3e54ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:13.226220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b817d5cc-82c9-4a2c-b1da-5179ec3e54ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:13.227941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b817d5cc-82c9-4a2c-b1da-5179ec3e54ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:13.228748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b817d5cc-82c9-4a2c-b1da-5179ec3e54ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:13.230681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b817d5cc-82c9-4a2c-b1da-5179ec3e54ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:13.488669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b817d5cc-82c9-4a2c-b1da-5179ec3e54ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:13.499470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b817d5cc-82c9-4a2c-b1da-5179ec3e54ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.284830 Mar 08 04:37:13.503484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 988/1920] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:14.516361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f9ebde7b-3094-4f05-a6f0-d43064e9132c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:14.517592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f9ebde7b-3094-4f05-a6f0-d43064e9132c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:14.523513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9ebde7b-3094-4f05-a6f0-d43064e9132c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:14.524194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9ebde7b-3094-4f05-a6f0-d43064e9132c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:14.524843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9ebde7b-3094-4f05-a6f0-d43064e9132c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:14.525281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9ebde7b-3094-4f05-a6f0-d43064e9132c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:14.666798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f9ebde7b-3094-4f05-a6f0-d43064e9132c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:14.677305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f9ebde7b-3094-4f05-a6f0-d43064e9132c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.164636 Mar 08 04:37:14.678094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 933/1921] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:15.696136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-26bcbc23-1242-427c-8e1c-b9e6fadc3e6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:15.696762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-26bcbc23-1242-427c-8e1c-b9e6fadc3e6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:15.702938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-26bcbc23-1242-427c-8e1c-b9e6fadc3e6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:15.703405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-26bcbc23-1242-427c-8e1c-b9e6fadc3e6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:15.704146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-26bcbc23-1242-427c-8e1c-b9e6fadc3e6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:15.704580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-26bcbc23-1242-427c-8e1c-b9e6fadc3e6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:15.840379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-26bcbc23-1242-427c-8e1c-b9e6fadc3e6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:15.849924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-26bcbc23-1242-427c-8e1c-b9e6fadc3e6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.158154 Mar 08 04:37:15.850513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 989/1922] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:16.866430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5882392d-0090-405e-bc85-11855a52fcc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:16.867070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5882392d-0090-405e-bc85-11855a52fcc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:16.874837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5882392d-0090-405e-bc85-11855a52fcc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:16.875287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5882392d-0090-405e-bc85-11855a52fcc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:16.876048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5882392d-0090-405e-bc85-11855a52fcc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:16.876540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5882392d-0090-405e-bc85-11855a52fcc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:17.007831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5882392d-0090-405e-bc85-11855a52fcc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:17.016280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5882392d-0090-405e-bc85-11855a52fcc7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153701 Mar 08 04:37:17.016908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 934/1923] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:18.034799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-400f5834-095d-46b2-b9a9-d9c346e942a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:18.035409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-400f5834-095d-46b2-b9a9-d9c346e942a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:18.041583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-400f5834-095d-46b2-b9a9-d9c346e942a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:18.042069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-400f5834-095d-46b2-b9a9-d9c346e942a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:18.042837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-400f5834-095d-46b2-b9a9-d9c346e942a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:18.043287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-400f5834-095d-46b2-b9a9-d9c346e942a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:18.175005 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-400f5834-095d-46b2-b9a9-d9c346e942a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:18.183260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-400f5834-095d-46b2-b9a9-d9c346e942a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152329 Mar 08 04:37:18.183816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 990/1924] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:19.199530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d8da5f4f-746f-4b11-be46-c737b519c31b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:19.200167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d8da5f4f-746f-4b11-be46-c737b519c31b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:19.206391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8da5f4f-746f-4b11-be46-c737b519c31b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:19.206842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8da5f4f-746f-4b11-be46-c737b519c31b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:19.207598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8da5f4f-746f-4b11-be46-c737b519c31b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:19.208032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8da5f4f-746f-4b11-be46-c737b519c31b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:19.341964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d8da5f4f-746f-4b11-be46-c737b519c31b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:19.349594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d8da5f4f-746f-4b11-be46-c737b519c31b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153973 Mar 08 04:37:19.350187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 935/1925] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:19.952232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:37:19.952809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:37:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:37:20.366639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4720d00d-020e-4dff-9320-b26c1a95ffeb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:20.367839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4720d00d-020e-4dff-9320-b26c1a95ffeb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:20.374139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4720d00d-020e-4dff-9320-b26c1a95ffeb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:20.374617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4720d00d-020e-4dff-9320-b26c1a95ffeb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:20.375381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4720d00d-020e-4dff-9320-b26c1a95ffeb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:20.375819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4720d00d-020e-4dff-9320-b26c1a95ffeb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:20.504198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4720d00d-020e-4dff-9320-b26c1a95ffeb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:20.512551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4720d00d-020e-4dff-9320-b26c1a95ffeb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149814 Mar 08 04:37:20.513117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 991/1926] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:21.530806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3788280e-8e94-45f1-b2d7-af71f606fca7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:21.531351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3788280e-8e94-45f1-b2d7-af71f606fca7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:21.537539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3788280e-8e94-45f1-b2d7-af71f606fca7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:21.538010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3788280e-8e94-45f1-b2d7-af71f606fca7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:21.538821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3788280e-8e94-45f1-b2d7-af71f606fca7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:21.539434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3788280e-8e94-45f1-b2d7-af71f606fca7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:21.677572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3788280e-8e94-45f1-b2d7-af71f606fca7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:21.685180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3788280e-8e94-45f1-b2d7-af71f606fca7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.158328 Mar 08 04:37:21.685754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 936/1927] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:22.702216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2b71c0ef-e351-4947-b07f-d174b88dd621 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:22.702819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2b71c0ef-e351-4947-b07f-d174b88dd621 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:22.709251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2b71c0ef-e351-4947-b07f-d174b88dd621 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:22.709729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2b71c0ef-e351-4947-b07f-d174b88dd621 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:22.710501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2b71c0ef-e351-4947-b07f-d174b88dd621 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:22.711003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2b71c0ef-e351-4947-b07f-d174b88dd621 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:22.843077 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2b71c0ef-e351-4947-b07f-d174b88dd621 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:22.850998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2b71c0ef-e351-4947-b07f-d174b88dd621 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152640 Mar 08 04:37:22.851696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 992/1928] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:37:23.870022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0fb6bd92-dde9-4028-afd5-91a850c6bf25 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:23.870624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0fb6bd92-dde9-4028-afd5-91a850c6bf25 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:23.877090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0fb6bd92-dde9-4028-afd5-91a850c6bf25 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:23.877535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0fb6bd92-dde9-4028-afd5-91a850c6bf25 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:23.878322 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0fb6bd92-dde9-4028-afd5-91a850c6bf25 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:23.878753 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0fb6bd92-dde9-4028-afd5-91a850c6bf25 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:24.010790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0fb6bd92-dde9-4028-afd5-91a850c6bf25 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:24.018547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0fb6bd92-dde9-4028-afd5-91a850c6bf25 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153508 Mar 08 04:37:24.019105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 937/1929] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:25.035992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f26da8a6-7cda-46eb-8466-533885f5e04c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:25.036636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f26da8a6-7cda-46eb-8466-533885f5e04c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:25.043088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f26da8a6-7cda-46eb-8466-533885f5e04c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:25.043545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f26da8a6-7cda-46eb-8466-533885f5e04c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:25.044313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f26da8a6-7cda-46eb-8466-533885f5e04c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:25.044755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f26da8a6-7cda-46eb-8466-533885f5e04c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:25.180054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f26da8a6-7cda-46eb-8466-533885f5e04c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:25.188108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f26da8a6-7cda-46eb-8466-533885f5e04c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.156149 Mar 08 04:37:25.188674 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 993/1930] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:26.204980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c9f59a0c-6d74-401e-b902-4983c78b2072 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:26.205587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c9f59a0c-6d74-401e-b902-4983c78b2072 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:26.211912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9f59a0c-6d74-401e-b902-4983c78b2072 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:26.212354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9f59a0c-6d74-401e-b902-4983c78b2072 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:26.213109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9f59a0c-6d74-401e-b902-4983c78b2072 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:26.213538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9f59a0c-6d74-401e-b902-4983c78b2072 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:26.343581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c9f59a0c-6d74-401e-b902-4983c78b2072 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:26.351204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c9f59a0c-6d74-401e-b902-4983c78b2072 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150034 Mar 08 04:37:26.352279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 938/1931] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:27.369291 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-032552c8-5a7b-42e3-9082-7f7832ec534a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:27.369913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-032552c8-5a7b-42e3-9082-7f7832ec534a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:27.376174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-032552c8-5a7b-42e3-9082-7f7832ec534a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:27.376785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-032552c8-5a7b-42e3-9082-7f7832ec534a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:27.377551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-032552c8-5a7b-42e3-9082-7f7832ec534a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:27.378012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-032552c8-5a7b-42e3-9082-7f7832ec534a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:27.509994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-032552c8-5a7b-42e3-9082-7f7832ec534a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:27.517633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-032552c8-5a7b-42e3-9082-7f7832ec534a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152698 Mar 08 04:37:27.518214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 994/1932] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:28.534927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-94cebb07-f708-4d9e-8172-d5fb738d230d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:28.535537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-94cebb07-f708-4d9e-8172-d5fb738d230d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:28.541862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94cebb07-f708-4d9e-8172-d5fb738d230d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:28.542309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94cebb07-f708-4d9e-8172-d5fb738d230d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:28.543062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94cebb07-f708-4d9e-8172-d5fb738d230d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:28.543491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94cebb07-f708-4d9e-8172-d5fb738d230d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:28.671451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-94cebb07-f708-4d9e-8172-d5fb738d230d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:28.679210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-94cebb07-f708-4d9e-8172-d5fb738d230d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148180 Mar 08 04:37:28.679827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 939/1933] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:29.696981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-29055d1b-0787-40be-afdb-4136f1b96d2b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:29.697585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-29055d1b-0787-40be-afdb-4136f1b96d2b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:29.703791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29055d1b-0787-40be-afdb-4136f1b96d2b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:29.704234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29055d1b-0787-40be-afdb-4136f1b96d2b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:29.704992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29055d1b-0787-40be-afdb-4136f1b96d2b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:29.705425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-29055d1b-0787-40be-afdb-4136f1b96d2b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:29.840496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-29055d1b-0787-40be-afdb-4136f1b96d2b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:29.848172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-29055d1b-0787-40be-afdb-4136f1b96d2b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.155739 Mar 08 04:37:29.848738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 995/1934] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:30.865428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-65ab618f-cf38-4bb2-bab2-8d99120ed897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:30.866096 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-65ab618f-cf38-4bb2-bab2-8d99120ed897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:30.872870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-65ab618f-cf38-4bb2-bab2-8d99120ed897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:30.873316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-65ab618f-cf38-4bb2-bab2-8d99120ed897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:30.874102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-65ab618f-cf38-4bb2-bab2-8d99120ed897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:30.874538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-65ab618f-cf38-4bb2-bab2-8d99120ed897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:31.003624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-65ab618f-cf38-4bb2-bab2-8d99120ed897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:31.012025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-65ab618f-cf38-4bb2-bab2-8d99120ed897 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150431 Mar 08 04:37:31.012584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 940/1935] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:32.029346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ee037df8-7a06-4e54-99c8-66d3642af0cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:32.029978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ee037df8-7a06-4e54-99c8-66d3642af0cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:32.036209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee037df8-7a06-4e54-99c8-66d3642af0cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:32.036665 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee037df8-7a06-4e54-99c8-66d3642af0cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:32.037429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee037df8-7a06-4e54-99c8-66d3642af0cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:32.037895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee037df8-7a06-4e54-99c8-66d3642af0cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:32.167609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ee037df8-7a06-4e54-99c8-66d3642af0cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:32.175382 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ee037df8-7a06-4e54-99c8-66d3642af0cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150217 Mar 08 04:37:32.175944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 996/1936] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:33.191959 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-866b51fa-ccd4-441d-8b25-d3853e143f07 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:33.192603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-866b51fa-ccd4-441d-8b25-d3853e143f07 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:33.198998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-866b51fa-ccd4-441d-8b25-d3853e143f07 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:33.199444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-866b51fa-ccd4-441d-8b25-d3853e143f07 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:33.200213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-866b51fa-ccd4-441d-8b25-d3853e143f07 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:33.200648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-866b51fa-ccd4-441d-8b25-d3853e143f07 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:33.332927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-866b51fa-ccd4-441d-8b25-d3853e143f07 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:33.341184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-866b51fa-ccd4-441d-8b25-d3853e143f07 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153098 Mar 08 04:37:33.341768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 941/1937] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:34.358940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-42e77eae-fb4d-42bb-ba47-045043cc95e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:34.359649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-42e77eae-fb4d-42bb-ba47-045043cc95e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:34.366277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-42e77eae-fb4d-42bb-ba47-045043cc95e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:34.368394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-42e77eae-fb4d-42bb-ba47-045043cc95e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:34.368394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-42e77eae-fb4d-42bb-ba47-045043cc95e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:34.368394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-42e77eae-fb4d-42bb-ba47-045043cc95e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:34.499062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-42e77eae-fb4d-42bb-ba47-045043cc95e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:34.506660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-42e77eae-fb4d-42bb-ba47-045043cc95e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151563 Mar 08 04:37:34.507226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 997/1938] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:35.524457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1b902d22-1db8-4997-ab06-9aa3a9d4241c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:35.525004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1b902d22-1db8-4997-ab06-9aa3a9d4241c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:35.531252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b902d22-1db8-4997-ab06-9aa3a9d4241c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:35.531704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b902d22-1db8-4997-ab06-9aa3a9d4241c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:35.532464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b902d22-1db8-4997-ab06-9aa3a9d4241c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:35.532901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b902d22-1db8-4997-ab06-9aa3a9d4241c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:35.664263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1b902d22-1db8-4997-ab06-9aa3a9d4241c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:35.671955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1b902d22-1db8-4997-ab06-9aa3a9d4241c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151980 Mar 08 04:37:35.672511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 942/1939] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:36.689307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-155d5aef-d3e0-4b47-b565-9fd716c9dd17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:36.689947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-155d5aef-d3e0-4b47-b565-9fd716c9dd17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:36.696929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-155d5aef-d3e0-4b47-b565-9fd716c9dd17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:36.697370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-155d5aef-d3e0-4b47-b565-9fd716c9dd17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:36.698160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-155d5aef-d3e0-4b47-b565-9fd716c9dd17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:36.698592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-155d5aef-d3e0-4b47-b565-9fd716c9dd17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:36.827667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-155d5aef-d3e0-4b47-b565-9fd716c9dd17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:36.836003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-155d5aef-d3e0-4b47-b565-9fd716c9dd17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149980 Mar 08 04:37:36.836663 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 998/1940] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:37.852390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-268bba8b-874b-4861-baad-87658fec660b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:37.853004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-268bba8b-874b-4861-baad-87658fec660b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:37.859297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-268bba8b-874b-4861-baad-87658fec660b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:37.859748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-268bba8b-874b-4861-baad-87658fec660b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:37.860522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-268bba8b-874b-4861-baad-87658fec660b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:37.860961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-268bba8b-874b-4861-baad-87658fec660b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:37.993822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-268bba8b-874b-4861-baad-87658fec660b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:38.001568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-268bba8b-874b-4861-baad-87658fec660b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153083 Mar 08 04:37:38.002166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 943/1941] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:38.700368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:37:38.700610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:37:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:37:39.019888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-55dd51a8-3a2f-493d-88d2-622240d098a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:39.020495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-55dd51a8-3a2f-493d-88d2-622240d098a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:39.026946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55dd51a8-3a2f-493d-88d2-622240d098a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:39.027393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55dd51a8-3a2f-493d-88d2-622240d098a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:39.028147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55dd51a8-3a2f-493d-88d2-622240d098a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:39.028580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-55dd51a8-3a2f-493d-88d2-622240d098a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:39.159868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-55dd51a8-3a2f-493d-88d2-622240d098a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:39.168114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-55dd51a8-3a2f-493d-88d2-622240d098a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152203 Mar 08 04:37:39.168669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 999/1942] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:40.184365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9e8062fb-dc38-48cf-a1fd-e5c625309ff3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:40.184964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9e8062fb-dc38-48cf-a1fd-e5c625309ff3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:40.191305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e8062fb-dc38-48cf-a1fd-e5c625309ff3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:40.191744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e8062fb-dc38-48cf-a1fd-e5c625309ff3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:40.192498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e8062fb-dc38-48cf-a1fd-e5c625309ff3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:40.192960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e8062fb-dc38-48cf-a1fd-e5c625309ff3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:40.321991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9e8062fb-dc38-48cf-a1fd-e5c625309ff3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:40.329839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9e8062fb-dc38-48cf-a1fd-e5c625309ff3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149286 Mar 08 04:37:40.330393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 944/1943] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:37:41.347396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-33ee9257-e02c-4615-a8bc-0568dcb142be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:41.347998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-33ee9257-e02c-4615-a8bc-0568dcb142be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:41.354742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33ee9257-e02c-4615-a8bc-0568dcb142be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:41.355187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33ee9257-e02c-4615-a8bc-0568dcb142be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:41.355940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33ee9257-e02c-4615-a8bc-0568dcb142be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:41.356372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33ee9257-e02c-4615-a8bc-0568dcb142be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:41.487713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-33ee9257-e02c-4615-a8bc-0568dcb142be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:41.495459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-33ee9257-e02c-4615-a8bc-0568dcb142be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151871 Mar 08 04:37:41.496019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1000/1944] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:42.511960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-520409bf-b1f8-47f5-abf1-28bc127b044c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:42.512682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-520409bf-b1f8-47f5-abf1-28bc127b044c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:42.518916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-520409bf-b1f8-47f5-abf1-28bc127b044c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:42.519364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-520409bf-b1f8-47f5-abf1-28bc127b044c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:42.520128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-520409bf-b1f8-47f5-abf1-28bc127b044c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:42.520565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-520409bf-b1f8-47f5-abf1-28bc127b044c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:42.649010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-520409bf-b1f8-47f5-abf1-28bc127b044c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:42.656953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-520409bf-b1f8-47f5-abf1-28bc127b044c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148883 Mar 08 04:37:42.657501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 945/1945] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:43.674536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-eb8c7789-b248-4ea7-b793-484c57434286 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:43.675146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-eb8c7789-b248-4ea7-b793-484c57434286 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:43.682075 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb8c7789-b248-4ea7-b793-484c57434286 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:43.682528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb8c7789-b248-4ea7-b793-484c57434286 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:43.683295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb8c7789-b248-4ea7-b793-484c57434286 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:43.683733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eb8c7789-b248-4ea7-b793-484c57434286 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:43.814785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-eb8c7789-b248-4ea7-b793-484c57434286 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:43.823584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-eb8c7789-b248-4ea7-b793-484c57434286 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152841 Mar 08 04:37:43.824150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1001/1946] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:44.841160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-91603a94-f505-40b3-ae7e-febc12d49e80 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:44.841794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-91603a94-f505-40b3-ae7e-febc12d49e80 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:44.849003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91603a94-f505-40b3-ae7e-febc12d49e80 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:44.849449 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91603a94-f505-40b3-ae7e-febc12d49e80 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:44.850253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91603a94-f505-40b3-ae7e-febc12d49e80 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:44.850751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91603a94-f505-40b3-ae7e-febc12d49e80 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:44.989502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-91603a94-f505-40b3-ae7e-febc12d49e80 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:44.997231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-91603a94-f505-40b3-ae7e-febc12d49e80 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.160005 Mar 08 04:37:44.997822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 946/1947] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:37:46.015311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8fbbf316-5920-494f-9229-d9c4e5035426 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:46.015920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8fbbf316-5920-494f-9229-d9c4e5035426 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:46.022266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8fbbf316-5920-494f-9229-d9c4e5035426 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:46.023272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8fbbf316-5920-494f-9229-d9c4e5035426 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:46.024271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8fbbf316-5920-494f-9229-d9c4e5035426 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:46.024715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8fbbf316-5920-494f-9229-d9c4e5035426 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:46.154511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8fbbf316-5920-494f-9229-d9c4e5035426 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:46.162172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8fbbf316-5920-494f-9229-d9c4e5035426 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150864 Mar 08 04:37:46.162741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1002/1948] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:37:47.180597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3b718b22-3961-4376-8642-3fa9a51dec78 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:47.181204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3b718b22-3961-4376-8642-3fa9a51dec78 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:47.187457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b718b22-3961-4376-8642-3fa9a51dec78 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:47.187904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b718b22-3961-4376-8642-3fa9a51dec78 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:47.188664 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b718b22-3961-4376-8642-3fa9a51dec78 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:47.189098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3b718b22-3961-4376-8642-3fa9a51dec78 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:47.319667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3b718b22-3961-4376-8642-3fa9a51dec78 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:47.327336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3b718b22-3961-4376-8642-3fa9a51dec78 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151179 Mar 08 04:37:47.327892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 947/1949] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:48.344402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8ec640b4-c57f-4312-b19e-6812d58c24d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:48.345010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8ec640b4-c57f-4312-b19e-6812d58c24d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:48.351018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ec640b4-c57f-4312-b19e-6812d58c24d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:48.351456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ec640b4-c57f-4312-b19e-6812d58c24d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:48.352208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ec640b4-c57f-4312-b19e-6812d58c24d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:48.352635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ec640b4-c57f-4312-b19e-6812d58c24d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:48.485525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8ec640b4-c57f-4312-b19e-6812d58c24d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:48.494142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8ec640b4-c57f-4312-b19e-6812d58c24d8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153553 Mar 08 04:37:48.494705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1003/1950] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:49.511157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cc0e46a4-f6d3-4ade-9a35-44c1dc3b3ae8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:49.511689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cc0e46a4-f6d3-4ade-9a35-44c1dc3b3ae8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:49.518102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc0e46a4-f6d3-4ade-9a35-44c1dc3b3ae8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:49.518554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc0e46a4-f6d3-4ade-9a35-44c1dc3b3ae8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:49.519318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc0e46a4-f6d3-4ade-9a35-44c1dc3b3ae8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:49.519754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc0e46a4-f6d3-4ade-9a35-44c1dc3b3ae8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:49.652490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cc0e46a4-f6d3-4ade-9a35-44c1dc3b3ae8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:49.660137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cc0e46a4-f6d3-4ade-9a35-44c1dc3b3ae8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152851 Mar 08 04:37:49.660690 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 948/1951] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:50.677770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2556ae82-b4be-43dc-a128-835e81af6fbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:50.678420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2556ae82-b4be-43dc-a128-835e81af6fbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:50.685432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2556ae82-b4be-43dc-a128-835e81af6fbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:50.685914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2556ae82-b4be-43dc-a128-835e81af6fbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:50.686686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2556ae82-b4be-43dc-a128-835e81af6fbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:50.687127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2556ae82-b4be-43dc-a128-835e81af6fbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:50.818790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2556ae82-b4be-43dc-a128-835e81af6fbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:50.827285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2556ae82-b4be-43dc-a128-835e81af6fbf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153466 Mar 08 04:37:50.827838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1004/1952] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:50 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:51.844018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-06b8023f-3eb7-4a21-b2a3-8b15489ad320 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:51.844742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-06b8023f-3eb7-4a21-b2a3-8b15489ad320 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:51.852463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-06b8023f-3eb7-4a21-b2a3-8b15489ad320 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:51.852463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-06b8023f-3eb7-4a21-b2a3-8b15489ad320 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:51.853337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-06b8023f-3eb7-4a21-b2a3-8b15489ad320 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:51.853804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-06b8023f-3eb7-4a21-b2a3-8b15489ad320 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:51.984275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-06b8023f-3eb7-4a21-b2a3-8b15489ad320 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:51.992560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-06b8023f-3eb7-4a21-b2a3-8b15489ad320 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152497 Mar 08 04:37:51.993116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 949/1953] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:37:53.010276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-016b28b9-339c-4849-97f3-37f02d4819f8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:53.010883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-016b28b9-339c-4849-97f3-37f02d4819f8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:53.017129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-016b28b9-339c-4849-97f3-37f02d4819f8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:53.017596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-016b28b9-339c-4849-97f3-37f02d4819f8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:53.018383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-016b28b9-339c-4849-97f3-37f02d4819f8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:53.018817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-016b28b9-339c-4849-97f3-37f02d4819f8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:53.159260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-016b28b9-339c-4849-97f3-37f02d4819f8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:53.167485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-016b28b9-339c-4849-97f3-37f02d4819f8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.161673 Mar 08 04:37:53.168053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1005/1954] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:54.185306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ed117917-b62b-4277-b4ec-8bf4f006bd04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:54.185972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ed117917-b62b-4277-b4ec-8bf4f006bd04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:54.192197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed117917-b62b-4277-b4ec-8bf4f006bd04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:54.192650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed117917-b62b-4277-b4ec-8bf4f006bd04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:54.193442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed117917-b62b-4277-b4ec-8bf4f006bd04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:54.193915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed117917-b62b-4277-b4ec-8bf4f006bd04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:54.327943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ed117917-b62b-4277-b4ec-8bf4f006bd04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:54.336146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ed117917-b62b-4277-b4ec-8bf4f006bd04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154543 Mar 08 04:37:54.336699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 950/1955] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:37:55.353056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ad8b595d-8501-4cfd-890e-4e85b87e5839 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:55.353686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ad8b595d-8501-4cfd-890e-4e85b87e5839 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:55.360208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad8b595d-8501-4cfd-890e-4e85b87e5839 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:55.360663 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad8b595d-8501-4cfd-890e-4e85b87e5839 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:55.361442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad8b595d-8501-4cfd-890e-4e85b87e5839 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:55.361915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad8b595d-8501-4cfd-890e-4e85b87e5839 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:55.492396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ad8b595d-8501-4cfd-890e-4e85b87e5839 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:55.500056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ad8b595d-8501-4cfd-890e-4e85b87e5839 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150959 Mar 08 04:37:55.500622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1006/1956] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:56.518131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c12a1b52-d7bc-456a-9130-7866ca0b43ff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:56.518738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c12a1b52-d7bc-456a-9130-7866ca0b43ff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:56.525643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c12a1b52-d7bc-456a-9130-7866ca0b43ff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:56.526361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c12a1b52-d7bc-456a-9130-7866ca0b43ff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:56.527114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c12a1b52-d7bc-456a-9130-7866ca0b43ff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:56.527544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c12a1b52-d7bc-456a-9130-7866ca0b43ff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:56.656879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c12a1b52-d7bc-456a-9130-7866ca0b43ff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:56.665293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c12a1b52-d7bc-456a-9130-7866ca0b43ff tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150979 Mar 08 04:37:56.665886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 951/1957] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:57.682977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-096ae7c7-d36b-4786-97c1-3516083d37b1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:57.683596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-096ae7c7-d36b-4786-97c1-3516083d37b1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:57.689929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-096ae7c7-d36b-4786-97c1-3516083d37b1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:57.690384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-096ae7c7-d36b-4786-97c1-3516083d37b1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:57.691153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-096ae7c7-d36b-4786-97c1-3516083d37b1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:57.691593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-096ae7c7-d36b-4786-97c1-3516083d37b1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:57.824843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-096ae7c7-d36b-4786-97c1-3516083d37b1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:57.832683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-096ae7c7-d36b-4786-97c1-3516083d37b1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154202 Mar 08 04:37:57.833246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1007/1958] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:37:58.848784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-20c152b1-b3fa-4d5e-b077-687f8c3dcf11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:37:58.849397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-20c152b1-b3fa-4d5e-b077-687f8c3dcf11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:37:58.855808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20c152b1-b3fa-4d5e-b077-687f8c3dcf11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:58.856263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20c152b1-b3fa-4d5e-b077-687f8c3dcf11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:58.857030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20c152b1-b3fa-4d5e-b077-687f8c3dcf11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:37:58.857469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20c152b1-b3fa-4d5e-b077-687f8c3dcf11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:37:58.986685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-20c152b1-b3fa-4d5e-b077-687f8c3dcf11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:37:58.994390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-20c152b1-b3fa-4d5e-b077-687f8c3dcf11 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149466 Mar 08 04:37:58.994944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 952/1959] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:37:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:00.011128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-301d4ad8-2c2b-4545-add6-746d40198687 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:00.011739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-301d4ad8-2c2b-4545-add6-746d40198687 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:00.018070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-301d4ad8-2c2b-4545-add6-746d40198687 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:00.018520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-301d4ad8-2c2b-4545-add6-746d40198687 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:00.019288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-301d4ad8-2c2b-4545-add6-746d40198687 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:00.019725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-301d4ad8-2c2b-4545-add6-746d40198687 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:00.150429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-301d4ad8-2c2b-4545-add6-746d40198687 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:00.158286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-301d4ad8-2c2b-4545-add6-746d40198687 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151516 Mar 08 04:38:00.158849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1008/1960] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:01.175358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2b943f3e-2af6-4774-a065-b4406949a396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:01.176000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2b943f3e-2af6-4774-a065-b4406949a396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:01.182447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2b943f3e-2af6-4774-a065-b4406949a396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:01.182896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2b943f3e-2af6-4774-a065-b4406949a396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:01.183660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2b943f3e-2af6-4774-a065-b4406949a396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:01.184094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2b943f3e-2af6-4774-a065-b4406949a396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:01.318495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2b943f3e-2af6-4774-a065-b4406949a396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:01.326197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2b943f3e-2af6-4774-a065-b4406949a396 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154681 Mar 08 04:38:01.326755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 953/1961] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:01 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:02.342845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0927c54a-ff66-4275-85bc-fcc1b37a9b88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:02.343457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0927c54a-ff66-4275-85bc-fcc1b37a9b88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:02.349758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0927c54a-ff66-4275-85bc-fcc1b37a9b88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:02.350207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0927c54a-ff66-4275-85bc-fcc1b37a9b88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:02.351138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0927c54a-ff66-4275-85bc-fcc1b37a9b88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:02.351575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0927c54a-ff66-4275-85bc-fcc1b37a9b88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:02.482628 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0927c54a-ff66-4275-85bc-fcc1b37a9b88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:02.490391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0927c54a-ff66-4275-85bc-fcc1b37a9b88 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151417 Mar 08 04:38:02.491473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1009/1962] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:03.508693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7fa2b3cd-c36c-4d2c-87e8-a04442b64905 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:03.509211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7fa2b3cd-c36c-4d2c-87e8-a04442b64905 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:03.515621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fa2b3cd-c36c-4d2c-87e8-a04442b64905 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:03.516064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fa2b3cd-c36c-4d2c-87e8-a04442b64905 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:03.516819 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fa2b3cd-c36c-4d2c-87e8-a04442b64905 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:03.517250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fa2b3cd-c36c-4d2c-87e8-a04442b64905 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:03.654626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7fa2b3cd-c36c-4d2c-87e8-a04442b64905 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:03.662738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7fa2b3cd-c36c-4d2c-87e8-a04442b64905 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.158401 Mar 08 04:38:03.663543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 954/1963] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:04.680276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c1790f7f-dd13-431c-b2d5-a11b461ab72c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:04.681327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c1790f7f-dd13-431c-b2d5-a11b461ab72c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:04.687728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c1790f7f-dd13-431c-b2d5-a11b461ab72c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:04.688176 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c1790f7f-dd13-431c-b2d5-a11b461ab72c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:04.688942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c1790f7f-dd13-431c-b2d5-a11b461ab72c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:04.689365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c1790f7f-dd13-431c-b2d5-a11b461ab72c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:04.820493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c1790f7f-dd13-431c-b2d5-a11b461ab72c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:04.828335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c1790f7f-dd13-431c-b2d5-a11b461ab72c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152056 Mar 08 04:38:04.828892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1010/1964] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:05.845886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0f3dc691-999a-4520-a5ee-4d13a2615156 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:05.846498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0f3dc691-999a-4520-a5ee-4d13a2615156 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:05.852603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f3dc691-999a-4520-a5ee-4d13a2615156 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:05.853052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f3dc691-999a-4520-a5ee-4d13a2615156 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:05.853934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f3dc691-999a-4520-a5ee-4d13a2615156 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:05.854800 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f3dc691-999a-4520-a5ee-4d13a2615156 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:05.983216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0f3dc691-999a-4520-a5ee-4d13a2615156 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:05.991070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0f3dc691-999a-4520-a5ee-4d13a2615156 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149216 Mar 08 04:38:05.991637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 955/1965] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:07.009160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-50596d9e-5ff6-47b8-a321-05980ecf5d95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:07.009718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-50596d9e-5ff6-47b8-a321-05980ecf5d95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:07.015963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50596d9e-5ff6-47b8-a321-05980ecf5d95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:07.016405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50596d9e-5ff6-47b8-a321-05980ecf5d95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:07.017164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50596d9e-5ff6-47b8-a321-05980ecf5d95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:07.017596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50596d9e-5ff6-47b8-a321-05980ecf5d95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:07.149574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-50596d9e-5ff6-47b8-a321-05980ecf5d95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:07.157533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-50596d9e-5ff6-47b8-a321-05980ecf5d95 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153214 Mar 08 04:38:07.158232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1011/1966] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:07 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:08.175371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6de43bb2-9418-4827-991a-e9e3dc54822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:08.175983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6de43bb2-9418-4827-991a-e9e3dc54822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:08.182350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6de43bb2-9418-4827-991a-e9e3dc54822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:08.182794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6de43bb2-9418-4827-991a-e9e3dc54822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:08.183552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6de43bb2-9418-4827-991a-e9e3dc54822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:08.183987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6de43bb2-9418-4827-991a-e9e3dc54822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:08.312950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6de43bb2-9418-4827-991a-e9e3dc54822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:08.321361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6de43bb2-9418-4827-991a-e9e3dc54822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149840 Mar 08 04:38:08.321956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 956/1967] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:09.337765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-eac6c680-ae77-4c86-bb8e-cf126d51e8e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:09.338375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-eac6c680-ae77-4c86-bb8e-cf126d51e8e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:09.344635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eac6c680-ae77-4c86-bb8e-cf126d51e8e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:09.345082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eac6c680-ae77-4c86-bb8e-cf126d51e8e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:09.345889 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eac6c680-ae77-4c86-bb8e-cf126d51e8e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:09.346353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-eac6c680-ae77-4c86-bb8e-cf126d51e8e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:09.485360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-eac6c680-ae77-4c86-bb8e-cf126d51e8e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:09.496051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-eac6c680-ae77-4c86-bb8e-cf126d51e8e4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.162198 Mar 08 04:38:09.496659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1012/1968] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:10.512178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-83f156ae-81c8-4afd-9165-d244dfe57d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:10.512816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-83f156ae-81c8-4afd-9165-d244dfe57d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:10.519003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83f156ae-81c8-4afd-9165-d244dfe57d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:10.519441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83f156ae-81c8-4afd-9165-d244dfe57d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:10.520188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83f156ae-81c8-4afd-9165-d244dfe57d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:10.520612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-83f156ae-81c8-4afd-9165-d244dfe57d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:10.649027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-83f156ae-81c8-4afd-9165-d244dfe57d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:10.656904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-83f156ae-81c8-4afd-9165-d244dfe57d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148525 Mar 08 04:38:10.657461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 957/1969] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:11.674705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fef177be-33b7-4065-b2fa-6268cc6d8c2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:11.675310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fef177be-33b7-4065-b2fa-6268cc6d8c2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:11.682129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fef177be-33b7-4065-b2fa-6268cc6d8c2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:11.682568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fef177be-33b7-4065-b2fa-6268cc6d8c2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:11.683325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fef177be-33b7-4065-b2fa-6268cc6d8c2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:11.683755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fef177be-33b7-4065-b2fa-6268cc6d8c2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:11.815196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fef177be-33b7-4065-b2fa-6268cc6d8c2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:11.823643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fef177be-33b7-4065-b2fa-6268cc6d8c2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152853 Mar 08 04:38:11.824200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1013/1970] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:12.840365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f0879012-4b8c-4096-8e31-e48ecafa9846 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:12.840974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f0879012-4b8c-4096-8e31-e48ecafa9846 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:12.847117 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0879012-4b8c-4096-8e31-e48ecafa9846 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:12.847561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0879012-4b8c-4096-8e31-e48ecafa9846 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:12.848347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0879012-4b8c-4096-8e31-e48ecafa9846 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:12.848777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f0879012-4b8c-4096-8e31-e48ecafa9846 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:13.205100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f0879012-4b8c-4096-8e31-e48ecafa9846 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:13.213502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f0879012-4b8c-4096-8e31-e48ecafa9846 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.376998 Mar 08 04:38:13.214092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 958/1971] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:14.231365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a8543313-f90b-4aa5-a599-fe76515304a1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:14.231999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a8543313-f90b-4aa5-a599-fe76515304a1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:14.238175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8543313-f90b-4aa5-a599-fe76515304a1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:14.238623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8543313-f90b-4aa5-a599-fe76515304a1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:14.239380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8543313-f90b-4aa5-a599-fe76515304a1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:14.239813 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8543313-f90b-4aa5-a599-fe76515304a1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:14.369299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a8543313-f90b-4aa5-a599-fe76515304a1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:14.377004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a8543313-f90b-4aa5-a599-fe76515304a1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149465 Mar 08 04:38:14.377567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1014/1972] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:15.395069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b56280b6-dbcf-4e13-90a5-88d4047900d9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:15.395672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b56280b6-dbcf-4e13-90a5-88d4047900d9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:15.402799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b56280b6-dbcf-4e13-90a5-88d4047900d9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:15.403285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b56280b6-dbcf-4e13-90a5-88d4047900d9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:15.404027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b56280b6-dbcf-4e13-90a5-88d4047900d9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:15.404452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b56280b6-dbcf-4e13-90a5-88d4047900d9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:15.535443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b56280b6-dbcf-4e13-90a5-88d4047900d9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:15.543251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b56280b6-dbcf-4e13-90a5-88d4047900d9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152036 Mar 08 04:38:15.543811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 959/1973] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:16.560082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-37d39b9f-6f22-4bc8-82e3-a29c5762fcf3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:16.560727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-37d39b9f-6f22-4bc8-82e3-a29c5762fcf3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:16.566919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37d39b9f-6f22-4bc8-82e3-a29c5762fcf3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:16.567371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37d39b9f-6f22-4bc8-82e3-a29c5762fcf3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:16.568135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37d39b9f-6f22-4bc8-82e3-a29c5762fcf3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:16.569085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-37d39b9f-6f22-4bc8-82e3-a29c5762fcf3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:16.700640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-37d39b9f-6f22-4bc8-82e3-a29c5762fcf3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:16.708389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-37d39b9f-6f22-4bc8-82e3-a29c5762fcf3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152162 Mar 08 04:38:16.709514 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1015/1974] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:17.726584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-084d933f-467f-43e1-aeaf-04335b18c56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:17.727220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-084d933f-467f-43e1-aeaf-04335b18c56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:17.733397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-084d933f-467f-43e1-aeaf-04335b18c56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:17.733890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-084d933f-467f-43e1-aeaf-04335b18c56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:17.734652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-084d933f-467f-43e1-aeaf-04335b18c56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:17.735086 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-084d933f-467f-43e1-aeaf-04335b18c56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:17.873820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-084d933f-467f-43e1-aeaf-04335b18c56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:17.881608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-084d933f-467f-43e1-aeaf-04335b18c56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.159452 Mar 08 04:38:17.882194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 960/1975] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:18.899235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6bbb391d-22f1-4c9b-8be3-92012feca871 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:18.899847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6bbb391d-22f1-4c9b-8be3-92012feca871 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:18.906042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bbb391d-22f1-4c9b-8be3-92012feca871 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:18.906487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bbb391d-22f1-4c9b-8be3-92012feca871 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:18.907251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bbb391d-22f1-4c9b-8be3-92012feca871 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:18.907688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6bbb391d-22f1-4c9b-8be3-92012feca871 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:19.036648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6bbb391d-22f1-4c9b-8be3-92012feca871 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:19.044465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6bbb391d-22f1-4c9b-8be3-92012feca871 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149668 Mar 08 04:38:19.045029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1016/1976] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:20.062960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3f162bf0-d5b9-4a03-9699-339552e3e268 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:20.063583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3f162bf0-d5b9-4a03-9699-339552e3e268 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:20.070485 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f162bf0-d5b9-4a03-9699-339552e3e268 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:20.070936 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f162bf0-d5b9-4a03-9699-339552e3e268 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:20.071707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f162bf0-d5b9-4a03-9699-339552e3e268 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:20.072144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f162bf0-d5b9-4a03-9699-339552e3e268 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:20.204235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3f162bf0-d5b9-4a03-9699-339552e3e268 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:20.212490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3f162bf0-d5b9-4a03-9699-339552e3e268 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153400 Mar 08 04:38:20.213066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 961/1977] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:21.229870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-60edbb9a-a866-499b-b3db-eee620e38819 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:21.230477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-60edbb9a-a866-499b-b3db-eee620e38819 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:21.236647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60edbb9a-a866-499b-b3db-eee620e38819 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:21.237088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60edbb9a-a866-499b-b3db-eee620e38819 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:21.237874 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60edbb9a-a866-499b-b3db-eee620e38819 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:21.238307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-60edbb9a-a866-499b-b3db-eee620e38819 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:21.368321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-60edbb9a-a866-499b-b3db-eee620e38819 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:21.375924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-60edbb9a-a866-499b-b3db-eee620e38819 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149985 Mar 08 04:38:21.376489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1017/1978] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:22.393976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e5ce00ab-667c-4304-b9e0-3bf33976b690 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:22.394581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e5ce00ab-667c-4304-b9e0-3bf33976b690 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:22.401336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5ce00ab-667c-4304-b9e0-3bf33976b690 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:22.401815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5ce00ab-667c-4304-b9e0-3bf33976b690 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:22.402586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5ce00ab-667c-4304-b9e0-3bf33976b690 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:22.403023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5ce00ab-667c-4304-b9e0-3bf33976b690 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:22.533602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e5ce00ab-667c-4304-b9e0-3bf33976b690 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:22.541851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e5ce00ab-667c-4304-b9e0-3bf33976b690 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151599 Mar 08 04:38:22.546421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 962/1979] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:23.558602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9c828a02-a8fe-4eaa-bc1a-ac574ea33806 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:23.559149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9c828a02-a8fe-4eaa-bc1a-ac574ea33806 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:23.565866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9c828a02-a8fe-4eaa-bc1a-ac574ea33806 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:23.565866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9c828a02-a8fe-4eaa-bc1a-ac574ea33806 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:23.566561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9c828a02-a8fe-4eaa-bc1a-ac574ea33806 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:23.567001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9c828a02-a8fe-4eaa-bc1a-ac574ea33806 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:23.701343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9c828a02-a8fe-4eaa-bc1a-ac574ea33806 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:23.709523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9c828a02-a8fe-4eaa-bc1a-ac574ea33806 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154307 Mar 08 04:38:23.710109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1018/1980] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:24.726998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ccab18f8-29ee-498c-925f-539dceac28b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:24.727609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ccab18f8-29ee-498c-925f-539dceac28b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:24.734064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccab18f8-29ee-498c-925f-539dceac28b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:24.734534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccab18f8-29ee-498c-925f-539dceac28b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:24.735348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccab18f8-29ee-498c-925f-539dceac28b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:24.735940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ccab18f8-29ee-498c-925f-539dceac28b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:24.870505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ccab18f8-29ee-498c-925f-539dceac28b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:24.878020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ccab18f8-29ee-498c-925f-539dceac28b9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.155509 Mar 08 04:38:24.878578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 963/1981] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:25.895757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9a5988dd-23f9-47ce-b6d3-c98be5881381 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:25.896865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9a5988dd-23f9-47ce-b6d3-c98be5881381 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:25.903581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a5988dd-23f9-47ce-b6d3-c98be5881381 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:25.904037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a5988dd-23f9-47ce-b6d3-c98be5881381 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:25.904814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a5988dd-23f9-47ce-b6d3-c98be5881381 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:25.905255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a5988dd-23f9-47ce-b6d3-c98be5881381 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:26.041199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9a5988dd-23f9-47ce-b6d3-c98be5881381 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:26.048872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9a5988dd-23f9-47ce-b6d3-c98be5881381 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.156986 Mar 08 04:38:26.049437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1019/1982] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:27.066307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-97125fd4-a2c5-4407-83cc-affc612ea308 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:27.066845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-97125fd4-a2c5-4407-83cc-affc612ea308 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:27.073482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97125fd4-a2c5-4407-83cc-affc612ea308 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:27.073955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97125fd4-a2c5-4407-83cc-affc612ea308 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:27.074708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97125fd4-a2c5-4407-83cc-affc612ea308 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:27.075133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97125fd4-a2c5-4407-83cc-affc612ea308 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:27.206791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-97125fd4-a2c5-4407-83cc-affc612ea308 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:27.214491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-97125fd4-a2c5-4407-83cc-affc612ea308 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152089 Mar 08 04:38:27.215052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 964/1983] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:28.231750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-390f9f1f-0135-4975-b79c-460697ad00cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:28.232351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-390f9f1f-0135-4975-b79c-460697ad00cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:28.238678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-390f9f1f-0135-4975-b79c-460697ad00cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:28.239124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-390f9f1f-0135-4975-b79c-460697ad00cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:28.240053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-390f9f1f-0135-4975-b79c-460697ad00cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:28.240499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-390f9f1f-0135-4975-b79c-460697ad00cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:28.368697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-390f9f1f-0135-4975-b79c-460697ad00cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:28.376419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-390f9f1f-0135-4975-b79c-460697ad00cc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148486 Mar 08 04:38:28.376983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1020/1984] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:29.394249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8c45415c-dbd5-44df-8fc1-c8db6e6c0d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:29.394886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8c45415c-dbd5-44df-8fc1-c8db6e6c0d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:29.402099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c45415c-dbd5-44df-8fc1-c8db6e6c0d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:29.402545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c45415c-dbd5-44df-8fc1-c8db6e6c0d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:29.403306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c45415c-dbd5-44df-8fc1-c8db6e6c0d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:29.403739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c45415c-dbd5-44df-8fc1-c8db6e6c0d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:29.534474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8c45415c-dbd5-44df-8fc1-c8db6e6c0d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:29.542672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8c45415c-dbd5-44df-8fc1-c8db6e6c0d16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152269 Mar 08 04:38:29.543237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 965/1985] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:30.559713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-414d74a9-9192-4df9-9503-3303c797b763 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:30.560325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-414d74a9-9192-4df9-9503-3303c797b763 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:30.566554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-414d74a9-9192-4df9-9503-3303c797b763 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:30.567001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-414d74a9-9192-4df9-9503-3303c797b763 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:30.568338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-414d74a9-9192-4df9-9503-3303c797b763 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:30.568749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-414d74a9-9192-4df9-9503-3303c797b763 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:30.698225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-414d74a9-9192-4df9-9503-3303c797b763 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:30.705915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-414d74a9-9192-4df9-9503-3303c797b763 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150072 Mar 08 04:38:30.706473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1021/1986] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:31.723476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fb0208de-a4f8-4b1d-bca7-09b9f6c5c6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:31.724689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fb0208de-a4f8-4b1d-bca7-09b9f6c5c6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:31.730968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb0208de-a4f8-4b1d-bca7-09b9f6c5c6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:31.731411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb0208de-a4f8-4b1d-bca7-09b9f6c5c6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:31.732163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb0208de-a4f8-4b1d-bca7-09b9f6c5c6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:31.732592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb0208de-a4f8-4b1d-bca7-09b9f6c5c6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:31.865147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fb0208de-a4f8-4b1d-bca7-09b9f6c5c6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:31.872779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fb0208de-a4f8-4b1d-bca7-09b9f6c5c6ed tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153141 Mar 08 04:38:31.873330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 966/1987] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:32.890324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fdd0bfec-0ee7-4bd7-943e-ef2f837aa234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:32.890963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fdd0bfec-0ee7-4bd7-943e-ef2f837aa234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:32.898019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdd0bfec-0ee7-4bd7-943e-ef2f837aa234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:32.898463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdd0bfec-0ee7-4bd7-943e-ef2f837aa234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:32.899227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdd0bfec-0ee7-4bd7-943e-ef2f837aa234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:32.899659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdd0bfec-0ee7-4bd7-943e-ef2f837aa234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:33.031308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fdd0bfec-0ee7-4bd7-943e-ef2f837aa234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:33.039219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fdd0bfec-0ee7-4bd7-943e-ef2f837aa234 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152777 Mar 08 04:38:33.039794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1022/1988] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:34.057216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3c9e446f-e7f2-4775-bc90-7f2dbd7d36da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:34.057850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3c9e446f-e7f2-4775-bc90-7f2dbd7d36da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:34.064036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c9e446f-e7f2-4775-bc90-7f2dbd7d36da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:34.064473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c9e446f-e7f2-4775-bc90-7f2dbd7d36da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:34.065223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c9e446f-e7f2-4775-bc90-7f2dbd7d36da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:34.065652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3c9e446f-e7f2-4775-bc90-7f2dbd7d36da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:34.202747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3c9e446f-e7f2-4775-bc90-7f2dbd7d36da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:34.210889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3c9e446f-e7f2-4775-bc90-7f2dbd7d36da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.157647 Mar 08 04:38:34.211550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 967/1989] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:35.227832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0871ba9c-4b9a-429b-8b6b-efecfd66d546 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:35.228534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0871ba9c-4b9a-429b-8b6b-efecfd66d546 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:35.234629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0871ba9c-4b9a-429b-8b6b-efecfd66d546 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:35.235075 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0871ba9c-4b9a-429b-8b6b-efecfd66d546 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:35.235839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0871ba9c-4b9a-429b-8b6b-efecfd66d546 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:35.236271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0871ba9c-4b9a-429b-8b6b-efecfd66d546 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:35.367092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0871ba9c-4b9a-429b-8b6b-efecfd66d546 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:35.374750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0871ba9c-4b9a-429b-8b6b-efecfd66d546 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151081 Mar 08 04:38:35.375307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1023/1990] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:35 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:36.392285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d74de5ac-9099-4447-b096-4bf8d0a934a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:36.392885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d74de5ac-9099-4447-b096-4bf8d0a934a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:36.399327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d74de5ac-9099-4447-b096-4bf8d0a934a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:36.399770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d74de5ac-9099-4447-b096-4bf8d0a934a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:36.400520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d74de5ac-9099-4447-b096-4bf8d0a934a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:36.401202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d74de5ac-9099-4447-b096-4bf8d0a934a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:36.529094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d74de5ac-9099-4447-b096-4bf8d0a934a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:36.537385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d74de5ac-9099-4447-b096-4bf8d0a934a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148803 Mar 08 04:38:36.537981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 968/1991] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:37.554432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9e337eaa-8c49-42b6-93e2-2f33e9d90d66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:37.554978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9e337eaa-8c49-42b6-93e2-2f33e9d90d66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:37.561240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9e337eaa-8c49-42b6-93e2-2f33e9d90d66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:37.561719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9e337eaa-8c49-42b6-93e2-2f33e9d90d66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:37.562496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9e337eaa-8c49-42b6-93e2-2f33e9d90d66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:37.562937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9e337eaa-8c49-42b6-93e2-2f33e9d90d66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:37.694995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9e337eaa-8c49-42b6-93e2-2f33e9d90d66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:37.702706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9e337eaa-8c49-42b6-93e2-2f33e9d90d66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152268 Mar 08 04:38:37.703278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1024/1992] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:38.720384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b378fe78-9a45-4a68-820a-fad83730bb20 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:38.720984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b378fe78-9a45-4a68-820a-fad83730bb20 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:38.727788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b378fe78-9a45-4a68-820a-fad83730bb20 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:38.728231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b378fe78-9a45-4a68-820a-fad83730bb20 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:38.728986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b378fe78-9a45-4a68-820a-fad83730bb20 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:38.729414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b378fe78-9a45-4a68-820a-fad83730bb20 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:38.859392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b378fe78-9a45-4a68-820a-fad83730bb20 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:38.867183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b378fe78-9a45-4a68-820a-fad83730bb20 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150688 Mar 08 04:38:38.867736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 969/1993] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:38:39.884134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ce32ba0d-8100-44f8-83b7-bc8c9e9b05a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:39.884741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ce32ba0d-8100-44f8-83b7-bc8c9e9b05a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:39.891174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce32ba0d-8100-44f8-83b7-bc8c9e9b05a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:39.891618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce32ba0d-8100-44f8-83b7-bc8c9e9b05a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:39.892373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce32ba0d-8100-44f8-83b7-bc8c9e9b05a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:39.892805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce32ba0d-8100-44f8-83b7-bc8c9e9b05a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:40.027593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ce32ba0d-8100-44f8-83b7-bc8c9e9b05a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:40.035179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ce32ba0d-8100-44f8-83b7-bc8c9e9b05a8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154965 Mar 08 04:38:40.035736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1025/1994] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:40.327630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Mar 08 04:38:40.328389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:38:41.052863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a4cb7742-7bc6-45d4-92b6-e353d4106ba3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:41.053473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a4cb7742-7bc6-45d4-92b6-e353d4106ba3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:41.059738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a4cb7742-7bc6-45d4-92b6-e353d4106ba3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:41.060184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a4cb7742-7bc6-45d4-92b6-e353d4106ba3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:41.060947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a4cb7742-7bc6-45d4-92b6-e353d4106ba3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:41.061392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a4cb7742-7bc6-45d4-92b6-e353d4106ba3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:41.198314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a4cb7742-7bc6-45d4-92b6-e353d4106ba3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:41.206057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a4cb7742-7bc6-45d4-92b6-e353d4106ba3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.157199 Mar 08 04:38:41.206617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 970/1995] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:42.223353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a1f3fcf5-b0c9-4c15-89a8-fb831eca665d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:42.224656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a1f3fcf5-b0c9-4c15-89a8-fb831eca665d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:42.231028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1f3fcf5-b0c9-4c15-89a8-fb831eca665d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:42.231475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1f3fcf5-b0c9-4c15-89a8-fb831eca665d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:42.232235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1f3fcf5-b0c9-4c15-89a8-fb831eca665d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:42.232672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1f3fcf5-b0c9-4c15-89a8-fb831eca665d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:42.359678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a1f3fcf5-b0c9-4c15-89a8-fb831eca665d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:42.367472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a1f3fcf5-b0c9-4c15-89a8-fb831eca665d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148019 Mar 08 04:38:42.368035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1026/1996] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:43.384239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9e9c0151-213e-4562-8f82-eb442d679ddc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:43.384851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9e9c0151-213e-4562-8f82-eb442d679ddc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:43.391043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e9c0151-213e-4562-8f82-eb442d679ddc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:43.391486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e9c0151-213e-4562-8f82-eb442d679ddc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:43.392235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e9c0151-213e-4562-8f82-eb442d679ddc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:43.392662 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e9c0151-213e-4562-8f82-eb442d679ddc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:43.526037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9e9c0151-213e-4562-8f82-eb442d679ddc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:43.533861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9e9c0151-213e-4562-8f82-eb442d679ddc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153411 Mar 08 04:38:43.534652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 971/1997] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:44.551118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-db2cfd39-cb3a-48c4-a9f4-43d771204cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:44.551730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-db2cfd39-cb3a-48c4-a9f4-43d771204cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:44.558256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-db2cfd39-cb3a-48c4-a9f4-43d771204cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:44.558709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-db2cfd39-cb3a-48c4-a9f4-43d771204cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:44.559539 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-db2cfd39-cb3a-48c4-a9f4-43d771204cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:44.559975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-db2cfd39-cb3a-48c4-a9f4-43d771204cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:44.693957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-db2cfd39-cb3a-48c4-a9f4-43d771204cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:44.701616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-db2cfd39-cb3a-48c4-a9f4-43d771204cd3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154305 Mar 08 04:38:44.702277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1027/1998] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:45.719234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cbdda543-ad87-4502-9ff7-de7bf068d5d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:45.719857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cbdda543-ad87-4502-9ff7-de7bf068d5d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:45.726444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbdda543-ad87-4502-9ff7-de7bf068d5d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:45.726893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbdda543-ad87-4502-9ff7-de7bf068d5d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:45.727651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbdda543-ad87-4502-9ff7-de7bf068d5d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:45.728085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cbdda543-ad87-4502-9ff7-de7bf068d5d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:45.863212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cbdda543-ad87-4502-9ff7-de7bf068d5d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:45.871657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cbdda543-ad87-4502-9ff7-de7bf068d5d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.156341 Mar 08 04:38:45.872208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 972/1999] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:46.889075 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-91e3926c-d2f4-4a34-8d9e-fd124e3ca92d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:46.889692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-91e3926c-d2f4-4a34-8d9e-fd124e3ca92d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:46.896959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91e3926c-d2f4-4a34-8d9e-fd124e3ca92d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:46.897405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91e3926c-d2f4-4a34-8d9e-fd124e3ca92d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:46.898207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91e3926c-d2f4-4a34-8d9e-fd124e3ca92d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:46.898642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91e3926c-d2f4-4a34-8d9e-fd124e3ca92d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:47.047541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-91e3926c-d2f4-4a34-8d9e-fd124e3ca92d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:47.055392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-91e3926c-d2f4-4a34-8d9e-fd124e3ca92d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.170299 Mar 08 04:38:47.055945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1028/2000] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:48.072227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c552a240-753d-4103-82bc-b526f48e463c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:48.072743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c552a240-753d-4103-82bc-b526f48e463c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:48.079031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c552a240-753d-4103-82bc-b526f48e463c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:48.079469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c552a240-753d-4103-82bc-b526f48e463c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:48.080222 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c552a240-753d-4103-82bc-b526f48e463c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:48.080652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c552a240-753d-4103-82bc-b526f48e463c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:48.211868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c552a240-753d-4103-82bc-b526f48e463c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:48.219454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c552a240-753d-4103-82bc-b526f48e463c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151093 Mar 08 04:38:48.220015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 973/2001] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:49.237897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bd593b7e-3a2c-4045-ab34-f9061bfb5a3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:49.238490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bd593b7e-3a2c-4045-ab34-f9061bfb5a3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:49.244689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd593b7e-3a2c-4045-ab34-f9061bfb5a3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:49.245140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd593b7e-3a2c-4045-ab34-f9061bfb5a3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:49.245993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd593b7e-3a2c-4045-ab34-f9061bfb5a3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:49.246434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd593b7e-3a2c-4045-ab34-f9061bfb5a3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:49.373390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bd593b7e-3a2c-4045-ab34-f9061bfb5a3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:49.381616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bd593b7e-3a2c-4045-ab34-f9061bfb5a3d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.147719 Mar 08 04:38:49.382207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1029/2002] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:50.399383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4ce3db2f-ac9c-4fc1-a45d-9a42f84d8d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:50.399999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4ce3db2f-ac9c-4fc1-a45d-9a42f84d8d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:50.406582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ce3db2f-ac9c-4fc1-a45d-9a42f84d8d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:50.407037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ce3db2f-ac9c-4fc1-a45d-9a42f84d8d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:50.407802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ce3db2f-ac9c-4fc1-a45d-9a42f84d8d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:50.408238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ce3db2f-ac9c-4fc1-a45d-9a42f84d8d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:50.537731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4ce3db2f-ac9c-4fc1-a45d-9a42f84d8d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:50.545575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4ce3db2f-ac9c-4fc1-a45d-9a42f84d8d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150872 Mar 08 04:38:50.546152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 974/2003] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:50 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:51.562625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f92dffd8-1c36-446d-b045-2f138ccad604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:51.563227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f92dffd8-1c36-446d-b045-2f138ccad604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:51.570076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f92dffd8-1c36-446d-b045-2f138ccad604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:51.570522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f92dffd8-1c36-446d-b045-2f138ccad604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:51.571283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f92dffd8-1c36-446d-b045-2f138ccad604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:51.571719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f92dffd8-1c36-446d-b045-2f138ccad604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:51.702376 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f92dffd8-1c36-446d-b045-2f138ccad604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:51.710234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f92dffd8-1c36-446d-b045-2f138ccad604 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151426 Mar 08 04:38:51.710804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1030/2004] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:52.727246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-13a7fbf7-f6e2-4509-baa7-d993548d685d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:52.727853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-13a7fbf7-f6e2-4509-baa7-d993548d685d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:52.734506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13a7fbf7-f6e2-4509-baa7-d993548d685d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:52.736130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13a7fbf7-f6e2-4509-baa7-d993548d685d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:52.736898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13a7fbf7-f6e2-4509-baa7-d993548d685d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:52.737334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13a7fbf7-f6e2-4509-baa7-d993548d685d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:52.867146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-13a7fbf7-f6e2-4509-baa7-d993548d685d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:52.874783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-13a7fbf7-f6e2-4509-baa7-d993548d685d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151442 Mar 08 04:38:52.875330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 975/2005] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:53.892347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-433520b4-5929-4685-9e9d-7917501fb54f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:53.892958 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-433520b4-5929-4685-9e9d-7917501fb54f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:53.899930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-433520b4-5929-4685-9e9d-7917501fb54f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:53.900375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-433520b4-5929-4685-9e9d-7917501fb54f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:53.901397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-433520b4-5929-4685-9e9d-7917501fb54f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:53.901862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-433520b4-5929-4685-9e9d-7917501fb54f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:54.032330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-433520b4-5929-4685-9e9d-7917501fb54f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:54.040273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-433520b4-5929-4685-9e9d-7917501fb54f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151786 Mar 08 04:38:54.040836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1031/2006] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:55.056888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-47f49e96-f959-4c53-b200-933441ad5acd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:55.057418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-47f49e96-f959-4c53-b200-933441ad5acd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:55.063751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47f49e96-f959-4c53-b200-933441ad5acd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:55.064196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47f49e96-f959-4c53-b200-933441ad5acd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:55.064953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47f49e96-f959-4c53-b200-933441ad5acd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:55.065378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-47f49e96-f959-4c53-b200-933441ad5acd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:55.202360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-47f49e96-f959-4c53-b200-933441ad5acd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:55.210221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-47f49e96-f959-4c53-b200-933441ad5acd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.157173 Mar 08 04:38:55.210804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 976/2007] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:38:56.226575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0841f4ba-e25a-4497-b2ac-589288dec8f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:56.227180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0841f4ba-e25a-4497-b2ac-589288dec8f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:56.233317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0841f4ba-e25a-4497-b2ac-589288dec8f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:56.233786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0841f4ba-e25a-4497-b2ac-589288dec8f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:56.234550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0841f4ba-e25a-4497-b2ac-589288dec8f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:56.234983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0841f4ba-e25a-4497-b2ac-589288dec8f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:56.365567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0841f4ba-e25a-4497-b2ac-589288dec8f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:56.373351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0841f4ba-e25a-4497-b2ac-589288dec8f9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150839 Mar 08 04:38:56.373946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1032/2008] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:57.390893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-563948fe-eb85-4dd0-ae6b-83f66a2491ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:57.391497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-563948fe-eb85-4dd0-ae6b-83f66a2491ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:57.398382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-563948fe-eb85-4dd0-ae6b-83f66a2491ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:57.398829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-563948fe-eb85-4dd0-ae6b-83f66a2491ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:57.399575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-563948fe-eb85-4dd0-ae6b-83f66a2491ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:57.400002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-563948fe-eb85-4dd0-ae6b-83f66a2491ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:57.534602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-563948fe-eb85-4dd0-ae6b-83f66a2491ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:57.542185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-563948fe-eb85-4dd0-ae6b-83f66a2491ab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.155037 Mar 08 04:38:57.542726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 977/2009] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:58.559730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c5bd2872-72f1-494f-92f2-c8afd38ff2c2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:58.560269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c5bd2872-72f1-494f-92f2-c8afd38ff2c2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:58.566503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5bd2872-72f1-494f-92f2-c8afd38ff2c2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:58.567052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5bd2872-72f1-494f-92f2-c8afd38ff2c2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:58.567958 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5bd2872-72f1-494f-92f2-c8afd38ff2c2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:58.568395 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c5bd2872-72f1-494f-92f2-c8afd38ff2c2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:58.849341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c5bd2872-72f1-494f-92f2-c8afd38ff2c2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:38:58.857178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c5bd2872-72f1-494f-92f2-c8afd38ff2c2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.301389 Mar 08 04:38:58.857752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1033/2010] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:38:59.873681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-118e160f-0a45-41d7-80cf-3cfa17c619c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:38:59.874288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-118e160f-0a45-41d7-80cf-3cfa17c619c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:38:59.880857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-118e160f-0a45-41d7-80cf-3cfa17c619c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:59.881298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-118e160f-0a45-41d7-80cf-3cfa17c619c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:38:59.882100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-118e160f-0a45-41d7-80cf-3cfa17c619c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:38:59.882531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-118e160f-0a45-41d7-80cf-3cfa17c619c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:00.016779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-118e160f-0a45-41d7-80cf-3cfa17c619c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:00.024961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-118e160f-0a45-41d7-80cf-3cfa17c619c8 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.155190 Mar 08 04:39:00.025793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 978/2011] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:38:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:01.042362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-50a95be3-db86-4c9d-ae01-863980e2c0b6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:01.042969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-50a95be3-db86-4c9d-ae01-863980e2c0b6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:01.049875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50a95be3-db86-4c9d-ae01-863980e2c0b6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:01.050334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50a95be3-db86-4c9d-ae01-863980e2c0b6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:01.051123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50a95be3-db86-4c9d-ae01-863980e2c0b6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:01.051808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50a95be3-db86-4c9d-ae01-863980e2c0b6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:01.182782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-50a95be3-db86-4c9d-ae01-863980e2c0b6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:01.190589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-50a95be3-db86-4c9d-ae01-863980e2c0b6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152044 Mar 08 04:39:01.191158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1034/2012] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:01 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:02.208757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-247935e3-76fd-4ac5-b3a7-669d56504cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:02.209370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-247935e3-76fd-4ac5-b3a7-669d56504cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:02.215729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-247935e3-76fd-4ac5-b3a7-669d56504cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:02.216181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-247935e3-76fd-4ac5-b3a7-669d56504cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:02.216950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-247935e3-76fd-4ac5-b3a7-669d56504cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:02.217387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-247935e3-76fd-4ac5-b3a7-669d56504cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:02.397368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-247935e3-76fd-4ac5-b3a7-669d56504cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:02.405269 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-247935e3-76fd-4ac5-b3a7-669d56504cab tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.200895 Mar 08 04:39:02.405864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 979/2013] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:03.426035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f8cf6bef-b4ad-40d1-ba26-6eb0ad66d56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:03.426642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f8cf6bef-b4ad-40d1-ba26-6eb0ad66d56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:03.432852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8cf6bef-b4ad-40d1-ba26-6eb0ad66d56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:03.433301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8cf6bef-b4ad-40d1-ba26-6eb0ad66d56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:03.434095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8cf6bef-b4ad-40d1-ba26-6eb0ad66d56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:03.434541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8cf6bef-b4ad-40d1-ba26-6eb0ad66d56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:03.566953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f8cf6bef-b4ad-40d1-ba26-6eb0ad66d56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:03.574654 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f8cf6bef-b4ad-40d1-ba26-6eb0ad66d56b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152474 Mar 08 04:39:03.575284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1035/2014] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:04.592013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8ddb8738-f1a0-4487-b338-b906d7b077d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:04.592624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8ddb8738-f1a0-4487-b338-b906d7b077d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:04.598950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ddb8738-f1a0-4487-b338-b906d7b077d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:04.599503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ddb8738-f1a0-4487-b338-b906d7b077d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:04.600161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ddb8738-f1a0-4487-b338-b906d7b077d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:04.600632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ddb8738-f1a0-4487-b338-b906d7b077d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:04.739130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8ddb8738-f1a0-4487-b338-b906d7b077d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:04.746840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8ddb8738-f1a0-4487-b338-b906d7b077d3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.158629 Mar 08 04:39:04.747403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 980/2015] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:05.763900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e246bb55-084a-4e68-b070-b42b94da7b35 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:05.764546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e246bb55-084a-4e68-b070-b42b94da7b35 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:05.771745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e246bb55-084a-4e68-b070-b42b94da7b35 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:05.772197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e246bb55-084a-4e68-b070-b42b94da7b35 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:05.772982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e246bb55-084a-4e68-b070-b42b94da7b35 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:05.773425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e246bb55-084a-4e68-b070-b42b94da7b35 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:05.907131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e246bb55-084a-4e68-b070-b42b94da7b35 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:05.915464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e246bb55-084a-4e68-b070-b42b94da7b35 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.155444 Mar 08 04:39:05.916035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1036/2016] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:06.933267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-216e13c8-bc77-4757-87e8-6bf1225d2478 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:06.933841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-216e13c8-bc77-4757-87e8-6bf1225d2478 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:06.939726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-216e13c8-bc77-4757-87e8-6bf1225d2478 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:06.940174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-216e13c8-bc77-4757-87e8-6bf1225d2478 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:06.940930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-216e13c8-bc77-4757-87e8-6bf1225d2478 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:06.941931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-216e13c8-bc77-4757-87e8-6bf1225d2478 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:07.069215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-216e13c8-bc77-4757-87e8-6bf1225d2478 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:07.076935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-216e13c8-bc77-4757-87e8-6bf1225d2478 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.147761 Mar 08 04:39:07.077498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 981/2017] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:07.814828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:07.815313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:07.824463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:07.824948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:07.825770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:07.826213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:07.850737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Going to try to terminate instance {{(pid=116774) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:39:07.905802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [119bc22d-fb7c-4ddb-9027-961cc9673764] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 04:39:08.093707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e5e751fa-b9a4-4583-823e-4a580c5cd661 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:08.094229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e5e751fa-b9a4-4583-823e-4a580c5cd661 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:08.101085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5e751fa-b9a4-4583-823e-4a580c5cd661 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:08.101529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5e751fa-b9a4-4583-823e-4a580c5cd661 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:08.102333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5e751fa-b9a4-4583-823e-4a580c5cd661 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:08.102765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5e751fa-b9a4-4583-823e-4a580c5cd661 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:08.236780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e5e751fa-b9a4-4583-823e-4a580c5cd661 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:08.244517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e5e751fa-b9a4-4583-823e-4a580c5cd661 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154794 Mar 08 04:39:08.245080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 982/2018] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:08.913638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [119bc22d-fb7c-4ddb-9027-961cc9673764] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 47688. Mar 08 04:39:08.934200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5a077537-15af-4224-b233-4d24975d4785 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 204 len: 0 microversion: 2.1 time: 1.122854 Mar 08 04:39:08.934836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1037/2019] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:39:07 2022] DELETE /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 0 bytes in 1124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:39:08.949627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b6abf704-652d-45b4-9a54-6fe67a6ba7c3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:08.950266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b6abf704-652d-45b4-9a54-6fe67a6ba7c3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:08.957999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6abf704-652d-45b4-9a54-6fe67a6ba7c3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:08.958472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6abf704-652d-45b4-9a54-6fe67a6ba7c3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:08.959275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6abf704-652d-45b4-9a54-6fe67a6ba7c3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:08.959712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6abf704-652d-45b4-9a54-6fe67a6ba7c3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:09.090077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b6abf704-652d-45b4-9a54-6fe67a6ba7c3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:09.097914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b6abf704-652d-45b4-9a54-6fe67a6ba7c3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.157759 Mar 08 04:39:09.098582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 983/2020] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:08 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:09.262316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d77d13f1-2b42-4f5c-93a2-45e833946bc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:09.263018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d77d13f1-2b42-4f5c-93a2-45e833946bc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:09.268901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d77d13f1-2b42-4f5c-93a2-45e833946bc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:09.269351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d77d13f1-2b42-4f5c-93a2-45e833946bc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:09.270197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d77d13f1-2b42-4f5c-93a2-45e833946bc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:09.270633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d77d13f1-2b42-4f5c-93a2-45e833946bc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:09.402141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d77d13f1-2b42-4f5c-93a2-45e833946bc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:09.409844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d77d13f1-2b42-4f5c-93a2-45e833946bc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151767 Mar 08 04:39:09.410671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1038/2021] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:10.115813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-989cb252-542b-44ce-a73d-aaf9acef45ca tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:10.116338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-989cb252-542b-44ce-a73d-aaf9acef45ca tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:10.123157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-989cb252-542b-44ce-a73d-aaf9acef45ca tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:10.123595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-989cb252-542b-44ce-a73d-aaf9acef45ca tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:10.124353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-989cb252-542b-44ce-a73d-aaf9acef45ca tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:10.124779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-989cb252-542b-44ce-a73d-aaf9acef45ca tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:10.257105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-989cb252-542b-44ce-a73d-aaf9acef45ca tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:10.264640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-989cb252-542b-44ce-a73d-aaf9acef45ca tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153511 Mar 08 04:39:10.265191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 984/2022] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:10 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:10.427136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-79b2c281-cd68-4d0a-87e9-464f02659525 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:10.427745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-79b2c281-cd68-4d0a-87e9-464f02659525 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:10.434008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79b2c281-cd68-4d0a-87e9-464f02659525 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:10.434451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79b2c281-cd68-4d0a-87e9-464f02659525 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:10.435208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79b2c281-cd68-4d0a-87e9-464f02659525 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:10.435642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79b2c281-cd68-4d0a-87e9-464f02659525 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:10.564618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-79b2c281-cd68-4d0a-87e9-464f02659525 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:10.572343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-79b2c281-cd68-4d0a-87e9-464f02659525 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149294 Mar 08 04:39:10.572905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1039/2023] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:11.282318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a5d723ad-ce41-40da-84a6-b33d3be67f3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:11.282938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a5d723ad-ce41-40da-84a6-b33d3be67f3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:11.290023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5d723ad-ce41-40da-84a6-b33d3be67f3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:11.290475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5d723ad-ce41-40da-84a6-b33d3be67f3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:11.291246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5d723ad-ce41-40da-84a6-b33d3be67f3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:11.291682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5d723ad-ce41-40da-84a6-b33d3be67f3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:11.425286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a5d723ad-ce41-40da-84a6-b33d3be67f3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:11.433203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a5d723ad-ce41-40da-84a6-b33d3be67f3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154740 Mar 08 04:39:11.433786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 985/2024] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:11 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:11.590143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-00351711-c43a-4c0f-8b43-6b6f9c19b1de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:11.590677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-00351711-c43a-4c0f-8b43-6b6f9c19b1de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:11.596925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00351711-c43a-4c0f-8b43-6b6f9c19b1de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:11.597933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00351711-c43a-4c0f-8b43-6b6f9c19b1de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:11.598800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00351711-c43a-4c0f-8b43-6b6f9c19b1de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:11.599244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00351711-c43a-4c0f-8b43-6b6f9c19b1de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:11.735044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-00351711-c43a-4c0f-8b43-6b6f9c19b1de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:11.743374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-00351711-c43a-4c0f-8b43-6b6f9c19b1de tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.157185 Mar 08 04:39:11.743941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1040/2025] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:12.450649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5f456d32-f670-4348-acf0-785c75019ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:12.451256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5f456d32-f670-4348-acf0-785c75019ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:12.458373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f456d32-f670-4348-acf0-785c75019ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:12.458814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f456d32-f670-4348-acf0-785c75019ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:12.459570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f456d32-f670-4348-acf0-785c75019ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:12.459999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f456d32-f670-4348-acf0-785c75019ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:12.604252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5f456d32-f670-4348-acf0-785c75019ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:12.612366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5f456d32-f670-4348-acf0-785c75019ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.165581 Mar 08 04:39:12.612931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 986/2026] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:12 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:12.760356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d9a4c570-199d-4d0c-ad15-43a92ea8deb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:12.760885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d9a4c570-199d-4d0c-ad15-43a92ea8deb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:12.767151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d9a4c570-199d-4d0c-ad15-43a92ea8deb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:12.767596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d9a4c570-199d-4d0c-ad15-43a92ea8deb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:12.768356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d9a4c570-199d-4d0c-ad15-43a92ea8deb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:12.768787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d9a4c570-199d-4d0c-ad15-43a92ea8deb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:12.903159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d9a4c570-199d-4d0c-ad15-43a92ea8deb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:12.911254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d9a4c570-199d-4d0c-ad15-43a92ea8deb2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154887 Mar 08 04:39:12.911813 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1041/2027] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:13.630406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-00f9d801-7876-45e9-afd8-293355b86da8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:13.631009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-00f9d801-7876-45e9-afd8-293355b86da8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:13.637131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00f9d801-7876-45e9-afd8-293355b86da8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:13.637572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00f9d801-7876-45e9-afd8-293355b86da8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:13.638355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00f9d801-7876-45e9-afd8-293355b86da8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:13.638782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00f9d801-7876-45e9-afd8-293355b86da8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:13.768656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-00f9d801-7876-45e9-afd8-293355b86da8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:13.776824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-00f9d801-7876-45e9-afd8-293355b86da8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150917 Mar 08 04:39:13.777375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 987/2028] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:13 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:13.928647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f955c02e-71c4-4bab-9370-9b87db2bccc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:13.929256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f955c02e-71c4-4bab-9370-9b87db2bccc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:13.935549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f955c02e-71c4-4bab-9370-9b87db2bccc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:13.935989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f955c02e-71c4-4bab-9370-9b87db2bccc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:13.936748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f955c02e-71c4-4bab-9370-9b87db2bccc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:13.937182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f955c02e-71c4-4bab-9370-9b87db2bccc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:14.070515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f955c02e-71c4-4bab-9370-9b87db2bccc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:14.078279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f955c02e-71c4-4bab-9370-9b87db2bccc6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154315 Mar 08 04:39:14.078833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1042/2029] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:13 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:14.794276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-732edec0-f55b-425d-b61b-b46b9aa8293f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:14.794865 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-732edec0-f55b-425d-b61b-b46b9aa8293f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:14.801876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-732edec0-f55b-425d-b61b-b46b9aa8293f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:14.802323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-732edec0-f55b-425d-b61b-b46b9aa8293f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:14.803082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-732edec0-f55b-425d-b61b-b46b9aa8293f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:14.803509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-732edec0-f55b-425d-b61b-b46b9aa8293f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:14.935483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-732edec0-f55b-425d-b61b-b46b9aa8293f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:14.943152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-732edec0-f55b-425d-b61b-b46b9aa8293f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152715 Mar 08 04:39:14.943712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 988/2030] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:14 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:15.095634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e044333b-7640-44cf-827c-82b51fbf17e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:15.096251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e044333b-7640-44cf-827c-82b51fbf17e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:15.103393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e044333b-7640-44cf-827c-82b51fbf17e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:15.103849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e044333b-7640-44cf-827c-82b51fbf17e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:15.104625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e044333b-7640-44cf-827c-82b51fbf17e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:15.105074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e044333b-7640-44cf-827c-82b51fbf17e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:15.240343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e044333b-7640-44cf-827c-82b51fbf17e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:15.247923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e044333b-7640-44cf-827c-82b51fbf17e7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.156107 Mar 08 04:39:15.248478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1043/2031] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:15.959090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ade4a0be-e70f-4eaa-91fa-c56bb8ffedfd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:15.959701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ade4a0be-e70f-4eaa-91fa-c56bb8ffedfd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:15.965976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ade4a0be-e70f-4eaa-91fa-c56bb8ffedfd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:15.966429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ade4a0be-e70f-4eaa-91fa-c56bb8ffedfd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:15.967196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ade4a0be-e70f-4eaa-91fa-c56bb8ffedfd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:15.967634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ade4a0be-e70f-4eaa-91fa-c56bb8ffedfd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:16.103735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ade4a0be-e70f-4eaa-91fa-c56bb8ffedfd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:16.111424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ade4a0be-e70f-4eaa-91fa-c56bb8ffedfd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.156194 Mar 08 04:39:16.111985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 989/2032] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:15 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:16.264078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b79733f3-791c-488e-b662-eba54832bcdb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:16.264686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b79733f3-791c-488e-b662-eba54832bcdb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:16.271480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b79733f3-791c-488e-b662-eba54832bcdb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:16.271925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b79733f3-791c-488e-b662-eba54832bcdb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:16.272684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b79733f3-791c-488e-b662-eba54832bcdb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:16.273121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b79733f3-791c-488e-b662-eba54832bcdb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:16.401223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b79733f3-791c-488e-b662-eba54832bcdb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:16.408892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b79733f3-791c-488e-b662-eba54832bcdb tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148569 Mar 08 04:39:16.409449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1044/2033] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:17.128730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cae8a2d8-6995-40d6-bc68-0d1102b8eec9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:17.129279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cae8a2d8-6995-40d6-bc68-0d1102b8eec9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:17.135529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cae8a2d8-6995-40d6-bc68-0d1102b8eec9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:17.135977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cae8a2d8-6995-40d6-bc68-0d1102b8eec9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:17.136743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cae8a2d8-6995-40d6-bc68-0d1102b8eec9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:17.137177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cae8a2d8-6995-40d6-bc68-0d1102b8eec9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:17.271512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cae8a2d8-6995-40d6-bc68-0d1102b8eec9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:17.279466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cae8a2d8-6995-40d6-bc68-0d1102b8eec9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154657 Mar 08 04:39:17.280025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 990/2034] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:17 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:17.427103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b5c07b93-69b6-4287-8424-7e1efc5cb431 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:17.427709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b5c07b93-69b6-4287-8424-7e1efc5cb431 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:17.434203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5c07b93-69b6-4287-8424-7e1efc5cb431 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:17.434656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5c07b93-69b6-4287-8424-7e1efc5cb431 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:17.435430 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5c07b93-69b6-4287-8424-7e1efc5cb431 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:17.435869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5c07b93-69b6-4287-8424-7e1efc5cb431 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:17.564822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b5c07b93-69b6-4287-8424-7e1efc5cb431 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:17.572559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b5c07b93-69b6-4287-8424-7e1efc5cb431 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149828 Mar 08 04:39:17.573125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1045/2035] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:18.296109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b0de0af6-d626-4e24-93b6-6f77bf0cff0f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:18.296718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b0de0af6-d626-4e24-93b6-6f77bf0cff0f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:18.303718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0de0af6-d626-4e24-93b6-6f77bf0cff0f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:18.304165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0de0af6-d626-4e24-93b6-6f77bf0cff0f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:18.304923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0de0af6-d626-4e24-93b6-6f77bf0cff0f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:18.305386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0de0af6-d626-4e24-93b6-6f77bf0cff0f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:18.438765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b0de0af6-d626-4e24-93b6-6f77bf0cff0f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:18.446503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b0de0af6-d626-4e24-93b6-6f77bf0cff0f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154212 Mar 08 04:39:18.447060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 991/2036] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:18 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:18.589440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-86d072a4-e17a-4580-9317-d79a773bc4a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:18.590004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-86d072a4-e17a-4580-9317-d79a773bc4a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:18.595828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86d072a4-e17a-4580-9317-d79a773bc4a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:18.596270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86d072a4-e17a-4580-9317-d79a773bc4a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:18.597024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86d072a4-e17a-4580-9317-d79a773bc4a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:18.598289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86d072a4-e17a-4580-9317-d79a773bc4a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:18.727459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-86d072a4-e17a-4580-9317-d79a773bc4a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:18.735019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-86d072a4-e17a-4580-9317-d79a773bc4a4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149619 Mar 08 04:39:18.735578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1046/2037] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:19.463613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a9fa6344-8d0b-40ac-98bd-dfa86f334a8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:19.464249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a9fa6344-8d0b-40ac-98bd-dfa86f334a8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:19.470413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9fa6344-8d0b-40ac-98bd-dfa86f334a8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:19.470862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9fa6344-8d0b-40ac-98bd-dfa86f334a8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:19.471623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9fa6344-8d0b-40ac-98bd-dfa86f334a8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:19.472056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9fa6344-8d0b-40ac-98bd-dfa86f334a8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:19.604450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a9fa6344-8d0b-40ac-98bd-dfa86f334a8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:19.612078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a9fa6344-8d0b-40ac-98bd-dfa86f334a8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152292 Mar 08 04:39:19.612647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 992/2038] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:19 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:19.752410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1a87c0de-a122-4ab4-b463-76214fad5315 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:19.753018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1a87c0de-a122-4ab4-b463-76214fad5315 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:19.759381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a87c0de-a122-4ab4-b463-76214fad5315 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:19.759826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a87c0de-a122-4ab4-b463-76214fad5315 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:19.760592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a87c0de-a122-4ab4-b463-76214fad5315 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:19.761026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a87c0de-a122-4ab4-b463-76214fad5315 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:19.891500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1a87c0de-a122-4ab4-b463-76214fad5315 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:19.900146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1a87c0de-a122-4ab4-b463-76214fad5315 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151701 Mar 08 04:39:19.900976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1047/2039] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:20.629174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f90898a1-dc76-48dc-9a2e-25983079e527 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:20.629809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f90898a1-dc76-48dc-9a2e-25983079e527 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:20.635911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f90898a1-dc76-48dc-9a2e-25983079e527 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:20.636350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f90898a1-dc76-48dc-9a2e-25983079e527 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:20.637107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f90898a1-dc76-48dc-9a2e-25983079e527 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:20.637535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f90898a1-dc76-48dc-9a2e-25983079e527 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:20.771735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f90898a1-dc76-48dc-9a2e-25983079e527 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:20.781224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f90898a1-dc76-48dc-9a2e-25983079e527 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.156206 Mar 08 04:39:20.781805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 993/2040] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:20 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:20.917353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a9ea13d2-5525-4a7c-8510-f83e60ed5e93 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:20.917987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a9ea13d2-5525-4a7c-8510-f83e60ed5e93 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:20.924253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a9ea13d2-5525-4a7c-8510-f83e60ed5e93 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:20.924697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a9ea13d2-5525-4a7c-8510-f83e60ed5e93 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:20.925601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a9ea13d2-5525-4a7c-8510-f83e60ed5e93 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:20.926076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a9ea13d2-5525-4a7c-8510-f83e60ed5e93 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:21.063460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a9ea13d2-5525-4a7c-8510-f83e60ed5e93 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:21.071612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a9ea13d2-5525-4a7c-8510-f83e60ed5e93 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.158113 Mar 08 04:39:21.072183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1048/2041] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:20 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:21.798763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d73566ee-99e4-4313-9932-861c299e4ff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:21.799370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d73566ee-99e4-4313-9932-861c299e4ff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:21.806293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d73566ee-99e4-4313-9932-861c299e4ff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:21.806733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d73566ee-99e4-4313-9932-861c299e4ff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:21.807492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d73566ee-99e4-4313-9932-861c299e4ff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:21.807925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d73566ee-99e4-4313-9932-861c299e4ff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:21.939648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d73566ee-99e4-4313-9932-861c299e4ff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:21.947343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d73566ee-99e4-4313-9932-861c299e4ff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152479 Mar 08 04:39:21.947899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 994/2042] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:21 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:22.088784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-028d2fe9-2fbe-476f-b800-22549ffc083f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:22.089318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-028d2fe9-2fbe-476f-b800-22549ffc083f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:22.095519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-028d2fe9-2fbe-476f-b800-22549ffc083f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:22.095965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-028d2fe9-2fbe-476f-b800-22549ffc083f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:22.096720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-028d2fe9-2fbe-476f-b800-22549ffc083f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:22.097186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-028d2fe9-2fbe-476f-b800-22549ffc083f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:22.229555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-028d2fe9-2fbe-476f-b800-22549ffc083f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:22.237384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-028d2fe9-2fbe-476f-b800-22549ffc083f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152453 Mar 08 04:39:22.238747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1049/2043] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:22.964494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fb36c1a7-9744-4464-9023-f64f5416b2d2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:22.965097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fb36c1a7-9744-4464-9023-f64f5416b2d2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:22.971324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb36c1a7-9744-4464-9023-f64f5416b2d2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:22.971766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb36c1a7-9744-4464-9023-f64f5416b2d2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:22.973024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb36c1a7-9744-4464-9023-f64f5416b2d2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:22.973447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb36c1a7-9744-4464-9023-f64f5416b2d2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:23.107742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fb36c1a7-9744-4464-9023-f64f5416b2d2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:23.115674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fb36c1a7-9744-4464-9023-f64f5416b2d2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155021 Mar 08 04:39:23.116233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 995/2044] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:22 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:23.255437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dbe42352-1a68-4424-864f-618f1ca31abc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:23.256072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dbe42352-1a68-4424-864f-618f1ca31abc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:23.262371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbe42352-1a68-4424-864f-618f1ca31abc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:23.262810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbe42352-1a68-4424-864f-618f1ca31abc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:23.263564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbe42352-1a68-4424-864f-618f1ca31abc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:23.263995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbe42352-1a68-4424-864f-618f1ca31abc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:23.392428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dbe42352-1a68-4424-864f-618f1ca31abc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:23.401133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dbe42352-1a68-4424-864f-618f1ca31abc tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149799 Mar 08 04:39:23.401720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1050/2045] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:24.132931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a3756181-9c08-4f69-a9bb-c640f23ee406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:24.133448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a3756181-9c08-4f69-a9bb-c640f23ee406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:24.139675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3756181-9c08-4f69-a9bb-c640f23ee406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:24.140121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3756181-9c08-4f69-a9bb-c640f23ee406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:24.140879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3756181-9c08-4f69-a9bb-c640f23ee406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:24.141312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3756181-9c08-4f69-a9bb-c640f23ee406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:24.274923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a3756181-9c08-4f69-a9bb-c640f23ee406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:24.282822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a3756181-9c08-4f69-a9bb-c640f23ee406 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154392 Mar 08 04:39:24.283388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 996/2046] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:24 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:24.418878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e2258a1e-b27d-40a3-9195-77b7732e6276 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:24.419484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e2258a1e-b27d-40a3-9195-77b7732e6276 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:24.426388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2258a1e-b27d-40a3-9195-77b7732e6276 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:24.426836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2258a1e-b27d-40a3-9195-77b7732e6276 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:24.427589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2258a1e-b27d-40a3-9195-77b7732e6276 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:24.428018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2258a1e-b27d-40a3-9195-77b7732e6276 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:24.559225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e2258a1e-b27d-40a3-9195-77b7732e6276 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:24.567121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e2258a1e-b27d-40a3-9195-77b7732e6276 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152552 Mar 08 04:39:24.567690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1051/2047] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:25.300824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-88b36178-fff6-489d-9f6c-500ac1efa845 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:25.301453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-88b36178-fff6-489d-9f6c-500ac1efa845 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:25.307671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88b36178-fff6-489d-9f6c-500ac1efa845 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:25.308114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88b36178-fff6-489d-9f6c-500ac1efa845 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:25.308872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88b36178-fff6-489d-9f6c-500ac1efa845 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:25.309300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88b36178-fff6-489d-9f6c-500ac1efa845 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:25.444493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-88b36178-fff6-489d-9f6c-500ac1efa845 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:25.452197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-88b36178-fff6-489d-9f6c-500ac1efa845 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155808 Mar 08 04:39:25.452757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 997/2048] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:25 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:25.590483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ac291f80-b873-4977-8b9f-2625ad71e7a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:25.591091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ac291f80-b873-4977-8b9f-2625ad71e7a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:25.598146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ac291f80-b873-4977-8b9f-2625ad71e7a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:25.598616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ac291f80-b873-4977-8b9f-2625ad71e7a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:25.599384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ac291f80-b873-4977-8b9f-2625ad71e7a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:25.599819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ac291f80-b873-4977-8b9f-2625ad71e7a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:25.731730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ac291f80-b873-4977-8b9f-2625ad71e7a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:25.740021 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ac291f80-b873-4977-8b9f-2625ad71e7a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153466 Mar 08 04:39:25.740575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1052/2049] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:25 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:26.469873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6b3c90fd-047e-47a3-885e-d708f639b75c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:26.470486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6b3c90fd-047e-47a3-885e-d708f639b75c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:26.477298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b3c90fd-047e-47a3-885e-d708f639b75c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:26.477781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b3c90fd-047e-47a3-885e-d708f639b75c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:26.478547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b3c90fd-047e-47a3-885e-d708f639b75c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:26.478982 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b3c90fd-047e-47a3-885e-d708f639b75c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:26.614577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6b3c90fd-047e-47a3-885e-d708f639b75c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:26.622543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6b3c90fd-047e-47a3-885e-d708f639b75c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.156498 Mar 08 04:39:26.623112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 998/2050] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:26 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:26.756056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f535f14e-8dd7-42d4-ab29-0dd184b97f30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:26.756661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f535f14e-8dd7-42d4-ab29-0dd184b97f30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:26.762785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f535f14e-8dd7-42d4-ab29-0dd184b97f30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:26.763229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f535f14e-8dd7-42d4-ab29-0dd184b97f30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:26.763981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f535f14e-8dd7-42d4-ab29-0dd184b97f30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:26.764414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f535f14e-8dd7-42d4-ab29-0dd184b97f30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:26.894631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f535f14e-8dd7-42d4-ab29-0dd184b97f30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:26.902550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f535f14e-8dd7-42d4-ab29-0dd184b97f30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150247 Mar 08 04:39:26.903112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1053/2051] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:27.639513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5957bf79-f156-443f-8813-f2b3cc3b6b0c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:27.640049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5957bf79-f156-443f-8813-f2b3cc3b6b0c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:27.647139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5957bf79-f156-443f-8813-f2b3cc3b6b0c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:27.647579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5957bf79-f156-443f-8813-f2b3cc3b6b0c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:27.648331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5957bf79-f156-443f-8813-f2b3cc3b6b0c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:27.648758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5957bf79-f156-443f-8813-f2b3cc3b6b0c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:27.781910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5957bf79-f156-443f-8813-f2b3cc3b6b0c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:27.789921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5957bf79-f156-443f-8813-f2b3cc3b6b0c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154286 Mar 08 04:39:27.790672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 999/2052] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:27 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:27.920010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f024c389-4f26-4679-acd4-fd4ffa62e455 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:27.920615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f024c389-4f26-4679-acd4-fd4ffa62e455 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:27.927538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f024c389-4f26-4679-acd4-fd4ffa62e455 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:27.927980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f024c389-4f26-4679-acd4-fd4ffa62e455 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:27.928734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f024c389-4f26-4679-acd4-fd4ffa62e455 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:27.929167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f024c389-4f26-4679-acd4-fd4ffa62e455 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:28.069637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f024c389-4f26-4679-acd4-fd4ffa62e455 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:28.077226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f024c389-4f26-4679-acd4-fd4ffa62e455 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.161037 Mar 08 04:39:28.077840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1054/2053] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:28.806738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d6456f82-aeec-48db-9d2d-9ab1d809c34f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:28.807365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d6456f82-aeec-48db-9d2d-9ab1d809c34f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:28.813590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d6456f82-aeec-48db-9d2d-9ab1d809c34f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:28.814077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d6456f82-aeec-48db-9d2d-9ab1d809c34f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:28.814838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d6456f82-aeec-48db-9d2d-9ab1d809c34f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:28.815273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d6456f82-aeec-48db-9d2d-9ab1d809c34f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:28.944777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d6456f82-aeec-48db-9d2d-9ab1d809c34f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:28.952368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d6456f82-aeec-48db-9d2d-9ab1d809c34f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149454 Mar 08 04:39:28.952927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1000/2054] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:28 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:29.094259 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a89475c5-ebc6-4072-bec6-2408a124df34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:29.094809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a89475c5-ebc6-4072-bec6-2408a124df34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:29.101589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a89475c5-ebc6-4072-bec6-2408a124df34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:29.102061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a89475c5-ebc6-4072-bec6-2408a124df34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:29.102814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a89475c5-ebc6-4072-bec6-2408a124df34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:29.103246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a89475c5-ebc6-4072-bec6-2408a124df34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:29.233711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a89475c5-ebc6-4072-bec6-2408a124df34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:29.242102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a89475c5-ebc6-4072-bec6-2408a124df34 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151648 Mar 08 04:39:29.242689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1055/2055] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:29 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:29.968072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-55b05603-1b29-4a8e-900a-bb30919aea3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:29.968674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-55b05603-1b29-4a8e-900a-bb30919aea3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:29.975486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55b05603-1b29-4a8e-900a-bb30919aea3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:29.975927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55b05603-1b29-4a8e-900a-bb30919aea3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:29.976671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55b05603-1b29-4a8e-900a-bb30919aea3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:29.977108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55b05603-1b29-4a8e-900a-bb30919aea3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:30.106196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-55b05603-1b29-4a8e-900a-bb30919aea3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:30.114649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-55b05603-1b29-4a8e-900a-bb30919aea3a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150366 Mar 08 04:39:30.115313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1001/2056] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:29 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:30.259081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7b48eea2-87f2-42ec-b640-b7ffa09d6bba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:30.259687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7b48eea2-87f2-42ec-b640-b7ffa09d6bba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:30.265885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b48eea2-87f2-42ec-b640-b7ffa09d6bba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:30.266332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b48eea2-87f2-42ec-b640-b7ffa09d6bba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:30.267122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b48eea2-87f2-42ec-b640-b7ffa09d6bba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:30.267558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b48eea2-87f2-42ec-b640-b7ffa09d6bba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:30.397225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7b48eea2-87f2-42ec-b640-b7ffa09d6bba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:30.405128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7b48eea2-87f2-42ec-b640-b7ffa09d6bba tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149870 Mar 08 04:39:30.405704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1056/2057] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:31.132801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cf4d7e41-bcb3-4b93-8aba-7c8ba431c90b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:31.133348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cf4d7e41-bcb3-4b93-8aba-7c8ba431c90b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:31.139589 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf4d7e41-bcb3-4b93-8aba-7c8ba431c90b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:31.140025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf4d7e41-bcb3-4b93-8aba-7c8ba431c90b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:31.140784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf4d7e41-bcb3-4b93-8aba-7c8ba431c90b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:31.141209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf4d7e41-bcb3-4b93-8aba-7c8ba431c90b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:31.274401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cf4d7e41-bcb3-4b93-8aba-7c8ba431c90b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:31.282282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cf4d7e41-bcb3-4b93-8aba-7c8ba431c90b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154248 Mar 08 04:39:31.282842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1002/2058] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:31 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:31.422722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4cdcafd2-d0d4-48a0-9dd2-c1ac4d45a6b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:31.423340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4cdcafd2-d0d4-48a0-9dd2-c1ac4d45a6b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:31.429792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4cdcafd2-d0d4-48a0-9dd2-c1ac4d45a6b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:31.430241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4cdcafd2-d0d4-48a0-9dd2-c1ac4d45a6b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:31.431006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4cdcafd2-d0d4-48a0-9dd2-c1ac4d45a6b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:31.431444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4cdcafd2-d0d4-48a0-9dd2-c1ac4d45a6b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:31.557795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4cdcafd2-d0d4-48a0-9dd2-c1ac4d45a6b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:31.565387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4cdcafd2-d0d4-48a0-9dd2-c1ac4d45a6b3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.146500 Mar 08 04:39:31.565980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1057/2059] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:32.299939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-155ed93f-b71c-4a26-9271-a984ed401698 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:32.300577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-155ed93f-b71c-4a26-9271-a984ed401698 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:32.306946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-155ed93f-b71c-4a26-9271-a984ed401698 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:32.307399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-155ed93f-b71c-4a26-9271-a984ed401698 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:32.308158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-155ed93f-b71c-4a26-9271-a984ed401698 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:32.308591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-155ed93f-b71c-4a26-9271-a984ed401698 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:32.437293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-155ed93f-b71c-4a26-9271-a984ed401698 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:32.445433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-155ed93f-b71c-4a26-9271-a984ed401698 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149322 Mar 08 04:39:32.446097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1003/2060] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:32 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:32.583400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-428f06a5-df96-4e6f-9ac2-2507b5542acf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:32.583960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-428f06a5-df96-4e6f-9ac2-2507b5542acf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:32.590246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-428f06a5-df96-4e6f-9ac2-2507b5542acf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:32.590697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-428f06a5-df96-4e6f-9ac2-2507b5542acf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:32.591463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-428f06a5-df96-4e6f-9ac2-2507b5542acf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:32.591906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-428f06a5-df96-4e6f-9ac2-2507b5542acf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:32.718833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-428f06a5-df96-4e6f-9ac2-2507b5542acf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:32.726605 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-428f06a5-df96-4e6f-9ac2-2507b5542acf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.147870 Mar 08 04:39:32.727170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1058/2061] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:33.462987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-62e2ba40-07c0-4c4c-9d6a-a11f9611323c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:33.463593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-62e2ba40-07c0-4c4c-9d6a-a11f9611323c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:33.469797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62e2ba40-07c0-4c4c-9d6a-a11f9611323c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:33.470265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62e2ba40-07c0-4c4c-9d6a-a11f9611323c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:33.471021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62e2ba40-07c0-4c4c-9d6a-a11f9611323c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:33.471450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62e2ba40-07c0-4c4c-9d6a-a11f9611323c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:33.602080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-62e2ba40-07c0-4c4c-9d6a-a11f9611323c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:33.609625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-62e2ba40-07c0-4c4c-9d6a-a11f9611323c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150597 Mar 08 04:39:33.610202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1004/2062] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:33 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:33.744291 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a1ad50c3-2043-428c-bb1b-267e0a5a40c4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:33.744907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a1ad50c3-2043-428c-bb1b-267e0a5a40c4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:33.751110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1ad50c3-2043-428c-bb1b-267e0a5a40c4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:33.751562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1ad50c3-2043-428c-bb1b-267e0a5a40c4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:33.752320 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1ad50c3-2043-428c-bb1b-267e0a5a40c4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:33.752757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1ad50c3-2043-428c-bb1b-267e0a5a40c4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:33.882992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a1ad50c3-2043-428c-bb1b-267e0a5a40c4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:33.890696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a1ad50c3-2043-428c-bb1b-267e0a5a40c4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150238 Mar 08 04:39:33.891250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1059/2063] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:34.627140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b3275f8d-cbea-42d1-af92-ccdd37a26874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:34.627891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b3275f8d-cbea-42d1-af92-ccdd37a26874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:34.634609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3275f8d-cbea-42d1-af92-ccdd37a26874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:34.635053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3275f8d-cbea-42d1-af92-ccdd37a26874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:34.635805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3275f8d-cbea-42d1-af92-ccdd37a26874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:34.636450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3275f8d-cbea-42d1-af92-ccdd37a26874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:34.775512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b3275f8d-cbea-42d1-af92-ccdd37a26874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:34.783387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b3275f8d-cbea-42d1-af92-ccdd37a26874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.160057 Mar 08 04:39:34.784257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1005/2064] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:34 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:34.908181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-73977553-be2c-41a6-8117-e3896ff33465 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:34.908726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-73977553-be2c-41a6-8117-e3896ff33465 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:34.915352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73977553-be2c-41a6-8117-e3896ff33465 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:34.915804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73977553-be2c-41a6-8117-e3896ff33465 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:34.916576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73977553-be2c-41a6-8117-e3896ff33465 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:34.917020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73977553-be2c-41a6-8117-e3896ff33465 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:35.049304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-73977553-be2c-41a6-8117-e3896ff33465 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:35.057753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-73977553-be2c-41a6-8117-e3896ff33465 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153441 Mar 08 04:39:35.058324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1060/2065] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:35.800859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c9d40ec1-52f6-46e1-98c9-4b7fa56a66f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:35.801555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c9d40ec1-52f6-46e1-98c9-4b7fa56a66f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:35.808094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9d40ec1-52f6-46e1-98c9-4b7fa56a66f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:35.808542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9d40ec1-52f6-46e1-98c9-4b7fa56a66f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:35.809303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9d40ec1-52f6-46e1-98c9-4b7fa56a66f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:35.809763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9d40ec1-52f6-46e1-98c9-4b7fa56a66f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:35.939587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c9d40ec1-52f6-46e1-98c9-4b7fa56a66f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:35.948304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c9d40ec1-52f6-46e1-98c9-4b7fa56a66f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151893 Mar 08 04:39:35.948867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1006/2066] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:35 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:36.075690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7f1175f8-01fd-45d9-9f58-3b26e8f45b17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:36.076269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7f1175f8-01fd-45d9-9f58-3b26e8f45b17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:36.082785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f1175f8-01fd-45d9-9f58-3b26e8f45b17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:36.083238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f1175f8-01fd-45d9-9f58-3b26e8f45b17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:36.084001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f1175f8-01fd-45d9-9f58-3b26e8f45b17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:36.084440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f1175f8-01fd-45d9-9f58-3b26e8f45b17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:36.223560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7f1175f8-01fd-45d9-9f58-3b26e8f45b17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:36.231203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7f1175f8-01fd-45d9-9f58-3b26e8f45b17 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.159635 Mar 08 04:39:36.231754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1061/2067] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:36.964201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-71275341-6d96-40fa-a0b6-0751b36c1ef1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:36.964859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-71275341-6d96-40fa-a0b6-0751b36c1ef1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:36.971112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71275341-6d96-40fa-a0b6-0751b36c1ef1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:36.971557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71275341-6d96-40fa-a0b6-0751b36c1ef1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:36.972310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71275341-6d96-40fa-a0b6-0751b36c1ef1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:36.972783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-71275341-6d96-40fa-a0b6-0751b36c1ef1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:37.101422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-71275341-6d96-40fa-a0b6-0751b36c1ef1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:37.109149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-71275341-6d96-40fa-a0b6-0751b36c1ef1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.148701 Mar 08 04:39:37.109639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1007/2068] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:36 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:37.248594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8a0796a2-828a-4e1b-a39d-6eec46c93ca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:37.249211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8a0796a2-828a-4e1b-a39d-6eec46c93ca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:37.256437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8a0796a2-828a-4e1b-a39d-6eec46c93ca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:37.256891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8a0796a2-828a-4e1b-a39d-6eec46c93ca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:37.257683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8a0796a2-828a-4e1b-a39d-6eec46c93ca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:37.258142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8a0796a2-828a-4e1b-a39d-6eec46c93ca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:37.387164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8a0796a2-828a-4e1b-a39d-6eec46c93ca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:37.394873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8a0796a2-828a-4e1b-a39d-6eec46c93ca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150066 Mar 08 04:39:37.395428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1062/2069] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:38.125862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dc62ad8e-9435-420c-bf37-f433b8ca8b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:38.126399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dc62ad8e-9435-420c-bf37-f433b8ca8b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:38.133450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc62ad8e-9435-420c-bf37-f433b8ca8b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:38.133933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc62ad8e-9435-420c-bf37-f433b8ca8b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:38.134695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc62ad8e-9435-420c-bf37-f433b8ca8b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:38.135131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc62ad8e-9435-420c-bf37-f433b8ca8b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:38.267861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dc62ad8e-9435-420c-bf37-f433b8ca8b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:38.275956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dc62ad8e-9435-420c-bf37-f433b8ca8b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154015 Mar 08 04:39:38.276524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1008/2070] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:38 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:38.412797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b43eb317-999e-4e77-8cc4-81d899e6a569 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:38.413411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b43eb317-999e-4e77-8cc4-81d899e6a569 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:38.419651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b43eb317-999e-4e77-8cc4-81d899e6a569 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:38.420101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b43eb317-999e-4e77-8cc4-81d899e6a569 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:38.420867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b43eb317-999e-4e77-8cc4-81d899e6a569 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:38.421308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b43eb317-999e-4e77-8cc4-81d899e6a569 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:38.551754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b43eb317-999e-4e77-8cc4-81d899e6a569 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:38.559526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b43eb317-999e-4e77-8cc4-81d899e6a569 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151361 Mar 08 04:39:38.560092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1063/2071] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:39.292828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7a9c800b-9f8a-43b6-81c6-fc338e316b53 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:39.293464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7a9c800b-9f8a-43b6-81c6-fc338e316b53 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:39.299783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a9c800b-9f8a-43b6-81c6-fc338e316b53 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:39.300227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a9c800b-9f8a-43b6-81c6-fc338e316b53 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:39.300989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a9c800b-9f8a-43b6-81c6-fc338e316b53 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:39.301422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7a9c800b-9f8a-43b6-81c6-fc338e316b53 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:39.434806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7a9c800b-9f8a-43b6-81c6-fc338e316b53 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:39.443261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7a9c800b-9f8a-43b6-81c6-fc338e316b53 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154284 Mar 08 04:39:39.443824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1009/2072] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:39 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:39.576925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9658ca3b-b9a4-456a-b999-eebb01324f3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:39.577455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9658ca3b-b9a4-456a-b999-eebb01324f3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:39.583981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9658ca3b-b9a4-456a-b999-eebb01324f3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:39.584426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9658ca3b-b9a4-456a-b999-eebb01324f3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:39.585178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9658ca3b-b9a4-456a-b999-eebb01324f3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:39.585610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9658ca3b-b9a4-456a-b999-eebb01324f3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:39.713227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9658ca3b-b9a4-456a-b999-eebb01324f3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:39.720850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9658ca3b-b9a4-456a-b999-eebb01324f3c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.147976 Mar 08 04:39:39.721410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1064/2073] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:40.459713 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-daef6819-85b4-4388-9e50-96faa9152c12 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:40.460321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-daef6819-85b4-4388-9e50-96faa9152c12 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:40.466489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-daef6819-85b4-4388-9e50-96faa9152c12 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:40.466930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-daef6819-85b4-4388-9e50-96faa9152c12 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:40.467683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-daef6819-85b4-4388-9e50-96faa9152c12 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:40.468119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-daef6819-85b4-4388-9e50-96faa9152c12 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:40.601973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-daef6819-85b4-4388-9e50-96faa9152c12 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:40.609599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-daef6819-85b4-4388-9e50-96faa9152c12 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154382 Mar 08 04:39:40.610179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1010/2074] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:40 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:40.738002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-298b770f-57f3-4c33-a88e-83eb89ae3f85 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:40.738619 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-298b770f-57f3-4c33-a88e-83eb89ae3f85 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:40.744836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-298b770f-57f3-4c33-a88e-83eb89ae3f85 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:40.745288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-298b770f-57f3-4c33-a88e-83eb89ae3f85 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:40.746111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-298b770f-57f3-4c33-a88e-83eb89ae3f85 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:40.746556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-298b770f-57f3-4c33-a88e-83eb89ae3f85 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:40.876668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-298b770f-57f3-4c33-a88e-83eb89ae3f85 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:40.884962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-298b770f-57f3-4c33-a88e-83eb89ae3f85 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150805 Mar 08 04:39:40.885519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1065/2075] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:40 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:41.626469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1f6613d3-b768-483b-af51-e2af0ee414ba tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:41.627018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1f6613d3-b768-483b-af51-e2af0ee414ba tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:41.633237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f6613d3-b768-483b-af51-e2af0ee414ba tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:41.633717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f6613d3-b768-483b-af51-e2af0ee414ba tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:41.634582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f6613d3-b768-483b-af51-e2af0ee414ba tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:41.634978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1f6613d3-b768-483b-af51-e2af0ee414ba tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:41.765327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1f6613d3-b768-483b-af51-e2af0ee414ba tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:41.773870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1f6613d3-b768-483b-af51-e2af0ee414ba tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151241 Mar 08 04:39:41.775846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1011/2076] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:41 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:41.903304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-499baf03-8d19-442f-b848-79d45e7a2c8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:41.903854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-499baf03-8d19-442f-b848-79d45e7a2c8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:41.910812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-499baf03-8d19-442f-b848-79d45e7a2c8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:41.911260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-499baf03-8d19-442f-b848-79d45e7a2c8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:41.912022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-499baf03-8d19-442f-b848-79d45e7a2c8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:41.912457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-499baf03-8d19-442f-b848-79d45e7a2c8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:42.043232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-499baf03-8d19-442f-b848-79d45e7a2c8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:42.051065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-499baf03-8d19-442f-b848-79d45e7a2c8c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.151913 Mar 08 04:39:42.051635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1066/2077] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:42.796366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-910c38b6-37a5-4cad-897f-6d3e876bef5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:42.796974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-910c38b6-37a5-4cad-897f-6d3e876bef5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:42.804042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-910c38b6-37a5-4cad-897f-6d3e876bef5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:42.804497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-910c38b6-37a5-4cad-897f-6d3e876bef5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:42.805245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-910c38b6-37a5-4cad-897f-6d3e876bef5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:42.805701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-910c38b6-37a5-4cad-897f-6d3e876bef5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:42.937102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-910c38b6-37a5-4cad-897f-6d3e876bef5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:42.944856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-910c38b6-37a5-4cad-897f-6d3e876bef5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152365 Mar 08 04:39:42.945413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1012/2078] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:42 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:43.067608 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5285dd5d-008e-44fd-9c15-205a46b57185 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:43.068122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5285dd5d-008e-44fd-9c15-205a46b57185 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:43.074411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5285dd5d-008e-44fd-9c15-205a46b57185 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:43.074854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5285dd5d-008e-44fd-9c15-205a46b57185 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:43.075615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5285dd5d-008e-44fd-9c15-205a46b57185 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:43.076045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5285dd5d-008e-44fd-9c15-205a46b57185 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:43.215087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5285dd5d-008e-44fd-9c15-205a46b57185 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:43.223414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5285dd5d-008e-44fd-9c15-205a46b57185 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.159850 Mar 08 04:39:43.223976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1067/2079] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:43.961909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c00e85be-52be-46cb-9a99-9ef2376bb101 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:43.962517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c00e85be-52be-46cb-9a99-9ef2376bb101 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:43.968922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c00e85be-52be-46cb-9a99-9ef2376bb101 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:43.969364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c00e85be-52be-46cb-9a99-9ef2376bb101 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:43.970192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c00e85be-52be-46cb-9a99-9ef2376bb101 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:43.970619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c00e85be-52be-46cb-9a99-9ef2376bb101 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:44.097484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c00e85be-52be-46cb-9a99-9ef2376bb101 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:44.105254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c00e85be-52be-46cb-9a99-9ef2376bb101 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.147144 Mar 08 04:39:44.105784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1013/2080] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:43 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:44.240696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6d600090-4458-410f-8a71-0f81fbff1d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:44.241309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6d600090-4458-410f-8a71-0f81fbff1d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:44.247541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d600090-4458-410f-8a71-0f81fbff1d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:44.247989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d600090-4458-410f-8a71-0f81fbff1d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:44.248760 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d600090-4458-410f-8a71-0f81fbff1d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:44.249197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d600090-4458-410f-8a71-0f81fbff1d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:44.377285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6d600090-4458-410f-8a71-0f81fbff1d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:44.384897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6d600090-4458-410f-8a71-0f81fbff1d62 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148556 Mar 08 04:39:44.385451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1068/2081] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:45.122894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-50f093b4-a9ac-4ad3-a840-ac2ef0c577e3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:45.123508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-50f093b4-a9ac-4ad3-a840-ac2ef0c577e3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:45.130416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-50f093b4-a9ac-4ad3-a840-ac2ef0c577e3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:45.130867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-50f093b4-a9ac-4ad3-a840-ac2ef0c577e3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:45.131632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-50f093b4-a9ac-4ad3-a840-ac2ef0c577e3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:45.132067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-50f093b4-a9ac-4ad3-a840-ac2ef0c577e3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:45.402446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-78d3beaf-7014-4d50-8b34-5fa611748b76 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:45.403311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-78d3beaf-7014-4d50-8b34-5fa611748b76 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:45.409859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78d3beaf-7014-4d50-8b34-5fa611748b76 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:45.410396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78d3beaf-7014-4d50-8b34-5fa611748b76 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:45.411185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78d3beaf-7014-4d50-8b34-5fa611748b76 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:45.411621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78d3beaf-7014-4d50-8b34-5fa611748b76 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:45.526152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-50f093b4-a9ac-4ad3-a840-ac2ef0c577e3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:45.533947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-50f093b4-a9ac-4ad3-a840-ac2ef0c577e3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.414867 Mar 08 04:39:45.534541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1014/2082] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:45 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:45.569044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-78d3beaf-7014-4d50-8b34-5fa611748b76 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:45.576709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-78d3beaf-7014-4d50-8b34-5fa611748b76 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.178536 Mar 08 04:39:45.577270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1069/2083] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:45 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:46.550686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-903abdb9-cf1d-403a-817f-a3be0384593e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:46.551350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-903abdb9-cf1d-403a-817f-a3be0384593e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:46.557445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-903abdb9-cf1d-403a-817f-a3be0384593e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:46.557916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-903abdb9-cf1d-403a-817f-a3be0384593e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:46.558681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-903abdb9-cf1d-403a-817f-a3be0384593e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:46.559113 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-903abdb9-cf1d-403a-817f-a3be0384593e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:46.593903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8738a55e-12b1-4f6f-97c9-c38ea5a47133 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:46.594510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8738a55e-12b1-4f6f-97c9-c38ea5a47133 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:46.601398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8738a55e-12b1-4f6f-97c9-c38ea5a47133 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:46.601901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8738a55e-12b1-4f6f-97c9-c38ea5a47133 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:46.602652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8738a55e-12b1-4f6f-97c9-c38ea5a47133 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:46.603081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8738a55e-12b1-4f6f-97c9-c38ea5a47133 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:46.725864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-903abdb9-cf1d-403a-817f-a3be0384593e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:46.735166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-903abdb9-cf1d-403a-817f-a3be0384593e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.188808 Mar 08 04:39:46.736319 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1015/2084] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:46 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:46.784917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8738a55e-12b1-4f6f-97c9-c38ea5a47133 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:46.792673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8738a55e-12b1-4f6f-97c9-c38ea5a47133 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.202619 Mar 08 04:39:46.793239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1070/2085] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:47.752056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-027f1e17-91cf-403b-b9cd-de41b20eddff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:47.752657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-027f1e17-91cf-403b-b9cd-de41b20eddff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:47.761930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-027f1e17-91cf-403b-b9cd-de41b20eddff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:47.762385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-027f1e17-91cf-403b-b9cd-de41b20eddff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:47.763162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-027f1e17-91cf-403b-b9cd-de41b20eddff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:47.763598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-027f1e17-91cf-403b-b9cd-de41b20eddff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:47.810347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-01475d5c-7980-4752-8771-99cd7e503ab0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:47.810934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-01475d5c-7980-4752-8771-99cd7e503ab0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:47.817758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-01475d5c-7980-4752-8771-99cd7e503ab0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:47.818806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-01475d5c-7980-4752-8771-99cd7e503ab0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:47.818939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-01475d5c-7980-4752-8771-99cd7e503ab0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:47.819305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-01475d5c-7980-4752-8771-99cd7e503ab0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:47.926899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-027f1e17-91cf-403b-b9cd-de41b20eddff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:47.934623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-027f1e17-91cf-403b-b9cd-de41b20eddff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.186393 Mar 08 04:39:47.935199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1016/2086] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:47 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:47.980456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-01475d5c-7980-4752-8771-99cd7e503ab0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:47.988554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-01475d5c-7980-4752-8771-99cd7e503ab0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.182063 Mar 08 04:39:47.989104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1071/2087] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:48.952163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d8ad1b0f-33be-4e95-b100-cfcbcfdc8d8d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:48.952764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d8ad1b0f-33be-4e95-b100-cfcbcfdc8d8d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:48.959770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8ad1b0f-33be-4e95-b100-cfcbcfdc8d8d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:48.960218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8ad1b0f-33be-4e95-b100-cfcbcfdc8d8d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:48.960975 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8ad1b0f-33be-4e95-b100-cfcbcfdc8d8d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:48.961406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8ad1b0f-33be-4e95-b100-cfcbcfdc8d8d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:49.006580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1d58c1b8-c772-4196-8897-bb675167187c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:49.007268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1d58c1b8-c772-4196-8897-bb675167187c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:49.013709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d58c1b8-c772-4196-8897-bb675167187c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:49.014256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d58c1b8-c772-4196-8897-bb675167187c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:49.015098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d58c1b8-c772-4196-8897-bb675167187c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:49.015543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1d58c1b8-c772-4196-8897-bb675167187c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:49.123437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d8ad1b0f-33be-4e95-b100-cfcbcfdc8d8d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:49.131837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d8ad1b0f-33be-4e95-b100-cfcbcfdc8d8d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.183478 Mar 08 04:39:49.132407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1017/2088] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:48 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:49.178587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1d58c1b8-c772-4196-8897-bb675167187c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:49.187538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1d58c1b8-c772-4196-8897-bb675167187c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.185824 Mar 08 04:39:49.188115 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1072/2089] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:50.150488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c896ec1d-5ced-47c9-b3fd-7c9d07a91900 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:50.151070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c896ec1d-5ced-47c9-b3fd-7c9d07a91900 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:50.157276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c896ec1d-5ced-47c9-b3fd-7c9d07a91900 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:50.157759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c896ec1d-5ced-47c9-b3fd-7c9d07a91900 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:50.158522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c896ec1d-5ced-47c9-b3fd-7c9d07a91900 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:50.158957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c896ec1d-5ced-47c9-b3fd-7c9d07a91900 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:50.204956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-89e1458a-b7df-4d98-9231-6c5579d10644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:50.205690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-89e1458a-b7df-4d98-9231-6c5579d10644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:50.212577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89e1458a-b7df-4d98-9231-6c5579d10644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:50.213020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89e1458a-b7df-4d98-9231-6c5579d10644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:50.213815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89e1458a-b7df-4d98-9231-6c5579d10644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:50.214246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-89e1458a-b7df-4d98-9231-6c5579d10644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:50.321939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c896ec1d-5ced-47c9-b3fd-7c9d07a91900 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:50.329899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c896ec1d-5ced-47c9-b3fd-7c9d07a91900 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.183477 Mar 08 04:39:50.339639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1018/2090] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:50 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:50.377486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-89e1458a-b7df-4d98-9231-6c5579d10644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:50.385858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-89e1458a-b7df-4d98-9231-6c5579d10644 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.184675 Mar 08 04:39:50.386421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1073/2091] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:50 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:51.346538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e1723441-61f2-497b-b505-99329ec71925 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:51.347365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e1723441-61f2-497b-b505-99329ec71925 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:51.353690 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1723441-61f2-497b-b505-99329ec71925 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:51.354144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1723441-61f2-497b-b505-99329ec71925 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:51.354904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1723441-61f2-497b-b505-99329ec71925 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:51.355339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1723441-61f2-497b-b505-99329ec71925 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:51.403848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5a95f726-c027-45a3-a950-59fee4a2d8aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:51.404453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5a95f726-c027-45a3-a950-59fee4a2d8aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:51.410738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a95f726-c027-45a3-a950-59fee4a2d8aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:51.411396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a95f726-c027-45a3-a950-59fee4a2d8aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:51.412158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a95f726-c027-45a3-a950-59fee4a2d8aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:51.412591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5a95f726-c027-45a3-a950-59fee4a2d8aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:51.517769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e1723441-61f2-497b-b505-99329ec71925 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:51.527060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e1723441-61f2-497b-b505-99329ec71925 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.183526 Mar 08 04:39:51.527060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1019/2092] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:51 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:51.582437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5a95f726-c027-45a3-a950-59fee4a2d8aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:51.590175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5a95f726-c027-45a3-a950-59fee4a2d8aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.190428 Mar 08 04:39:51.590741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1074/2093] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:52.543363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a6615f48-74b7-4c6e-84d9-b67e5014c4aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:52.543969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a6615f48-74b7-4c6e-84d9-b67e5014c4aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:52.550542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6615f48-74b7-4c6e-84d9-b67e5014c4aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:52.550991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6615f48-74b7-4c6e-84d9-b67e5014c4aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:52.551759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6615f48-74b7-4c6e-84d9-b67e5014c4aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:52.552280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6615f48-74b7-4c6e-84d9-b67e5014c4aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:52.606994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e046db64-9e9a-41aa-ac57-2ecf197740a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:52.607598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e046db64-9e9a-41aa-ac57-2ecf197740a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:52.613865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e046db64-9e9a-41aa-ac57-2ecf197740a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:52.614374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e046db64-9e9a-41aa-ac57-2ecf197740a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:52.615138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e046db64-9e9a-41aa-ac57-2ecf197740a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:52.615578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e046db64-9e9a-41aa-ac57-2ecf197740a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:52.714697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a6615f48-74b7-4c6e-84d9-b67e5014c4aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:52.722388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a6615f48-74b7-4c6e-84d9-b67e5014c4aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.182928 Mar 08 04:39:52.723568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1020/2094] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:52 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:52.781254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e046db64-9e9a-41aa-ac57-2ecf197740a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:52.789761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e046db64-9e9a-41aa-ac57-2ecf197740a7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.186499 Mar 08 04:39:52.790320 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1075/2095] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:53.740489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-17fbc453-76ee-483a-a0fa-c7ece69b11cb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:53.741105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-17fbc453-76ee-483a-a0fa-c7ece69b11cb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:53.747333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-17fbc453-76ee-483a-a0fa-c7ece69b11cb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:53.747781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-17fbc453-76ee-483a-a0fa-c7ece69b11cb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:53.748545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-17fbc453-76ee-483a-a0fa-c7ece69b11cb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:53.748983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-17fbc453-76ee-483a-a0fa-c7ece69b11cb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:53.807638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-425c2a5d-cba4-4765-92a4-c6171dbe30ec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:53.808347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-425c2a5d-cba4-4765-92a4-c6171dbe30ec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:53.814799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-425c2a5d-cba4-4765-92a4-c6171dbe30ec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:53.815257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-425c2a5d-cba4-4765-92a4-c6171dbe30ec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:53.816058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-425c2a5d-cba4-4765-92a4-c6171dbe30ec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:53.817123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-425c2a5d-cba4-4765-92a4-c6171dbe30ec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:53.908757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-17fbc453-76ee-483a-a0fa-c7ece69b11cb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:53.916934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-17fbc453-76ee-483a-a0fa-c7ece69b11cb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.180948 Mar 08 04:39:53.917495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1021/2096] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:53 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:53.972248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-425c2a5d-cba4-4765-92a4-c6171dbe30ec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:53.980585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-425c2a5d-cba4-4765-92a4-c6171dbe30ec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.176803 Mar 08 04:39:53.981146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1076/2097] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:54.934503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-54ffe10f-ff27-40d4-bd43-4a4d3bbb722d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:54.935143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-54ffe10f-ff27-40d4-bd43-4a4d3bbb722d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:54.941364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54ffe10f-ff27-40d4-bd43-4a4d3bbb722d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:54.942421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54ffe10f-ff27-40d4-bd43-4a4d3bbb722d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:54.943185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54ffe10f-ff27-40d4-bd43-4a4d3bbb722d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:54.943628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54ffe10f-ff27-40d4-bd43-4a4d3bbb722d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:54.998402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-609f0222-ab74-4051-8dca-220985206ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:54.999009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-609f0222-ab74-4051-8dca-220985206ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:55.006266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-609f0222-ab74-4051-8dca-220985206ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:55.006716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-609f0222-ab74-4051-8dca-220985206ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:55.007491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-609f0222-ab74-4051-8dca-220985206ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:55.007931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-609f0222-ab74-4051-8dca-220985206ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:55.110930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-54ffe10f-ff27-40d4-bd43-4a4d3bbb722d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:55.119770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-54ffe10f-ff27-40d4-bd43-4a4d3bbb722d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.188993 Mar 08 04:39:55.120428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1022/2098] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:54 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:55.178765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-609f0222-ab74-4051-8dca-220985206ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:55.186496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-609f0222-ab74-4051-8dca-220985206ef6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.191939 Mar 08 04:39:55.187059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1077/2099] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:56.136624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e921154d-9da3-4b2f-a9d9-090e24b12779 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:56.137328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e921154d-9da3-4b2f-a9d9-090e24b12779 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:56.143648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e921154d-9da3-4b2f-a9d9-090e24b12779 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:56.144092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e921154d-9da3-4b2f-a9d9-090e24b12779 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:56.144879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e921154d-9da3-4b2f-a9d9-090e24b12779 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:56.145315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e921154d-9da3-4b2f-a9d9-090e24b12779 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:56.204152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-61219294-db71-463c-b830-2c89b0636f6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:56.204959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-61219294-db71-463c-b830-2c89b0636f6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:56.211556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61219294-db71-463c-b830-2c89b0636f6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:56.212011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61219294-db71-463c-b830-2c89b0636f6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:56.212795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61219294-db71-463c-b830-2c89b0636f6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:56.213235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-61219294-db71-463c-b830-2c89b0636f6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:56.315021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e921154d-9da3-4b2f-a9d9-090e24b12779 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:56.323307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e921154d-9da3-4b2f-a9d9-090e24b12779 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.190837 Mar 08 04:39:56.323926 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1023/2100] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:56 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:56.373691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-61219294-db71-463c-b830-2c89b0636f6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:56.382249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-61219294-db71-463c-b830-2c89b0636f6f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.181820 Mar 08 04:39:56.382810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1078/2101] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:56 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:57.340559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cb0d2190-beaa-4d1c-be9f-b26b92b3803a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:57.341174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cb0d2190-beaa-4d1c-be9f-b26b92b3803a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:57.347422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb0d2190-beaa-4d1c-be9f-b26b92b3803a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:57.348529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb0d2190-beaa-4d1c-be9f-b26b92b3803a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:57.349296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb0d2190-beaa-4d1c-be9f-b26b92b3803a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:57.349760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb0d2190-beaa-4d1c-be9f-b26b92b3803a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:57.399387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-797588dc-8fd3-48fd-a385-91a797d4ade2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:57.399907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-797588dc-8fd3-48fd-a385-91a797d4ade2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:57.406423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-797588dc-8fd3-48fd-a385-91a797d4ade2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:57.406876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-797588dc-8fd3-48fd-a385-91a797d4ade2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:57.407645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-797588dc-8fd3-48fd-a385-91a797d4ade2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:57.408086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-797588dc-8fd3-48fd-a385-91a797d4ade2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:57.516159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cb0d2190-beaa-4d1c-be9f-b26b92b3803a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:57.524739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cb0d2190-beaa-4d1c-be9f-b26b92b3803a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.187966 Mar 08 04:39:57.525596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1024/2102] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:57 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:57.576537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-797588dc-8fd3-48fd-a385-91a797d4ade2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:57.584811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-797588dc-8fd3-48fd-a385-91a797d4ade2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.189388 Mar 08 04:39:57.585371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1079/2103] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:58.542243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ff1f4aec-ed1f-472a-9b37-6d310e2e7e84 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:58.542791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ff1f4aec-ed1f-472a-9b37-6d310e2e7e84 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:58.548954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff1f4aec-ed1f-472a-9b37-6d310e2e7e84 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:58.549395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff1f4aec-ed1f-472a-9b37-6d310e2e7e84 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:58.550170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff1f4aec-ed1f-472a-9b37-6d310e2e7e84 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:58.550605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff1f4aec-ed1f-472a-9b37-6d310e2e7e84 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:58.602372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cd814419-703a-48ab-b5dc-8309c6856b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:58.602981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cd814419-703a-48ab-b5dc-8309c6856b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:58.609100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd814419-703a-48ab-b5dc-8309c6856b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:58.609547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd814419-703a-48ab-b5dc-8309c6856b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:58.610338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd814419-703a-48ab-b5dc-8309c6856b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:58.610772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd814419-703a-48ab-b5dc-8309c6856b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:58.710173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ff1f4aec-ed1f-472a-9b37-6d310e2e7e84 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:58.717850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ff1f4aec-ed1f-472a-9b37-6d310e2e7e84 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.179497 Mar 08 04:39:58.718414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1025/2104] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:58 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:58.772178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cd814419-703a-48ab-b5dc-8309c6856b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:58.780131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cd814419-703a-48ab-b5dc-8309c6856b10 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.182256 Mar 08 04:39:58.780692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1080/2105] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:39:59.735282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e20e7f57-0561-4281-9a6e-c502580676a9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:59.735892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e20e7f57-0561-4281-9a6e-c502580676a9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:59.742359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e20e7f57-0561-4281-9a6e-c502580676a9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:59.742804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e20e7f57-0561-4281-9a6e-c502580676a9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:59.743552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e20e7f57-0561-4281-9a6e-c502580676a9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:59.743984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e20e7f57-0561-4281-9a6e-c502580676a9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:59.797680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-449b209a-41c5-4f43-8148-259f2291288b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:39:59.798297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-449b209a-41c5-4f43-8148-259f2291288b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:39:59.804577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-449b209a-41c5-4f43-8148-259f2291288b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:59.805030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-449b209a-41c5-4f43-8148-259f2291288b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:59.805898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-449b209a-41c5-4f43-8148-259f2291288b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:39:59.806336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-449b209a-41c5-4f43-8148-259f2291288b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:39:59.909380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e20e7f57-0561-4281-9a6e-c502580676a9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:59.917390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e20e7f57-0561-4281-9a6e-c502580676a9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.185849 Mar 08 04:39:59.918287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1026/2106] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:59 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:39:59.970768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-449b209a-41c5-4f43-8148-259f2291288b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:39:59.978602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-449b209a-41c5-4f43-8148-259f2291288b tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.184826 Mar 08 04:39:59.979164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1081/2107] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:39:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:00.933484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-42554925-fc5b-4957-98d6-2aecaee4c737 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:00.934139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-42554925-fc5b-4957-98d6-2aecaee4c737 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:00.940351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-42554925-fc5b-4957-98d6-2aecaee4c737 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:00.940792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-42554925-fc5b-4957-98d6-2aecaee4c737 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:00.941626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-42554925-fc5b-4957-98d6-2aecaee4c737 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:00.942077 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-42554925-fc5b-4957-98d6-2aecaee4c737 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:00.996272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1dbb6ae1-19a8-45b5-afb3-8f0f7c127a4a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:00.996872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1dbb6ae1-19a8-45b5-afb3-8f0f7c127a4a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:01.003262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1dbb6ae1-19a8-45b5-afb3-8f0f7c127a4a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:01.003714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1dbb6ae1-19a8-45b5-afb3-8f0f7c127a4a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:01.004723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1dbb6ae1-19a8-45b5-afb3-8f0f7c127a4a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:01.005157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1dbb6ae1-19a8-45b5-afb3-8f0f7c127a4a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:01.102142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-42554925-fc5b-4957-98d6-2aecaee4c737 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:01.113199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-42554925-fc5b-4957-98d6-2aecaee4c737 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.183326 Mar 08 04:40:01.113828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1027/2108] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:00 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:01.165854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1dbb6ae1-19a8-45b5-afb3-8f0f7c127a4a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:01.173649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1dbb6ae1-19a8-45b5-afb3-8f0f7c127a4a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.181180 Mar 08 04:40:01.174238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1082/2109] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:02.130023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-54cb91b4-b01b-4feb-a964-7c746088fa05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:02.130562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-54cb91b4-b01b-4feb-a964-7c746088fa05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:02.136667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54cb91b4-b01b-4feb-a964-7c746088fa05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:02.137111 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54cb91b4-b01b-4feb-a964-7c746088fa05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:02.137907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54cb91b4-b01b-4feb-a964-7c746088fa05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:02.138340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-54cb91b4-b01b-4feb-a964-7c746088fa05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:02.191448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2adae796-729c-4e41-9c8e-e8d7720a57d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:02.192084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2adae796-729c-4e41-9c8e-e8d7720a57d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:02.198690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2adae796-729c-4e41-9c8e-e8d7720a57d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:02.199135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2adae796-729c-4e41-9c8e-e8d7720a57d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:02.199902 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2adae796-729c-4e41-9c8e-e8d7720a57d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:02.200335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2adae796-729c-4e41-9c8e-e8d7720a57d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:02.300961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-54cb91b4-b01b-4feb-a964-7c746088fa05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:02.309468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-54cb91b4-b01b-4feb-a964-7c746088fa05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.183387 Mar 08 04:40:02.310075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1028/2110] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:02 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:02.362258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2adae796-729c-4e41-9c8e-e8d7720a57d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:02.369912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2adae796-729c-4e41-9c8e-e8d7720a57d6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.182217 Mar 08 04:40:02.370477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1083/2111] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:03.325716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6970b02b-5c02-4fae-b6f7-a1c996a726ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:03.326341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6970b02b-5c02-4fae-b6f7-a1c996a726ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:03.332517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6970b02b-5c02-4fae-b6f7-a1c996a726ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:03.333504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6970b02b-5c02-4fae-b6f7-a1c996a726ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:03.334291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6970b02b-5c02-4fae-b6f7-a1c996a726ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:03.334723 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6970b02b-5c02-4fae-b6f7-a1c996a726ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:03.386905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e0c5dbff-72ce-4d8d-88d2-54b017f0d2b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:03.387515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e0c5dbff-72ce-4d8d-88d2-54b017f0d2b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:03.393875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0c5dbff-72ce-4d8d-88d2-54b017f0d2b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:03.394337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0c5dbff-72ce-4d8d-88d2-54b017f0d2b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:03.395107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0c5dbff-72ce-4d8d-88d2-54b017f0d2b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:03.396395 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0c5dbff-72ce-4d8d-88d2-54b017f0d2b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:03.499601 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6970b02b-5c02-4fae-b6f7-a1c996a726ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:03.508135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6970b02b-5c02-4fae-b6f7-a1c996a726ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.186286 Mar 08 04:40:03.508699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1029/2112] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:03 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:03.561814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e0c5dbff-72ce-4d8d-88d2-54b017f0d2b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:03.569920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e0c5dbff-72ce-4d8d-88d2-54b017f0d2b2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.186888 Mar 08 04:40:03.570554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1084/2113] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:04.524587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7afc42ca-473f-4d09-9267-590105b01858 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:04.525447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7afc42ca-473f-4d09-9267-590105b01858 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:04.531534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7afc42ca-473f-4d09-9267-590105b01858 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:04.531980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7afc42ca-473f-4d09-9267-590105b01858 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:04.532745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7afc42ca-473f-4d09-9267-590105b01858 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:04.533176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7afc42ca-473f-4d09-9267-590105b01858 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:04.590280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-70d022e7-c721-4ebb-9ec7-7576ef8215bd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:04.591591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-70d022e7-c721-4ebb-9ec7-7576ef8215bd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:04.597969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-70d022e7-c721-4ebb-9ec7-7576ef8215bd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:04.598442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-70d022e7-c721-4ebb-9ec7-7576ef8215bd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:04.599254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-70d022e7-c721-4ebb-9ec7-7576ef8215bd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:04.599689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-70d022e7-c721-4ebb-9ec7-7576ef8215bd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:04.700030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7afc42ca-473f-4d09-9267-590105b01858 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:04.707801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7afc42ca-473f-4d09-9267-590105b01858 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.187399 Mar 08 04:40:04.708739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1030/2114] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:04 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:04.766938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-70d022e7-c721-4ebb-9ec7-7576ef8215bd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:04.774772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-70d022e7-c721-4ebb-9ec7-7576ef8215bd tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.189101 Mar 08 04:40:04.775608 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1085/2115] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:05.725320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-970ece34-a36e-4e65-8aa5-928d252c2bdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:05.725938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-970ece34-a36e-4e65-8aa5-928d252c2bdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:05.732109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-970ece34-a36e-4e65-8aa5-928d252c2bdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:05.732558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-970ece34-a36e-4e65-8aa5-928d252c2bdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:05.733337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-970ece34-a36e-4e65-8aa5-928d252c2bdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:05.733777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-970ece34-a36e-4e65-8aa5-928d252c2bdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:05.792815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-aded286a-4e52-41d8-b505-0d279ad0f09c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:05.793452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-aded286a-4e52-41d8-b505-0d279ad0f09c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:05.799657 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aded286a-4e52-41d8-b505-0d279ad0f09c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:05.800133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aded286a-4e52-41d8-b505-0d279ad0f09c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:05.800910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aded286a-4e52-41d8-b505-0d279ad0f09c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:05.801346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aded286a-4e52-41d8-b505-0d279ad0f09c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:05.895148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-970ece34-a36e-4e65-8aa5-928d252c2bdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:05.903604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-970ece34-a36e-4e65-8aa5-928d252c2bdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.182607 Mar 08 04:40:05.904172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1031/2116] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:05 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:05.956764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-aded286a-4e52-41d8-b505-0d279ad0f09c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:05.964404 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-aded286a-4e52-41d8-b505-0d279ad0f09c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.175451 Mar 08 04:40:05.964967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1086/2117] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:06.923006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6d9051c9-7644-4818-b307-1f8cf4028111 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:06.923006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6d9051c9-7644-4818-b307-1f8cf4028111 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:06.929201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d9051c9-7644-4818-b307-1f8cf4028111 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:06.929650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d9051c9-7644-4818-b307-1f8cf4028111 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:06.930447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d9051c9-7644-4818-b307-1f8cf4028111 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:06.930886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d9051c9-7644-4818-b307-1f8cf4028111 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:06.981936 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-07740a08-f8d1-4727-b2c7-f85f823c25b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:06.982672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-07740a08-f8d1-4727-b2c7-f85f823c25b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:06.988891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07740a08-f8d1-4727-b2c7-f85f823c25b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:06.989340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07740a08-f8d1-4727-b2c7-f85f823c25b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:06.990132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07740a08-f8d1-4727-b2c7-f85f823c25b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:06.990636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07740a08-f8d1-4727-b2c7-f85f823c25b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:07.095681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6d9051c9-7644-4818-b307-1f8cf4028111 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:07.104161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6d9051c9-7644-4818-b307-1f8cf4028111 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.186220 Mar 08 04:40:07.104760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1032/2118] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:06 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:07.153679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-07740a08-f8d1-4727-b2c7-f85f823c25b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:07.161302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-07740a08-f8d1-4727-b2c7-f85f823c25b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.183176 Mar 08 04:40:07.161893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1087/2119] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:08.120144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ed1591e9-4fe2-4f0e-9055-d6fdc945b2ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:08.120754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ed1591e9-4fe2-4f0e-9055-d6fdc945b2ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:08.127013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed1591e9-4fe2-4f0e-9055-d6fdc945b2ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:08.127461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed1591e9-4fe2-4f0e-9055-d6fdc945b2ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:08.128221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed1591e9-4fe2-4f0e-9055-d6fdc945b2ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:08.128658 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed1591e9-4fe2-4f0e-9055-d6fdc945b2ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:08.260978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ed1591e9-4fe2-4f0e-9055-d6fdc945b2ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:08.268836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ed1591e9-4fe2-4f0e-9055-d6fdc945b2ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152507 Mar 08 04:40:08.269405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1033/2120] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:08 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:08.298669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2ac4dfdb-bb9a-4988-91fb-4225436ce958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:08.299284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2ac4dfdb-bb9a-4988-91fb-4225436ce958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:08.305706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ac4dfdb-bb9a-4988-91fb-4225436ce958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:08.306153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ac4dfdb-bb9a-4988-91fb-4225436ce958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:08.306918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ac4dfdb-bb9a-4988-91fb-4225436ce958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:08.307357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ac4dfdb-bb9a-4988-91fb-4225436ce958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:08.438556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2ac4dfdb-bb9a-4988-91fb-4225436ce958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:08.446777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2ac4dfdb-bb9a-4988-91fb-4225436ce958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.271573 Mar 08 04:40:08.447345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1088/2121] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:08 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:09.286956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-389c8fa4-cdde-4ec1-b0d2-d527d8fc637a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:09.288271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-389c8fa4-cdde-4ec1-b0d2-d527d8fc637a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:09.294451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-389c8fa4-cdde-4ec1-b0d2-d527d8fc637a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:09.294895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-389c8fa4-cdde-4ec1-b0d2-d527d8fc637a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:09.295648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-389c8fa4-cdde-4ec1-b0d2-d527d8fc637a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:09.296078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-389c8fa4-cdde-4ec1-b0d2-d527d8fc637a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:09.426689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-389c8fa4-cdde-4ec1-b0d2-d527d8fc637a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:09.434418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-389c8fa4-cdde-4ec1-b0d2-d527d8fc637a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151263 Mar 08 04:40:09.434980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1034/2122] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:09 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:09.463680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4f8834d3-9239-49f1-9077-1f99f3ccf033 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:09.464283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4f8834d3-9239-49f1-9077-1f99f3ccf033 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:09.470598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f8834d3-9239-49f1-9077-1f99f3ccf033 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:09.471049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f8834d3-9239-49f1-9077-1f99f3ccf033 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:09.471811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f8834d3-9239-49f1-9077-1f99f3ccf033 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:09.472248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f8834d3-9239-49f1-9077-1f99f3ccf033 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:09.604003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4f8834d3-9239-49f1-9077-1f99f3ccf033 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:09.611648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4f8834d3-9239-49f1-9077-1f99f3ccf033 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152509 Mar 08 04:40:09.612216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1089/2123] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:09 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:10.450900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ed4cec0d-3dba-4318-83c2-eeef576442bd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:10.451508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ed4cec0d-3dba-4318-83c2-eeef576442bd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:10.457746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed4cec0d-3dba-4318-83c2-eeef576442bd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:10.458197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed4cec0d-3dba-4318-83c2-eeef576442bd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:10.459540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed4cec0d-3dba-4318-83c2-eeef576442bd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:10.459988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed4cec0d-3dba-4318-83c2-eeef576442bd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:10.594835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ed4cec0d-3dba-4318-83c2-eeef576442bd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:10.602528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ed4cec0d-3dba-4318-83c2-eeef576442bd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155437 Mar 08 04:40:10.603085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1035/2124] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:10 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:10.628134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-66086ae4-f7b8-4f0c-9247-0a34047f71aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:10.628740 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-66086ae4-f7b8-4f0c-9247-0a34047f71aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:10.635623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66086ae4-f7b8-4f0c-9247-0a34047f71aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:10.636063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66086ae4-f7b8-4f0c-9247-0a34047f71aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:10.636818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66086ae4-f7b8-4f0c-9247-0a34047f71aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:10.637251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66086ae4-f7b8-4f0c-9247-0a34047f71aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:10.766996 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-66086ae4-f7b8-4f0c-9247-0a34047f71aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:10.774739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-66086ae4-f7b8-4f0c-9247-0a34047f71aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150421 Mar 08 04:40:10.775575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1090/2125] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:10 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:11.620109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-476cdc65-832c-4e3b-88c7-c95b4bc5d5f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:11.620637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-476cdc65-832c-4e3b-88c7-c95b4bc5d5f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:11.627019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-476cdc65-832c-4e3b-88c7-c95b4bc5d5f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:11.627469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-476cdc65-832c-4e3b-88c7-c95b4bc5d5f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:11.628227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-476cdc65-832c-4e3b-88c7-c95b4bc5d5f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:11.628663 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-476cdc65-832c-4e3b-88c7-c95b4bc5d5f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:11.764793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-476cdc65-832c-4e3b-88c7-c95b4bc5d5f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:11.773362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-476cdc65-832c-4e3b-88c7-c95b4bc5d5f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.157219 Mar 08 04:40:11.773951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1036/2126] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:11 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:11.792906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-34f30d0a-9763-423a-a13a-7f0771192d30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:11.793507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-34f30d0a-9763-423a-a13a-7f0771192d30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:11.799506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-34f30d0a-9763-423a-a13a-7f0771192d30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:11.799977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-34f30d0a-9763-423a-a13a-7f0771192d30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:11.800725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-34f30d0a-9763-423a-a13a-7f0771192d30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:11.801155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-34f30d0a-9763-423a-a13a-7f0771192d30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:11.930650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-34f30d0a-9763-423a-a13a-7f0771192d30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:11.938327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-34f30d0a-9763-423a-a13a-7f0771192d30 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.150976 Mar 08 04:40:11.938893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1091/2127] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:12.790657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-97a5bf22-7dcf-46a4-9565-5b4684630178 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:12.791330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-97a5bf22-7dcf-46a4-9565-5b4684630178 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:12.797530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97a5bf22-7dcf-46a4-9565-5b4684630178 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:12.798007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97a5bf22-7dcf-46a4-9565-5b4684630178 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:12.798763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97a5bf22-7dcf-46a4-9565-5b4684630178 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:12.799193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97a5bf22-7dcf-46a4-9565-5b4684630178 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:12.937289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-97a5bf22-7dcf-46a4-9565-5b4684630178 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:12.945034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-97a5bf22-7dcf-46a4-9565-5b4684630178 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.158823 Mar 08 04:40:12.945588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1037/2128] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:12 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:12.955921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c4e021cd-34b9-4d0b-84f2-3402874b8fee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:12.956554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c4e021cd-34b9-4d0b-84f2-3402874b8fee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:12.963366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4e021cd-34b9-4d0b-84f2-3402874b8fee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:12.963809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4e021cd-34b9-4d0b-84f2-3402874b8fee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:12.964566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4e021cd-34b9-4d0b-84f2-3402874b8fee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:12.965002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c4e021cd-34b9-4d0b-84f2-3402874b8fee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:13.098229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c4e021cd-34b9-4d0b-84f2-3402874b8fee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:13.106207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c4e021cd-34b9-4d0b-84f2-3402874b8fee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154023 Mar 08 04:40:13.106815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1092/2129] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:12 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:13.962680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-914e1b4d-4d53-4922-8662-38afa353a801 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:13.963296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-914e1b4d-4d53-4922-8662-38afa353a801 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:13.969704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-914e1b4d-4d53-4922-8662-38afa353a801 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:13.970160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-914e1b4d-4d53-4922-8662-38afa353a801 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:13.970928 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-914e1b4d-4d53-4922-8662-38afa353a801 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:13.971366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-914e1b4d-4d53-4922-8662-38afa353a801 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:14.099988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-914e1b4d-4d53-4922-8662-38afa353a801 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:14.107840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-914e1b4d-4d53-4922-8662-38afa353a801 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149565 Mar 08 04:40:14.108407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1038/2130] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:13 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:14.124106 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-91d8ff99-589a-4766-a583-4ad30c5d8d1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:14.124718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-91d8ff99-589a-4766-a583-4ad30c5d8d1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:14.131610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d8ff99-589a-4766-a583-4ad30c5d8d1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:14.132138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d8ff99-589a-4766-a583-4ad30c5d8d1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:14.132900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d8ff99-589a-4766-a583-4ad30c5d8d1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:14.133336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91d8ff99-589a-4766-a583-4ad30c5d8d1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:14.276166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-91d8ff99-589a-4766-a583-4ad30c5d8d1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:14.283721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-91d8ff99-589a-4766-a583-4ad30c5d8d1c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.163394 Mar 08 04:40:14.284282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1093/2131] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:14 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:15.124301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d4842052-2f33-4707-9cb2-57cc51e8e4e5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:15.124908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d4842052-2f33-4707-9cb2-57cc51e8e4e5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:15.131182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4842052-2f33-4707-9cb2-57cc51e8e4e5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:15.131622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4842052-2f33-4707-9cb2-57cc51e8e4e5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:15.132384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4842052-2f33-4707-9cb2-57cc51e8e4e5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:15.132807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4842052-2f33-4707-9cb2-57cc51e8e4e5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:15.262770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d4842052-2f33-4707-9cb2-57cc51e8e4e5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:15.270315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d4842052-2f33-4707-9cb2-57cc51e8e4e5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149771 Mar 08 04:40:15.270868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1039/2132] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:15 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:15.300620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d7d01980-fe49-49c9-b7cd-d3367bc1d3ee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:15.301236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d7d01980-fe49-49c9-b7cd-d3367bc1d3ee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:15.307648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7d01980-fe49-49c9-b7cd-d3367bc1d3ee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:15.308103 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7d01980-fe49-49c9-b7cd-d3367bc1d3ee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:15.308867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7d01980-fe49-49c9-b7cd-d3367bc1d3ee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:15.309307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7d01980-fe49-49c9-b7cd-d3367bc1d3ee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:15.443624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d7d01980-fe49-49c9-b7cd-d3367bc1d3ee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:15.451190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d7d01980-fe49-49c9-b7cd-d3367bc1d3ee tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.154439 Mar 08 04:40:15.451748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1094/2133] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:15 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:16.288496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3f321945-601d-4a17-9f8b-54f884eaecb4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:16.289104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3f321945-601d-4a17-9f8b-54f884eaecb4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:16.295265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f321945-601d-4a17-9f8b-54f884eaecb4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:16.295709 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f321945-601d-4a17-9f8b-54f884eaecb4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:16.296458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f321945-601d-4a17-9f8b-54f884eaecb4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:16.296885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f321945-601d-4a17-9f8b-54f884eaecb4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:16.423706 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3f321945-601d-4a17-9f8b-54f884eaecb4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:16.432278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3f321945-601d-4a17-9f8b-54f884eaecb4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.148520 Mar 08 04:40:16.432845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1040/2134] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:16 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:16.468079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-991c7379-e261-4f4f-b278-467c6975e434 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:16.468690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-991c7379-e261-4f4f-b278-467c6975e434 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:16.475470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-991c7379-e261-4f4f-b278-467c6975e434 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:16.475924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-991c7379-e261-4f4f-b278-467c6975e434 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:16.476709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-991c7379-e261-4f4f-b278-467c6975e434 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:16.477145 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-991c7379-e261-4f4f-b278-467c6975e434 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:16.605727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-991c7379-e261-4f4f-b278-467c6975e434 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:16.613322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-991c7379-e261-4f4f-b278-467c6975e434 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.149055 Mar 08 04:40:16.613915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1095/2135] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:16 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:17.449629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e7880873-19bc-411f-987f-be88dc47d6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:17.450263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e7880873-19bc-411f-987f-be88dc47d6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:17.456437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7880873-19bc-411f-987f-be88dc47d6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:17.456879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7880873-19bc-411f-987f-be88dc47d6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:17.457640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7880873-19bc-411f-987f-be88dc47d6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:17.458095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7880873-19bc-411f-987f-be88dc47d6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:17.589349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e7880873-19bc-411f-987f-be88dc47d6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:17.596959 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e7880873-19bc-411f-987f-be88dc47d6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151130 Mar 08 04:40:17.597514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1041/2136] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:17 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:17.632409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-48d5f5d1-e262-43e8-85c5-5463530beb45 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:17.633012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-48d5f5d1-e262-43e8-85c5-5463530beb45 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:17.639193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48d5f5d1-e262-43e8-85c5-5463530beb45 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:17.639637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48d5f5d1-e262-43e8-85c5-5463530beb45 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:17.640391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48d5f5d1-e262-43e8-85c5-5463530beb45 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:17.640819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48d5f5d1-e262-43e8-85c5-5463530beb45 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:17.768902 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-48d5f5d1-e262-43e8-85c5-5463530beb45 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:17.776920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-48d5f5d1-e262-43e8-85c5-5463530beb45 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.148919 Mar 08 04:40:17.777488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1096/2137] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:17 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:18.613422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f681755b-fa97-4408-85db-c14bafee8287 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:18.613999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f681755b-fa97-4408-85db-c14bafee8287 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:18.620288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f681755b-fa97-4408-85db-c14bafee8287 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:18.620766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f681755b-fa97-4408-85db-c14bafee8287 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:18.621518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f681755b-fa97-4408-85db-c14bafee8287 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:18.621970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f681755b-fa97-4408-85db-c14bafee8287 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:18.755141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f681755b-fa97-4408-85db-c14bafee8287 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:18.763355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f681755b-fa97-4408-85db-c14bafee8287 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153840 Mar 08 04:40:18.763923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1042/2138] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:18 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:18.794301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e363bc8f-2995-4860-be5c-d1aebdf41da7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:18.794921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e363bc8f-2995-4860-be5c-d1aebdf41da7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:18.801294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e363bc8f-2995-4860-be5c-d1aebdf41da7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:18.801776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e363bc8f-2995-4860-be5c-d1aebdf41da7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:18.803094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e363bc8f-2995-4860-be5c-d1aebdf41da7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:18.803641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e363bc8f-2995-4860-be5c-d1aebdf41da7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:18.934713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e363bc8f-2995-4860-be5c-d1aebdf41da7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:18.942371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e363bc8f-2995-4860-be5c-d1aebdf41da7 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.152191 Mar 08 04:40:18.942950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1097/2139] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:18 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:19.780945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-56faad17-ab6a-4036-b20e-6e568cce16fd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:19.781484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-56faad17-ab6a-4036-b20e-6e568cce16fd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:19.787819 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56faad17-ab6a-4036-b20e-6e568cce16fd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:19.788263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56faad17-ab6a-4036-b20e-6e568cce16fd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:19.789015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56faad17-ab6a-4036-b20e-6e568cce16fd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:19.789444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56faad17-ab6a-4036-b20e-6e568cce16fd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:19.960985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-69ad6796-dd40-4f91-ad46-c1f02f8f334e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:19.961879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-69ad6796-dd40-4f91-ad46-c1f02f8f334e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:19.968097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69ad6796-dd40-4f91-ad46-c1f02f8f334e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:19.968651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69ad6796-dd40-4f91-ad46-c1f02f8f334e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:19.969422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69ad6796-dd40-4f91-ad46-c1f02f8f334e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:19.969888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69ad6796-dd40-4f91-ad46-c1f02f8f334e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:20.144846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-56faad17-ab6a-4036-b20e-6e568cce16fd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:20.148498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-69ad6796-dd40-4f91-ad46-c1f02f8f334e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:20.153543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-56faad17-ab6a-4036-b20e-6e568cce16fd tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.376436 Mar 08 04:40:20.154282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1043/2140] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:19 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:20.156771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-69ad6796-dd40-4f91-ad46-c1f02f8f334e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.201186 Mar 08 04:40:20.157528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1098/2141] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:19 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:21.171011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a29c96ce-51b7-417a-a927-0eaeef102016 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:21.171623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a29c96ce-51b7-417a-a927-0eaeef102016 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:21.173525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9a7150a6-6f3b-40a1-8526-1d885d2cd8da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:21.174155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9a7150a6-6f3b-40a1-8526-1d885d2cd8da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:21.178004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a29c96ce-51b7-417a-a927-0eaeef102016 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:21.178425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a29c96ce-51b7-417a-a927-0eaeef102016 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:21.179199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a29c96ce-51b7-417a-a927-0eaeef102016 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:21.179630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a29c96ce-51b7-417a-a927-0eaeef102016 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:21.180408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a7150a6-6f3b-40a1-8526-1d885d2cd8da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:21.180855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a7150a6-6f3b-40a1-8526-1d885d2cd8da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:21.181610 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a7150a6-6f3b-40a1-8526-1d885d2cd8da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:21.182067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a7150a6-6f3b-40a1-8526-1d885d2cd8da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:21.380018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9a7150a6-6f3b-40a1-8526-1d885d2cd8da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:21.383403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a29c96ce-51b7-417a-a927-0eaeef102016 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:21.387657 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9a7150a6-6f3b-40a1-8526-1d885d2cd8da tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.217914 Mar 08 04:40:21.388224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1099/2142] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:21 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:21.391339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a29c96ce-51b7-417a-a927-0eaeef102016 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.224219 Mar 08 04:40:21.391875 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1044/2143] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:21 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:22.406175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d5ec859b-ee3e-499b-bc95-b51eeb9d8a79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:22.406757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d5ec859b-ee3e-499b-bc95-b51eeb9d8a79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:22.407859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-80e71fe4-dadd-4c7d-a1df-a76e65493a2a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:22.408462 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-80e71fe4-dadd-4c7d-a1df-a76e65493a2a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:22.413213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5ec859b-ee3e-499b-bc95-b51eeb9d8a79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:22.413683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5ec859b-ee3e-499b-bc95-b51eeb9d8a79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:22.414462 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5ec859b-ee3e-499b-bc95-b51eeb9d8a79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:22.414606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80e71fe4-dadd-4c7d-a1df-a76e65493a2a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:22.414899 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5ec859b-ee3e-499b-bc95-b51eeb9d8a79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:22.415050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80e71fe4-dadd-4c7d-a1df-a76e65493a2a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:22.416582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80e71fe4-dadd-4c7d-a1df-a76e65493a2a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:22.417033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80e71fe4-dadd-4c7d-a1df-a76e65493a2a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:22.613387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-80e71fe4-dadd-4c7d-a1df-a76e65493a2a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:22.616638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d5ec859b-ee3e-499b-bc95-b51eeb9d8a79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:22.621838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-80e71fe4-dadd-4c7d-a1df-a76e65493a2a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.217593 Mar 08 04:40:22.622535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1045/2144] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:22 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:22.624993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d5ec859b-ee3e-499b-bc95-b51eeb9d8a79 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.222606 Mar 08 04:40:22.625557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1100/2145] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:22 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:23.639389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8d758b7d-6252-4fec-93a3-a68a6c5833ac tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:23.640009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8d758b7d-6252-4fec-93a3-a68a6c5833ac tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:23.642286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-00c35824-b116-4652-b2c4-255e5caae7fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:23.642903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-00c35824-b116-4652-b2c4-255e5caae7fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:23.646240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d758b7d-6252-4fec-93a3-a68a6c5833ac tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:23.646677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d758b7d-6252-4fec-93a3-a68a6c5833ac tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:23.647440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d758b7d-6252-4fec-93a3-a68a6c5833ac tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:23.647869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d758b7d-6252-4fec-93a3-a68a6c5833ac tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:23.649162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00c35824-b116-4652-b2c4-255e5caae7fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:23.649607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00c35824-b116-4652-b2c4-255e5caae7fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:23.651487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00c35824-b116-4652-b2c4-255e5caae7fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:23.651919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00c35824-b116-4652-b2c4-255e5caae7fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:23.837409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8d758b7d-6252-4fec-93a3-a68a6c5833ac tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:23.845087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8d758b7d-6252-4fec-93a3-a68a6c5833ac tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.209646 Mar 08 04:40:23.845848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1046/2146] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:23 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:23.848896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-00c35824-b116-4652-b2c4-255e5caae7fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:23.856942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-00c35824-b116-4652-b2c4-255e5caae7fe tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.218430 Mar 08 04:40:23.857504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1101/2147] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:23 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:24.862101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cb2451bd-9291-4bf0-b5a1-38e150cee0a6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:24.862714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cb2451bd-9291-4bf0-b5a1-38e150cee0a6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:24.868898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb2451bd-9291-4bf0-b5a1-38e150cee0a6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:24.869352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb2451bd-9291-4bf0-b5a1-38e150cee0a6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:24.870128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb2451bd-9291-4bf0-b5a1-38e150cee0a6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:24.870552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb2451bd-9291-4bf0-b5a1-38e150cee0a6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:24.873475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9013e398-9cde-4634-9169-0d5e621a9330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:24.874118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9013e398-9cde-4634-9169-0d5e621a9330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:24.880304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9013e398-9cde-4634-9169-0d5e621a9330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:24.880762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9013e398-9cde-4634-9169-0d5e621a9330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:24.881529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9013e398-9cde-4634-9169-0d5e621a9330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:24.881996 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9013e398-9cde-4634-9169-0d5e621a9330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:25.069258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cb2451bd-9291-4bf0-b5a1-38e150cee0a6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:25.072953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9013e398-9cde-4634-9169-0d5e621a9330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:25.077766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cb2451bd-9291-4bf0-b5a1-38e150cee0a6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219449 Mar 08 04:40:25.078332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1047/2148] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:24 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:25.081251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9013e398-9cde-4634-9169-0d5e621a9330 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.211766 Mar 08 04:40:25.081834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1102/2149] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:24 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:26.095364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cf73c21a-61a8-42d4-829c-c927f3365752 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:26.095961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cf73c21a-61a8-42d4-829c-c927f3365752 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:26.098335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-415f7c79-c26a-489b-a036-698aa485a958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:26.098943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-415f7c79-c26a-489b-a036-698aa485a958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:26.102287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf73c21a-61a8-42d4-829c-c927f3365752 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:26.102734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf73c21a-61a8-42d4-829c-c927f3365752 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:26.103517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf73c21a-61a8-42d4-829c-c927f3365752 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:26.104544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf73c21a-61a8-42d4-829c-c927f3365752 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:26.105566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-415f7c79-c26a-489b-a036-698aa485a958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:26.106042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-415f7c79-c26a-489b-a036-698aa485a958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:26.106799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-415f7c79-c26a-489b-a036-698aa485a958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:26.107234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-415f7c79-c26a-489b-a036-698aa485a958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:26.296222 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cf73c21a-61a8-42d4-829c-c927f3365752 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:26.302160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-415f7c79-c26a-489b-a036-698aa485a958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:26.303260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cf73c21a-61a8-42d4-829c-c927f3365752 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.211835 Mar 08 04:40:26.303820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1048/2150] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:26 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:26.310926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-415f7c79-c26a-489b-a036-698aa485a958 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.216354 Mar 08 04:40:26.311492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1103/2151] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:26 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:27.320231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1e12e08a-d020-448d-822b-e3b8c7598cc6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:27.320841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1e12e08a-d020-448d-822b-e3b8c7598cc6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:27.327557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e12e08a-d020-448d-822b-e3b8c7598cc6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:27.328002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e12e08a-d020-448d-822b-e3b8c7598cc6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:27.328124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-683da18c-9213-41cd-b2b3-48dfff61804a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:27.328699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-683da18c-9213-41cd-b2b3-48dfff61804a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:27.328859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e12e08a-d020-448d-822b-e3b8c7598cc6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:27.329181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1e12e08a-d020-448d-822b-e3b8c7598cc6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:27.334853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-683da18c-9213-41cd-b2b3-48dfff61804a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:27.335297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-683da18c-9213-41cd-b2b3-48dfff61804a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:27.336060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-683da18c-9213-41cd-b2b3-48dfff61804a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:27.336493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-683da18c-9213-41cd-b2b3-48dfff61804a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:27.526180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1e12e08a-d020-448d-822b-e3b8c7598cc6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:27.529343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-683da18c-9213-41cd-b2b3-48dfff61804a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:27.533950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1e12e08a-d020-448d-822b-e3b8c7598cc6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.217455 Mar 08 04:40:27.534667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1049/2152] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:27 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:27.537775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-683da18c-9213-41cd-b2b3-48dfff61804a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.213502 Mar 08 04:40:27.538332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1104/2153] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:27 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:28.551462 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e60a13bb-390a-461a-a02e-accf77cab12a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:28.552074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e60a13bb-390a-461a-a02e-accf77cab12a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:28.554647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3393e701-6e3f-40d7-a2cb-4ac292ae79d1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:28.555254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3393e701-6e3f-40d7-a2cb-4ac292ae79d1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:28.558787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e60a13bb-390a-461a-a02e-accf77cab12a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:28.559233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e60a13bb-390a-461a-a02e-accf77cab12a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:28.559992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e60a13bb-390a-461a-a02e-accf77cab12a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:28.560418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e60a13bb-390a-461a-a02e-accf77cab12a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:28.561388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3393e701-6e3f-40d7-a2cb-4ac292ae79d1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:28.561881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3393e701-6e3f-40d7-a2cb-4ac292ae79d1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:28.562646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3393e701-6e3f-40d7-a2cb-4ac292ae79d1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:28.563088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3393e701-6e3f-40d7-a2cb-4ac292ae79d1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:28.980526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e60a13bb-390a-461a-a02e-accf77cab12a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:28.983643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3393e701-6e3f-40d7-a2cb-4ac292ae79d1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:28.988205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e60a13bb-390a-461a-a02e-accf77cab12a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.440521 Mar 08 04:40:28.989157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1050/2154] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:28 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:28.991439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3393e701-6e3f-40d7-a2cb-4ac292ae79d1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.440560 Mar 08 04:40:28.991993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1105/2155] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:28 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:30.006038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9d9323d0-2458-4e89-ac98-05ecb433c0ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:30.006750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9d9323d0-2458-4e89-ac98-05ecb433c0ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:30.008680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fb32687e-c3f1-44f1-867d-8763ad04cc57 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:30.009283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fb32687e-c3f1-44f1-867d-8763ad04cc57 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:30.014158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d9323d0-2458-4e89-ac98-05ecb433c0ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:30.014613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d9323d0-2458-4e89-ac98-05ecb433c0ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:30.015389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d9323d0-2458-4e89-ac98-05ecb433c0ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:30.015825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d9323d0-2458-4e89-ac98-05ecb433c0ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:30.016360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb32687e-c3f1-44f1-867d-8763ad04cc57 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:30.016807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb32687e-c3f1-44f1-867d-8763ad04cc57 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:30.017581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb32687e-c3f1-44f1-867d-8763ad04cc57 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:30.018040 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fb32687e-c3f1-44f1-867d-8763ad04cc57 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:30.208813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9d9323d0-2458-4e89-ac98-05ecb433c0ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:30.212581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fb32687e-c3f1-44f1-867d-8763ad04cc57 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:30.217518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9d9323d0-2458-4e89-ac98-05ecb433c0ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.215351 Mar 08 04:40:30.218109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1051/2156] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:30 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:30.221019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fb32687e-c3f1-44f1-867d-8763ad04cc57 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.216076 Mar 08 04:40:30.221802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1106/2157] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:30 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:31.235257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-27c003cc-073d-45e6-8726-408736c52f89 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:31.235889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-27c003cc-073d-45e6-8726-408736c52f89 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:31.238053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a67fa7f0-07e1-4a18-81dd-26fbe3c650f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:31.238662 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a67fa7f0-07e1-4a18-81dd-26fbe3c650f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:31.242177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27c003cc-073d-45e6-8726-408736c52f89 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:31.242625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27c003cc-073d-45e6-8726-408736c52f89 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:31.243389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27c003cc-073d-45e6-8726-408736c52f89 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:31.243821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27c003cc-073d-45e6-8726-408736c52f89 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:31.244906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a67fa7f0-07e1-4a18-81dd-26fbe3c650f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:31.245347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a67fa7f0-07e1-4a18-81dd-26fbe3c650f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:31.246136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a67fa7f0-07e1-4a18-81dd-26fbe3c650f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:31.246571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a67fa7f0-07e1-4a18-81dd-26fbe3c650f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:31.440082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-27c003cc-073d-45e6-8726-408736c52f89 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:31.443217 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a67fa7f0-07e1-4a18-81dd-26fbe3c650f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:31.447899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-27c003cc-073d-45e6-8726-408736c52f89 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.216594 Mar 08 04:40:31.448458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1052/2158] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:31 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:31.451046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a67fa7f0-07e1-4a18-81dd-26fbe3c650f1 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.216737 Mar 08 04:40:31.451754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1107/2159] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:31 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:32.464916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-94da09d3-00b7-485a-a44e-db7da2c7cb73 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:32.465501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-94da09d3-00b7-485a-a44e-db7da2c7cb73 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:32.468245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5b5790a4-6430-4385-b6a5-1da9e067fca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:32.468864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5b5790a4-6430-4385-b6a5-1da9e067fca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:32.471806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94da09d3-00b7-485a-a44e-db7da2c7cb73 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:32.472253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94da09d3-00b7-485a-a44e-db7da2c7cb73 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:32.473012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94da09d3-00b7-485a-a44e-db7da2c7cb73 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:32.473439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94da09d3-00b7-485a-a44e-db7da2c7cb73 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:32.475234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b5790a4-6430-4385-b6a5-1da9e067fca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:32.475688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b5790a4-6430-4385-b6a5-1da9e067fca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:32.476452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b5790a4-6430-4385-b6a5-1da9e067fca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:32.476891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b5790a4-6430-4385-b6a5-1da9e067fca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:32.672619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-94da09d3-00b7-485a-a44e-db7da2c7cb73 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:32.675872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5b5790a4-6430-4385-b6a5-1da9e067fca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:32.680373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-94da09d3-00b7-485a-a44e-db7da2c7cb73 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219932 Mar 08 04:40:32.680930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1053/2160] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:32 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:32.684379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5b5790a4-6430-4385-b6a5-1da9e067fca0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.219852 Mar 08 04:40:32.684940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1108/2161] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:32 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:33.698042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-615c3dd9-1fb5-498b-a6f1-93d972933a61 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:33.698692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-615c3dd9-1fb5-498b-a6f1-93d972933a61 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:33.700651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-782fc25a-2fa5-4235-8b58-5428af1e2648 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:33.701258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-782fc25a-2fa5-4235-8b58-5428af1e2648 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:33.704909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-615c3dd9-1fb5-498b-a6f1-93d972933a61 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:33.705360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-615c3dd9-1fb5-498b-a6f1-93d972933a61 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:33.706152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-615c3dd9-1fb5-498b-a6f1-93d972933a61 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:33.706588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-615c3dd9-1fb5-498b-a6f1-93d972933a61 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:33.707356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-782fc25a-2fa5-4235-8b58-5428af1e2648 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:33.707800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-782fc25a-2fa5-4235-8b58-5428af1e2648 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:33.708554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-782fc25a-2fa5-4235-8b58-5428af1e2648 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:33.708989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-782fc25a-2fa5-4235-8b58-5428af1e2648 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:33.899280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-615c3dd9-1fb5-498b-a6f1-93d972933a61 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:33.903952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-782fc25a-2fa5-4235-8b58-5428af1e2648 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:33.907869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-615c3dd9-1fb5-498b-a6f1-93d972933a61 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.213666 Mar 08 04:40:33.908434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1054/2162] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:33 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:33.911542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-782fc25a-2fa5-4235-8b58-5428af1e2648 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.214679 Mar 08 04:40:33.912097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1109/2163] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:33 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:34.924428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1b832102-d133-4710-8377-e32512c8f1b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:34.925128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1b832102-d133-4710-8377-e32512c8f1b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:34.928222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-618022dd-f853-42d8-8b4b-28b2920c6fda tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:34.928873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-618022dd-f853-42d8-8b4b-28b2920c6fda tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:34.932273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b832102-d133-4710-8377-e32512c8f1b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:34.932907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b832102-d133-4710-8377-e32512c8f1b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:34.933886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b832102-d133-4710-8377-e32512c8f1b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:34.934482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1b832102-d133-4710-8377-e32512c8f1b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:34.936030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-618022dd-f853-42d8-8b4b-28b2920c6fda tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:34.936591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-618022dd-f853-42d8-8b4b-28b2920c6fda tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:34.937466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-618022dd-f853-42d8-8b4b-28b2920c6fda tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:34.937988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-618022dd-f853-42d8-8b4b-28b2920c6fda tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:35.145729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1b832102-d133-4710-8377-e32512c8f1b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:35.154245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1b832102-d133-4710-8377-e32512c8f1b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.233663 Mar 08 04:40:35.163643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1055/2164] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:34 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:35.167252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-618022dd-f853-42d8-8b4b-28b2920c6fda tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:35.175301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-618022dd-f853-42d8-8b4b-28b2920c6fda tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.250952 Mar 08 04:40:35.176222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1110/2165] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:34 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:36.170164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-90f65761-4a75-43d6-b813-8b55d2b57ba1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:36.170807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-90f65761-4a75-43d6-b813-8b55d2b57ba1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:36.176685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90f65761-4a75-43d6-b813-8b55d2b57ba1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:36.177130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90f65761-4a75-43d6-b813-8b55d2b57ba1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:36.177915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90f65761-4a75-43d6-b813-8b55d2b57ba1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:36.178354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90f65761-4a75-43d6-b813-8b55d2b57ba1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:36.193193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-161228fd-9381-4dc9-b69d-cac5e0fb0a41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:36.193951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-161228fd-9381-4dc9-b69d-cac5e0fb0a41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:36.204284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-161228fd-9381-4dc9-b69d-cac5e0fb0a41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:36.204284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-161228fd-9381-4dc9-b69d-cac5e0fb0a41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:36.204284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-161228fd-9381-4dc9-b69d-cac5e0fb0a41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:36.204284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-161228fd-9381-4dc9-b69d-cac5e0fb0a41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:36.383257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-90f65761-4a75-43d6-b813-8b55d2b57ba1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:36.391536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-90f65761-4a75-43d6-b813-8b55d2b57ba1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.225160 Mar 08 04:40:36.392092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1056/2166] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:36 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:36.394324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-161228fd-9381-4dc9-b69d-cac5e0fb0a41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:36.402964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-161228fd-9381-4dc9-b69d-cac5e0fb0a41 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.213539 Mar 08 04:40:36.403520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1111/2167] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:36 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:37.408810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d7023237-4869-4418-a821-dd9202a30623 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:37.409418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d7023237-4869-4418-a821-dd9202a30623 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:37.415688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7023237-4869-4418-a821-dd9202a30623 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:37.416136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7023237-4869-4418-a821-dd9202a30623 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:37.416888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7023237-4869-4418-a821-dd9202a30623 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:37.417317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7023237-4869-4418-a821-dd9202a30623 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:37.419759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e1a5e7be-e01d-446d-9389-7464b0778507 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:37.420360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e1a5e7be-e01d-446d-9389-7464b0778507 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:37.426520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1a5e7be-e01d-446d-9389-7464b0778507 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:37.426954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1a5e7be-e01d-446d-9389-7464b0778507 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:37.427706 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1a5e7be-e01d-446d-9389-7464b0778507 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:37.428136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1a5e7be-e01d-446d-9389-7464b0778507 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:37.615221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d7023237-4869-4418-a821-dd9202a30623 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:37.622595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e1a5e7be-e01d-446d-9389-7464b0778507 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:37.623627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d7023237-4869-4418-a821-dd9202a30623 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218549 Mar 08 04:40:37.624196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1057/2168] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:37 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:37.630300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e1a5e7be-e01d-446d-9389-7464b0778507 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.214491 Mar 08 04:40:37.630853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1112/2169] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:37 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:38.640468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8529584b-86fc-436f-b100-a4d856cc8883 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:38.641006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8529584b-86fc-436f-b100-a4d856cc8883 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:38.646984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e920fcee-1c90-45d9-bfe5-9b1b04d67923 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:38.647399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8529584b-86fc-436f-b100-a4d856cc8883 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:38.647576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e920fcee-1c90-45d9-bfe5-9b1b04d67923 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:38.647768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8529584b-86fc-436f-b100-a4d856cc8883 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:38.648532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8529584b-86fc-436f-b100-a4d856cc8883 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:38.648971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8529584b-86fc-436f-b100-a4d856cc8883 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:38.654748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e920fcee-1c90-45d9-bfe5-9b1b04d67923 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:38.655201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e920fcee-1c90-45d9-bfe5-9b1b04d67923 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:38.655968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e920fcee-1c90-45d9-bfe5-9b1b04d67923 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:38.656406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e920fcee-1c90-45d9-bfe5-9b1b04d67923 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:38.856438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8529584b-86fc-436f-b100-a4d856cc8883 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:38.858545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e920fcee-1c90-45d9-bfe5-9b1b04d67923 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:38.864344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8529584b-86fc-436f-b100-a4d856cc8883 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.227744 Mar 08 04:40:38.864905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1058/2170] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:38 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:38.866220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e920fcee-1c90-45d9-bfe5-9b1b04d67923 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.223017 Mar 08 04:40:38.866929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1113/2171] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:38 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:39.880354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cd5d656f-c988-46fe-a380-860b6b8c20f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:39.880969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cd5d656f-c988-46fe-a380-860b6b8c20f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:39.882825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b3560dec-5632-43c6-aa74-4e9b3bba4f89 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:39.883428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b3560dec-5632-43c6-aa74-4e9b3bba4f89 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:39.887478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd5d656f-c988-46fe-a380-860b6b8c20f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:39.887929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd5d656f-c988-46fe-a380-860b6b8c20f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:39.888700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd5d656f-c988-46fe-a380-860b6b8c20f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:39.889139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd5d656f-c988-46fe-a380-860b6b8c20f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:39.889633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b3560dec-5632-43c6-aa74-4e9b3bba4f89 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:39.890109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b3560dec-5632-43c6-aa74-4e9b3bba4f89 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:39.890862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b3560dec-5632-43c6-aa74-4e9b3bba4f89 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:39.891292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b3560dec-5632-43c6-aa74-4e9b3bba4f89 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:39.960673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:40:39.960932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:40:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 (ip 10.222.0.30) !!! Mar 08 04:40:40.086237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b3560dec-5632-43c6-aa74-4e9b3bba4f89 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:40.089326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cd5d656f-c988-46fe-a380-860b6b8c20f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:40.094072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b3560dec-5632-43c6-aa74-4e9b3bba4f89 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.214937 Mar 08 04:40:40.094726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1114/2172] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:39 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:40.097126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cd5d656f-c988-46fe-a380-860b6b8c20f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.220714 Mar 08 04:40:40.097691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1059/2173] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:39 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:41.112750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-968c60a2-3ac7-4d3a-b6e9-0f5d52aa5670 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:41.113279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-968c60a2-3ac7-4d3a-b6e9-0f5d52aa5670 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:41.115066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c9bd7484-761b-4670-83c7-cabb6bd16197 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:41.115675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c9bd7484-761b-4670-83c7-cabb6bd16197 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:41.120538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-968c60a2-3ac7-4d3a-b6e9-0f5d52aa5670 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:41.120979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-968c60a2-3ac7-4d3a-b6e9-0f5d52aa5670 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:41.121776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-968c60a2-3ac7-4d3a-b6e9-0f5d52aa5670 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:41.122211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-968c60a2-3ac7-4d3a-b6e9-0f5d52aa5670 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:41.122932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9bd7484-761b-4670-83c7-cabb6bd16197 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:41.123380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9bd7484-761b-4670-83c7-cabb6bd16197 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:41.124139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9bd7484-761b-4670-83c7-cabb6bd16197 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:41.124575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c9bd7484-761b-4670-83c7-cabb6bd16197 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:41.323402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c9bd7484-761b-4670-83c7-cabb6bd16197 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:41.326431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-968c60a2-3ac7-4d3a-b6e9-0f5d52aa5670 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:41.331374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c9bd7484-761b-4670-83c7-cabb6bd16197 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.220358 Mar 08 04:40:41.331943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1060/2174] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:41 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:41.334159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-968c60a2-3ac7-4d3a-b6e9-0f5d52aa5670 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.225941 Mar 08 04:40:41.334723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1115/2175] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:41 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:42.348277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-89c783a9-f301-4e5e-ac1e-8cc2ba76db24 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:42.348886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-89c783a9-f301-4e5e-ac1e-8cc2ba76db24 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:42.350656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6a8302aa-0d75-4e32-b05d-94b308c310b5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:42.351261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6a8302aa-0d75-4e32-b05d-94b308c310b5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:42.355329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-89c783a9-f301-4e5e-ac1e-8cc2ba76db24 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:42.355780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-89c783a9-f301-4e5e-ac1e-8cc2ba76db24 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:42.356550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-89c783a9-f301-4e5e-ac1e-8cc2ba76db24 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:42.356987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-89c783a9-f301-4e5e-ac1e-8cc2ba76db24 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:42.357559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a8302aa-0d75-4e32-b05d-94b308c310b5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:42.358038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a8302aa-0d75-4e32-b05d-94b308c310b5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:42.358795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a8302aa-0d75-4e32-b05d-94b308c310b5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:42.359231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a8302aa-0d75-4e32-b05d-94b308c310b5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:42.560515 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-89c783a9-f301-4e5e-ac1e-8cc2ba76db24 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:42.567350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6a8302aa-0d75-4e32-b05d-94b308c310b5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:42.568576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-89c783a9-f301-4e5e-ac1e-8cc2ba76db24 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.224164 Mar 08 04:40:42.569223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1061/2176] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:42 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:42.576034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6a8302aa-0d75-4e32-b05d-94b308c310b5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.229108 Mar 08 04:40:42.576593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1116/2177] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:42 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:43.585427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-99b8a2a0-700c-4cf7-a058-fdad1b9157b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:43.586168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-99b8a2a0-700c-4cf7-a058-fdad1b9157b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:43.592806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e9569f4b-6b2c-435c-a927-952dc7531809 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:43.593312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99b8a2a0-700c-4cf7-a058-fdad1b9157b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:43.593418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e9569f4b-6b2c-435c-a927-952dc7531809 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:43.593615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99b8a2a0-700c-4cf7-a058-fdad1b9157b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:43.594427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99b8a2a0-700c-4cf7-a058-fdad1b9157b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:43.594864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-99b8a2a0-700c-4cf7-a058-fdad1b9157b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:43.599985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9569f4b-6b2c-435c-a927-952dc7531809 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:43.600437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9569f4b-6b2c-435c-a927-952dc7531809 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:43.601204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9569f4b-6b2c-435c-a927-952dc7531809 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:43.601641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e9569f4b-6b2c-435c-a927-952dc7531809 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:43.793456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-99b8a2a0-700c-4cf7-a058-fdad1b9157b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:43.798276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e9569f4b-6b2c-435c-a927-952dc7531809 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:43.801240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-99b8a2a0-700c-4cf7-a058-fdad1b9157b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219583 Mar 08 04:40:43.801838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1062/2178] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:43 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:43.807510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e9569f4b-6b2c-435c-a927-952dc7531809 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.218534 Mar 08 04:40:43.808067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1117/2179] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:43 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:44.818772 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-08767d33-485e-4643-a771-88764d1c967e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:44.820712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-08767d33-485e-4643-a771-88764d1c967e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:44.825648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08767d33-485e-4643-a771-88764d1c967e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:44.825956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d83cb49d-c2da-43dc-aca0-180845a34e1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:44.826402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08767d33-485e-4643-a771-88764d1c967e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:44.826570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d83cb49d-c2da-43dc-aca0-180845a34e1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:44.826895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08767d33-485e-4643-a771-88764d1c967e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:44.827334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08767d33-485e-4643-a771-88764d1c967e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:44.832624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d83cb49d-c2da-43dc-aca0-180845a34e1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:44.833072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d83cb49d-c2da-43dc-aca0-180845a34e1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:44.833877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d83cb49d-c2da-43dc-aca0-180845a34e1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:44.834316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d83cb49d-c2da-43dc-aca0-180845a34e1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:45.025607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-08767d33-485e-4643-a771-88764d1c967e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:45.028849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d83cb49d-c2da-43dc-aca0-180845a34e1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:45.033424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-08767d33-485e-4643-a771-88764d1c967e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218622 Mar 08 04:40:45.034094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1063/2180] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:44 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:45.036713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d83cb49d-c2da-43dc-aca0-180845a34e1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.214762 Mar 08 04:40:45.037273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1118/2181] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:44 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:46.051212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2ca2ba1f-3cf8-450c-ad0a-d6bbe6a871f5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:46.051817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2ca2ba1f-3cf8-450c-ad0a-d6bbe6a871f5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:46.053932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-41fcaac2-c5ac-40d0-a49a-a8e066fb6cec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:46.054568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-41fcaac2-c5ac-40d0-a49a-a8e066fb6cec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:46.058510 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ca2ba1f-3cf8-450c-ad0a-d6bbe6a871f5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:46.058954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ca2ba1f-3cf8-450c-ad0a-d6bbe6a871f5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:46.059718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ca2ba1f-3cf8-450c-ad0a-d6bbe6a871f5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:46.060151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ca2ba1f-3cf8-450c-ad0a-d6bbe6a871f5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:46.060897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41fcaac2-c5ac-40d0-a49a-a8e066fb6cec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:46.061344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41fcaac2-c5ac-40d0-a49a-a8e066fb6cec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:46.062138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41fcaac2-c5ac-40d0-a49a-a8e066fb6cec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:46.062573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41fcaac2-c5ac-40d0-a49a-a8e066fb6cec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:46.262270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-41fcaac2-c5ac-40d0-a49a-a8e066fb6cec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:46.266516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ca2ba1f-3cf8-450c-ad0a-d6bbe6a871f5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:46.270328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-41fcaac2-c5ac-40d0-a49a-a8e066fb6cec tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.220079 Mar 08 04:40:46.270908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1119/2182] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:46 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:46.274056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2ca2ba1f-3cf8-450c-ad0a-d6bbe6a871f5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.226671 Mar 08 04:40:46.274954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1064/2183] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:46 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:47.287432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e0d6e4e4-25dc-4edb-b119-1a22c7bb6e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:47.288036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e0d6e4e4-25dc-4edb-b119-1a22c7bb6e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:47.292370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5761cfcd-b705-4c1b-91d7-14c81ed5f855 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:47.292844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5761cfcd-b705-4c1b-91d7-14c81ed5f855 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:47.295226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0d6e4e4-25dc-4edb-b119-1a22c7bb6e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:47.295672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0d6e4e4-25dc-4edb-b119-1a22c7bb6e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:47.296431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0d6e4e4-25dc-4edb-b119-1a22c7bb6e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:47.296861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0d6e4e4-25dc-4edb-b119-1a22c7bb6e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:47.298748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5761cfcd-b705-4c1b-91d7-14c81ed5f855 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:47.299200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5761cfcd-b705-4c1b-91d7-14c81ed5f855 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:47.299952 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5761cfcd-b705-4c1b-91d7-14c81ed5f855 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:47.300382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5761cfcd-b705-4c1b-91d7-14c81ed5f855 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:47.494317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e0d6e4e4-25dc-4edb-b119-1a22c7bb6e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:47.497500 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5761cfcd-b705-4c1b-91d7-14c81ed5f855 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:47.502159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e0d6e4e4-25dc-4edb-b119-1a22c7bb6e19 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.218505 Mar 08 04:40:47.502723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1120/2184] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:47 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:47.506284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5761cfcd-b705-4c1b-91d7-14c81ed5f855 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.217640 Mar 08 04:40:47.506284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1065/2185] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:47 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:48.519903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-49737ef1-e511-4eb6-aa3b-af4051110ea3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:48.520530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-49737ef1-e511-4eb6-aa3b-af4051110ea3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:48.522888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8db7eec4-4735-468c-bbbd-481c12aaad58 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:48.523484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8db7eec4-4735-468c-bbbd-481c12aaad58 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:48.527660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49737ef1-e511-4eb6-aa3b-af4051110ea3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:48.528155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49737ef1-e511-4eb6-aa3b-af4051110ea3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:48.528925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49737ef1-e511-4eb6-aa3b-af4051110ea3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:48.529363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49737ef1-e511-4eb6-aa3b-af4051110ea3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:48.530030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8db7eec4-4735-468c-bbbd-481c12aaad58 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:48.530483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8db7eec4-4735-468c-bbbd-481c12aaad58 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:48.531245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8db7eec4-4735-468c-bbbd-481c12aaad58 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:48.531680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8db7eec4-4735-468c-bbbd-481c12aaad58 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:48.726843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-49737ef1-e511-4eb6-aa3b-af4051110ea3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:48.730804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8db7eec4-4735-468c-bbbd-481c12aaad58 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:48.734789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-49737ef1-e511-4eb6-aa3b-af4051110ea3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.218854 Mar 08 04:40:48.735354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1121/2186] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:48 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:48.738688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8db7eec4-4735-468c-bbbd-481c12aaad58 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219910 Mar 08 04:40:48.739245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1066/2187] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:48 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:49.752479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7b2472c6-3aa3-44a0-91f6-27d2535d98ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:49.753117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7b2472c6-3aa3-44a0-91f6-27d2535d98ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:49.754602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-736b9120-1cb8-4477-a520-14fee74499f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:49.755274 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-736b9120-1cb8-4477-a520-14fee74499f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:49.759600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b2472c6-3aa3-44a0-91f6-27d2535d98ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:49.760049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b2472c6-3aa3-44a0-91f6-27d2535d98ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:49.760824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b2472c6-3aa3-44a0-91f6-27d2535d98ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:49.761261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b2472c6-3aa3-44a0-91f6-27d2535d98ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:49.764873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-736b9120-1cb8-4477-a520-14fee74499f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:49.765445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-736b9120-1cb8-4477-a520-14fee74499f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:49.766259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-736b9120-1cb8-4477-a520-14fee74499f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:49.766696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-736b9120-1cb8-4477-a520-14fee74499f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:49.994812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7b2472c6-3aa3-44a0-91f6-27d2535d98ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:49.999195 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-736b9120-1cb8-4477-a520-14fee74499f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:50.002912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7b2472c6-3aa3-44a0-91f6-27d2535d98ad tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.254264 Mar 08 04:40:50.003427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1122/2188] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:49 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:50.007043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-736b9120-1cb8-4477-a520-14fee74499f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.256471 Mar 08 04:40:50.007601 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1067/2189] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:49 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:51.020891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ba3cfb12-4629-423f-8039-d1d813a02cf5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:51.021648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ba3cfb12-4629-423f-8039-d1d813a02cf5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:51.024490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a5168fd5-8e99-46aa-a47b-e39412fb7867 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:51.025393 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a5168fd5-8e99-46aa-a47b-e39412fb7867 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:51.028993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba3cfb12-4629-423f-8039-d1d813a02cf5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:51.029379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba3cfb12-4629-423f-8039-d1d813a02cf5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:51.030179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba3cfb12-4629-423f-8039-d1d813a02cf5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:51.030615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba3cfb12-4629-423f-8039-d1d813a02cf5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:51.032394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5168fd5-8e99-46aa-a47b-e39412fb7867 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:51.032841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5168fd5-8e99-46aa-a47b-e39412fb7867 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:51.033600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5168fd5-8e99-46aa-a47b-e39412fb7867 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:51.034054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5168fd5-8e99-46aa-a47b-e39412fb7867 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:51.229358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ba3cfb12-4629-423f-8039-d1d813a02cf5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:51.232341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a5168fd5-8e99-46aa-a47b-e39412fb7867 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:51.237116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ba3cfb12-4629-423f-8039-d1d813a02cf5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.220726 Mar 08 04:40:51.237784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1123/2190] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:51 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:51.239992 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a5168fd5-8e99-46aa-a47b-e39412fb7867 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219388 Mar 08 04:40:51.240535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1068/2191] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:51 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:52.255394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-42eb8524-f7a1-4d92-a8b7-ef83fe0cf4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:52.256007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-42eb8524-f7a1-4d92-a8b7-ef83fe0cf4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:52.256148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cc16d926-c1e2-4e7c-af7c-96ad7cd37ba6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:52.256646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cc16d926-c1e2-4e7c-af7c-96ad7cd37ba6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:52.262909 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-42eb8524-f7a1-4d92-a8b7-ef83fe0cf4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:52.263316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc16d926-c1e2-4e7c-af7c-96ad7cd37ba6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:52.263440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-42eb8524-f7a1-4d92-a8b7-ef83fe0cf4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:52.263768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc16d926-c1e2-4e7c-af7c-96ad7cd37ba6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:52.264119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-42eb8524-f7a1-4d92-a8b7-ef83fe0cf4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:52.264524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc16d926-c1e2-4e7c-af7c-96ad7cd37ba6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:52.264637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-42eb8524-f7a1-4d92-a8b7-ef83fe0cf4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:52.264963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc16d926-c1e2-4e7c-af7c-96ad7cd37ba6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:52.461268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cc16d926-c1e2-4e7c-af7c-96ad7cd37ba6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:52.466262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-42eb8524-f7a1-4d92-a8b7-ef83fe0cf4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:52.469569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cc16d926-c1e2-4e7c-af7c-96ad7cd37ba6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.217196 Mar 08 04:40:52.470165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1069/2192] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:52 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:52.473943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-42eb8524-f7a1-4d92-a8b7-ef83fe0cf4e6 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.222516 Mar 08 04:40:52.474493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1124/2193] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:52 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:53.486809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-48ad5889-1fca-4920-9e1d-15e8792e8a34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:53.487368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-48ad5889-1fca-4920-9e1d-15e8792e8a34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:53.490568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8c60cb3c-bb10-47ae-88a4-bf2bb27c5f04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:53.491169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8c60cb3c-bb10-47ae-88a4-bf2bb27c5f04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:53.493523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48ad5889-1fca-4920-9e1d-15e8792e8a34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:53.494009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48ad5889-1fca-4920-9e1d-15e8792e8a34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:53.494764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48ad5889-1fca-4920-9e1d-15e8792e8a34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:53.495194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48ad5889-1fca-4920-9e1d-15e8792e8a34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:53.497584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c60cb3c-bb10-47ae-88a4-bf2bb27c5f04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:53.498067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c60cb3c-bb10-47ae-88a4-bf2bb27c5f04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:53.498833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c60cb3c-bb10-47ae-88a4-bf2bb27c5f04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:53.499267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c60cb3c-bb10-47ae-88a4-bf2bb27c5f04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:53.688142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-48ad5889-1fca-4920-9e1d-15e8792e8a34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:53.692023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8c60cb3c-bb10-47ae-88a4-bf2bb27c5f04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:53.701251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8c60cb3c-bb10-47ae-88a4-bf2bb27c5f04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.214453 Mar 08 04:40:53.701841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1125/2194] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:53 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:53.704106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-48ad5889-1fca-4920-9e1d-15e8792e8a34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.221310 Mar 08 04:40:53.704676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1070/2195] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:53 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:54.718362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-835e49a7-3d9a-4896-bf62-7bda275ce527 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:54.718970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-835e49a7-3d9a-4896-bf62-7bda275ce527 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:54.721288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0265cfdd-9221-4d8c-aa67-8713534c3714 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:54.721931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0265cfdd-9221-4d8c-aa67-8713534c3714 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:54.725297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-835e49a7-3d9a-4896-bf62-7bda275ce527 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:54.725767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-835e49a7-3d9a-4896-bf62-7bda275ce527 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:54.726535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-835e49a7-3d9a-4896-bf62-7bda275ce527 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:54.726966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-835e49a7-3d9a-4896-bf62-7bda275ce527 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:54.728661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0265cfdd-9221-4d8c-aa67-8713534c3714 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:54.729112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0265cfdd-9221-4d8c-aa67-8713534c3714 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:54.729900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0265cfdd-9221-4d8c-aa67-8713534c3714 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:54.730364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0265cfdd-9221-4d8c-aa67-8713534c3714 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:54.923850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-835e49a7-3d9a-4896-bf62-7bda275ce527 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:54.928067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0265cfdd-9221-4d8c-aa67-8713534c3714 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:54.931623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-835e49a7-3d9a-4896-bf62-7bda275ce527 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.217084 Mar 08 04:40:54.932266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1126/2196] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:54 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:54.936262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0265cfdd-9221-4d8c-aa67-8713534c3714 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218760 Mar 08 04:40:54.936817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1071/2197] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:54 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:55.948799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-95a778ec-94ee-4bce-a631-84421f469cd2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:55.949440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-95a778ec-94ee-4bce-a631-84421f469cd2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:55.952058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fe03db27-02d6-46f3-96d4-3059b366a6cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:55.952662 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fe03db27-02d6-46f3-96d4-3059b366a6cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:55.955788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95a778ec-94ee-4bce-a631-84421f469cd2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:55.956243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95a778ec-94ee-4bce-a631-84421f469cd2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:55.957014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95a778ec-94ee-4bce-a631-84421f469cd2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:55.957455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95a778ec-94ee-4bce-a631-84421f469cd2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:55.958831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe03db27-02d6-46f3-96d4-3059b366a6cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:55.959292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe03db27-02d6-46f3-96d4-3059b366a6cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:55.960032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe03db27-02d6-46f3-96d4-3059b366a6cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:55.960463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe03db27-02d6-46f3-96d4-3059b366a6cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:56.161331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-95a778ec-94ee-4bce-a631-84421f469cd2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:56.167252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fe03db27-02d6-46f3-96d4-3059b366a6cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:56.176636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-95a778ec-94ee-4bce-a631-84421f469cd2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.225585 Mar 08 04:40:56.177815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fe03db27-02d6-46f3-96d4-3059b366a6cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.229414 Mar 08 04:40:56.178387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1072/2198] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:55 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:56.181510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1127/2199] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:55 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:57.187453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0c8ebf8b-e732-4cbb-ba37-77f15c83c43d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:57.188062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0c8ebf8b-e732-4cbb-ba37-77f15c83c43d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:57.194502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c8ebf8b-e732-4cbb-ba37-77f15c83c43d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:57.194842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9be27b3e-3070-490f-bbab-ba577d511b66 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:57.195318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c8ebf8b-e732-4cbb-ba37-77f15c83c43d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:57.195506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9be27b3e-3070-490f-bbab-ba577d511b66 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:57.195697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c8ebf8b-e732-4cbb-ba37-77f15c83c43d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:57.196128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c8ebf8b-e732-4cbb-ba37-77f15c83c43d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:57.202972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9be27b3e-3070-490f-bbab-ba577d511b66 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:57.203697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9be27b3e-3070-490f-bbab-ba577d511b66 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:57.204927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9be27b3e-3070-490f-bbab-ba577d511b66 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:57.205555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9be27b3e-3070-490f-bbab-ba577d511b66 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:57.396962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0c8ebf8b-e732-4cbb-ba37-77f15c83c43d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:57.400223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9be27b3e-3070-490f-bbab-ba577d511b66 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:57.405230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0c8ebf8b-e732-4cbb-ba37-77f15c83c43d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.221488 Mar 08 04:40:57.405902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1073/2200] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:57 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:57.407988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9be27b3e-3070-490f-bbab-ba577d511b66 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.216937 Mar 08 04:40:57.408554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1128/2201] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:57 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:58.422536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ce877734-cc34-4093-8010-4ca6cb267d51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:58.423146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ce877734-cc34-4093-8010-4ca6cb267d51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:58.424142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c125f7bc-d56e-4e0e-9136-54522b61186d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:58.424755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c125f7bc-d56e-4e0e-9136-54522b61186d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:58.429118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce877734-cc34-4093-8010-4ca6cb267d51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:58.429563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce877734-cc34-4093-8010-4ca6cb267d51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:58.430356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce877734-cc34-4093-8010-4ca6cb267d51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:58.430918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce877734-cc34-4093-8010-4ca6cb267d51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:58.431080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c125f7bc-d56e-4e0e-9136-54522b61186d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:58.431529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c125f7bc-d56e-4e0e-9136-54522b61186d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:58.432295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c125f7bc-d56e-4e0e-9136-54522b61186d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:58.432728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c125f7bc-d56e-4e0e-9136-54522b61186d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:58.623583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ce877734-cc34-4093-8010-4ca6cb267d51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:58.627792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c125f7bc-d56e-4e0e-9136-54522b61186d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:58.631440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ce877734-cc34-4093-8010-4ca6cb267d51 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.212982 Mar 08 04:40:58.632000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1074/2202] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:58 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:58.636183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c125f7bc-d56e-4e0e-9136-54522b61186d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.215918 Mar 08 04:40:58.636752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1129/2203] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:58 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:40:58.709196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:40:58.709374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:40:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:40:59.649455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-80d9711a-5b23-4736-a086-32e45445d65a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:59.650388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-80d9711a-5b23-4736-a086-32e45445d65a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:59.653518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-76632717-1f07-4682-b4ca-e77816ad06f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:40:59.654165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-76632717-1f07-4682-b4ca-e77816ad06f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:40:59.656507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80d9711a-5b23-4736-a086-32e45445d65a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:59.656955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80d9711a-5b23-4736-a086-32e45445d65a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:59.657733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80d9711a-5b23-4736-a086-32e45445d65a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:59.658164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-80d9711a-5b23-4736-a086-32e45445d65a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:59.660343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76632717-1f07-4682-b4ca-e77816ad06f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:59.660798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76632717-1f07-4682-b4ca-e77816ad06f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:59.661571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76632717-1f07-4682-b4ca-e77816ad06f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:40:59.662039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76632717-1f07-4682-b4ca-e77816ad06f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:40:59.864667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-80d9711a-5b23-4736-a086-32e45445d65a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:59.868641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-76632717-1f07-4682-b4ca-e77816ad06f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:40:59.873233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-80d9711a-5b23-4736-a086-32e45445d65a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.227843 Mar 08 04:40:59.873822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1075/2204] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:59 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:40:59.876339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-76632717-1f07-4682-b4ca-e77816ad06f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.226966 Mar 08 04:40:59.876898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1130/2205] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:40:59 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:00.890785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d3f26c4f-f52c-4841-ac86-1f94d22795ce tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:00.891397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d3f26c4f-f52c-4841-ac86-1f94d22795ce tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:00.891924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0f9de352-975b-48fd-997d-0035a4f0d956 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:00.892569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0f9de352-975b-48fd-997d-0035a4f0d956 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:00.897795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3f26c4f-f52c-4841-ac86-1f94d22795ce tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:00.898245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3f26c4f-f52c-4841-ac86-1f94d22795ce tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:00.898673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f9de352-975b-48fd-997d-0035a4f0d956 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:00.899029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3f26c4f-f52c-4841-ac86-1f94d22795ce tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:00.899142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f9de352-975b-48fd-997d-0035a4f0d956 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:00.899705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3f26c4f-f52c-4841-ac86-1f94d22795ce tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:00.900280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f9de352-975b-48fd-997d-0035a4f0d956 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:00.900719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f9de352-975b-48fd-997d-0035a4f0d956 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:01.095006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0f9de352-975b-48fd-997d-0035a4f0d956 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:01.099004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d3f26c4f-f52c-4841-ac86-1f94d22795ce tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:01.102808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0f9de352-975b-48fd-997d-0035a4f0d956 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.214595 Mar 08 04:41:01.107678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1131/2206] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:00 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:01.107850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d3f26c4f-f52c-4841-ac86-1f94d22795ce tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.220659 Mar 08 04:41:01.108448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1076/2207] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:00 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:02.120407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1b74394d-bdb5-4a3c-85e4-74fc8495cb5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:02.121028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1b74394d-bdb5-4a3c-85e4-74fc8495cb5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:02.125969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f24d404c-e48f-4be6-bb05-e7fd9b18a9aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:02.126564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f24d404c-e48f-4be6-bb05-e7fd9b18a9aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:02.127356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b74394d-bdb5-4a3c-85e4-74fc8495cb5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:02.127808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b74394d-bdb5-4a3c-85e4-74fc8495cb5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:02.128577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b74394d-bdb5-4a3c-85e4-74fc8495cb5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:02.129023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b74394d-bdb5-4a3c-85e4-74fc8495cb5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:02.132409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f24d404c-e48f-4be6-bb05-e7fd9b18a9aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:02.132854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f24d404c-e48f-4be6-bb05-e7fd9b18a9aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:02.134233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f24d404c-e48f-4be6-bb05-e7fd9b18a9aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:02.135056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f24d404c-e48f-4be6-bb05-e7fd9b18a9aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:02.323972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1b74394d-bdb5-4a3c-85e4-74fc8495cb5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:02.327053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f24d404c-e48f-4be6-bb05-e7fd9b18a9aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:02.331955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1b74394d-bdb5-4a3c-85e4-74fc8495cb5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.215604 Mar 08 04:41:02.332528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1132/2208] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:02 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:02.334946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f24d404c-e48f-4be6-bb05-e7fd9b18a9aa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.212750 Mar 08 04:41:02.335492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1077/2209] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:02 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:03.349133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e49cbc04-ba74-4cc7-a268-f2c146753d4f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:03.349778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e49cbc04-ba74-4cc7-a268-f2c146753d4f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:03.351931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6fa52c21-48ff-46bf-ba36-2155679e9051 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:03.353182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6fa52c21-48ff-46bf-ba36-2155679e9051 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:03.356859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e49cbc04-ba74-4cc7-a268-f2c146753d4f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:03.357311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e49cbc04-ba74-4cc7-a268-f2c146753d4f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:03.358122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e49cbc04-ba74-4cc7-a268-f2c146753d4f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:03.358563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e49cbc04-ba74-4cc7-a268-f2c146753d4f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:03.359432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6fa52c21-48ff-46bf-ba36-2155679e9051 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:03.359879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6fa52c21-48ff-46bf-ba36-2155679e9051 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:03.360637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6fa52c21-48ff-46bf-ba36-2155679e9051 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:03.361250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6fa52c21-48ff-46bf-ba36-2155679e9051 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:03.551923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e49cbc04-ba74-4cc7-a268-f2c146753d4f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:03.560018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e49cbc04-ba74-4cc7-a268-f2c146753d4f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.215042 Mar 08 04:41:03.560597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1133/2210] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:03 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:03.563671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6fa52c21-48ff-46bf-ba36-2155679e9051 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:03.573648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6fa52c21-48ff-46bf-ba36-2155679e9051 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.225362 Mar 08 04:41:03.574251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1078/2211] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:03 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:04.576223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-35e32f6e-6c25-49a3-961d-29dd8757b3a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:04.576838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-35e32f6e-6c25-49a3-961d-29dd8757b3a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:04.583238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35e32f6e-6c25-49a3-961d-29dd8757b3a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:04.583653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35e32f6e-6c25-49a3-961d-29dd8757b3a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:04.584420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35e32f6e-6c25-49a3-961d-29dd8757b3a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:04.584851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35e32f6e-6c25-49a3-961d-29dd8757b3a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:04.590945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-677a3f8e-edb5-45fd-813a-6c4154bf62bf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:04.591548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-677a3f8e-edb5-45fd-813a-6c4154bf62bf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:04.598439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-677a3f8e-edb5-45fd-813a-6c4154bf62bf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:04.598901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-677a3f8e-edb5-45fd-813a-6c4154bf62bf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:04.599760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-677a3f8e-edb5-45fd-813a-6c4154bf62bf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:04.600200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-677a3f8e-edb5-45fd-813a-6c4154bf62bf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:04.744402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-677a3f8e-edb5-45fd-813a-6c4154bf62bf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:04.752428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-677a3f8e-edb5-45fd-813a-6c4154bf62bf tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.166036 Mar 08 04:41:04.752993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1079/2212] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:04 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:04.872143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-35e32f6e-6c25-49a3-961d-29dd8757b3a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:04.879716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-35e32f6e-6c25-49a3-961d-29dd8757b3a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.307322 Mar 08 04:41:04.880274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1134/2213] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:04 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:05.768937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7112d4ac-07ba-44c2-b08f-23023135db1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:05.769543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7112d4ac-07ba-44c2-b08f-23023135db1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:05.775733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7112d4ac-07ba-44c2-b08f-23023135db1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:05.776173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7112d4ac-07ba-44c2-b08f-23023135db1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:05.776923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7112d4ac-07ba-44c2-b08f-23023135db1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:05.777354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7112d4ac-07ba-44c2-b08f-23023135db1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:05.896680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-975ee9b9-7cf6-43b9-8b68-7b90c7c17e32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:05.897295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-975ee9b9-7cf6-43b9-8b68-7b90c7c17e32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:05.903914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-975ee9b9-7cf6-43b9-8b68-7b90c7c17e32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:05.904367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-975ee9b9-7cf6-43b9-8b68-7b90c7c17e32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:05.905138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-975ee9b9-7cf6-43b9-8b68-7b90c7c17e32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:05.905578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-975ee9b9-7cf6-43b9-8b68-7b90c7c17e32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:05.910734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7112d4ac-07ba-44c2-b08f-23023135db1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:05.919069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7112d4ac-07ba-44c2-b08f-23023135db1e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153996 Mar 08 04:41:05.919634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1080/2214] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:05 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:06.032774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-975ee9b9-7cf6-43b9-8b68-7b90c7c17e32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:06.040880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-975ee9b9-7cf6-43b9-8b68-7b90c7c17e32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.148079 Mar 08 04:41:06.041428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1135/2215] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:05 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:06.936172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-df50f7f2-a451-4257-b364-73b7db6b1c36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:06.936777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-df50f7f2-a451-4257-b364-73b7db6b1c36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:06.943003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df50f7f2-a451-4257-b364-73b7db6b1c36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:06.943447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df50f7f2-a451-4257-b364-73b7db6b1c36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:06.944197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df50f7f2-a451-4257-b364-73b7db6b1c36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:06.944623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df50f7f2-a451-4257-b364-73b7db6b1c36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:07.057904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3f59f623-a873-4ecd-847f-398de7e26add tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:07.058526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3f59f623-a873-4ecd-847f-398de7e26add tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:07.064728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f59f623-a873-4ecd-847f-398de7e26add tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:07.065182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f59f623-a873-4ecd-847f-398de7e26add tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:07.065976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f59f623-a873-4ecd-847f-398de7e26add tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:07.066418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f59f623-a873-4ecd-847f-398de7e26add tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:07.077922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-df50f7f2-a451-4257-b364-73b7db6b1c36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:07.086261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-df50f7f2-a451-4257-b364-73b7db6b1c36 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 200 len: 1727 microversion: 2.1 time: 0.153817 Mar 08 04:41:07.087606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1081/2216] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:06 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:07.104251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-49cca99e-fc9a-4670-b3fb-41b209dc9181 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '.version_select at 0x7fe832ee89d0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:07.123859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-49cca99e-fc9a-4670-b3fb-41b209dc9181 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774575763" status: 202 len: 0 microversion: 2.1 time: 0.023793 Mar 08 04:41:07.124446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1082/2217] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Mar 8 04:41:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774575763 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 04:41:07.201047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3f59f623-a873-4ecd-847f-398de7e26add tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:07.208937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3f59f623-a873-4ecd-847f-398de7e26add tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155055 Mar 08 04:41:07.209495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1136/2218] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:07 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:08.227935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-da2f3c92-28f9-4ae4-887a-5fd66cb456ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:08.228585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-da2f3c92-28f9-4ae4-887a-5fd66cb456ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:08.234850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-da2f3c92-28f9-4ae4-887a-5fd66cb456ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:08.235306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-da2f3c92-28f9-4ae4-887a-5fd66cb456ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:08.236202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-da2f3c92-28f9-4ae4-887a-5fd66cb456ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:08.236958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-da2f3c92-28f9-4ae4-887a-5fd66cb456ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:08.354444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-75737fa8-7996-4337-bf09-fba8f1ad573f req-7b5df71e-ba45-4657-b1dd-4d5a593c57a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1088612f-57f5-4e1a-bf1a-5f218b6f9eb5", "tag": "f1b4d95e-df7d-4dd5-a257-db8b401c5084"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:41:08.366791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-75737fa8-7996-4337-bf09-fba8f1ad573f req-7b5df71e-ba45-4657-b1dd-4d5a593c57a9 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:08.368091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-75737fa8-7996-4337-bf09-fba8f1ad573f req-7b5df71e-ba45-4657-b1dd-4d5a593c57a9 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:08.382897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-75737fa8-7996-4337-bf09-fba8f1ad573f req-7b5df71e-ba45-4657-b1dd-4d5a593c57a9 service nova] Creating event network-changed:f1b4d95e-df7d-4dd5-a257-db8b401c5084 for instance 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 on hv-cinder-73306 Mar 08 04:41:08.393527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-75737fa8-7996-4337-bf09-fba8f1ad573f req-7b5df71e-ba45-4657-b1dd-4d5a593c57a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110780 Mar 08 04:41:08.395618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1137/2219] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:41:08.423209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-da2f3c92-28f9-4ae4-887a-5fd66cb456ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:08.433562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-da2f3c92-28f9-4ae4-887a-5fd66cb456ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.210170 Mar 08 04:41:08.434455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1083/2220] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:08 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:08.456263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f00aeeaf-28f5-41e9-b546-aeaa65822372 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: .version_select at 0x7fe8370bd940>, body: {"keypair": {"name": "tempest-keypair-1351077523"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:41:08.471058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-f00aeeaf-28f5-41e9-b546-aeaa65822372 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:41:08.475483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-f00aeeaf-28f5-41e9-b546-aeaa65822372 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:41:08.754129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-f00aeeaf-28f5-41e9-b546-aeaa65822372 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:41:08.758326 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-f00aeeaf-28f5-41e9-b546-aeaa65822372 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:41:08.772061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f00aeeaf-28f5-41e9-b546-aeaa65822372 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.320140 Mar 08 04:41:08.773449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1138/2221] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 04:41:08 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:09.457887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0d4fcec3-972a-4f21-9824-fc47a68dd366 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:09.458508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0d4fcec3-972a-4f21-9824-fc47a68dd366 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:09.465397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d4fcec3-972a-4f21-9824-fc47a68dd366 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:09.465885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d4fcec3-972a-4f21-9824-fc47a68dd366 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:09.466650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d4fcec3-972a-4f21-9824-fc47a68dd366 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:09.467085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d4fcec3-972a-4f21-9824-fc47a68dd366 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:09.682011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0d4fcec3-972a-4f21-9824-fc47a68dd366 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:09.689757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0d4fcec3-972a-4f21-9824-fc47a68dd366 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.235749 Mar 08 04:41:09.690328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1084/2222] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:09 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:10.122075 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-410338826", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "551fbd03-e272-4e1c-ae72-e8d5eda5763a"}], "security_groups": [{"name": "tempest-securitygroup--1898384182"}], "key_name": "tempest-keypair-1351077523", "user_data": "}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:41:10.220210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] validate_networks() for [('551fbd03-e272-4e1c-ae72-e8d5eda5763a', None, None, None, None, None)] {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:41:10.706499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-74542162-b832-45bc-8a56-c449fd715afe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:10.707102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-74542162-b832-45bc-8a56-c449fd715afe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:10.713367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74542162-b832-45bc-8a56-c449fd715afe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:10.713860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74542162-b832-45bc-8a56-c449fd715afe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:10.714615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74542162-b832-45bc-8a56-c449fd715afe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:10.715047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-74542162-b832-45bc-8a56-c449fd715afe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:10.907878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:41:10.907878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:41:10.907878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:41:10.907878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:41:10.907878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:41:10.915247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:10.915931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:10.916747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:10.917179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:10.935329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:41:10.935503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-74542162-b832-45bc-8a56-c449fd715afe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:10.939739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:41:10.943289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-74542162-b832-45bc-8a56-c449fd715afe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.240592 Mar 08 04:41:10.944039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1085/2223] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:10 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:10.958486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:41:10.960871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:41:11.008905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d2196d4c-e872-446c-88b5-7b667456f301 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.891972 Mar 08 04:41:11.009543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1139/2224] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:41:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:41:11.019446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-20b3c2d9-3d93-4474-adbe-31c83e44a571 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:11.020073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-20b3c2d9-3d93-4474-adbe-31c83e44a571 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:11.074667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-20b3c2d9-3d93-4474-adbe-31c83e44a571 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:11.081222 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-20b3c2d9-3d93-4474-adbe-31c83e44a571 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1241 microversion: 2.1 time: 0.065552 Mar 08 04:41:11.082031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1086/2225] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:11 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:11.962723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4556caa6-a52b-4358-8064-20241e2a19f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:11.964107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4556caa6-a52b-4358-8064-20241e2a19f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:11.971562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4556caa6-a52b-4358-8064-20241e2a19f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:11.972243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4556caa6-a52b-4358-8064-20241e2a19f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:11.973012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4556caa6-a52b-4358-8064-20241e2a19f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:11.973445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4556caa6-a52b-4358-8064-20241e2a19f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:12.098392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2b4b6d3c-7636-40a7-a11a-5cc6a217d588 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:12.099548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2b4b6d3c-7636-40a7-a11a-5cc6a217d588 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:12.106137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2b4b6d3c-7636-40a7-a11a-5cc6a217d588 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:12.106858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2b4b6d3c-7636-40a7-a11a-5cc6a217d588 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:12.107631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2b4b6d3c-7636-40a7-a11a-5cc6a217d588 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:12.108414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2b4b6d3c-7636-40a7-a11a-5cc6a217d588 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:12.123392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4556caa6-a52b-4358-8064-20241e2a19f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:12.131838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4556caa6-a52b-4358-8064-20241e2a19f4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.174624 Mar 08 04:41:12.137145 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1140/2226] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:11 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:12.184265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2b4b6d3c-7636-40a7-a11a-5cc6a217d588 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:12.191617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2b4b6d3c-7636-40a7-a11a-5cc6a217d588 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1299 microversion: 2.1 time: 0.097217 Mar 08 04:41:12.192262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1087/2227] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:12 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:13.151075 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e8a523a1-225c-40af-804b-fb2e66406096 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:13.151695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e8a523a1-225c-40af-804b-fb2e66406096 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:13.158387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8a523a1-225c-40af-804b-fb2e66406096 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:13.158829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8a523a1-225c-40af-804b-fb2e66406096 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:13.159528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8a523a1-225c-40af-804b-fb2e66406096 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:13.160180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8a523a1-225c-40af-804b-fb2e66406096 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:13.213056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e42ddea3-e6a7-47b7-8f7d-22d173002186 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:13.213694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e42ddea3-e6a7-47b7-8f7d-22d173002186 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:13.220175 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e42ddea3-e6a7-47b7-8f7d-22d173002186 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:13.220979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e42ddea3-e6a7-47b7-8f7d-22d173002186 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:13.221967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e42ddea3-e6a7-47b7-8f7d-22d173002186 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:13.222563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e42ddea3-e6a7-47b7-8f7d-22d173002186 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:13.353423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e8a523a1-225c-40af-804b-fb2e66406096 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:13.363169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e8a523a1-225c-40af-804b-fb2e66406096 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.216897 Mar 08 04:41:13.376003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1141/2228] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:13 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:13.381241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-7d06180d-fa39-4734-841c-af59ab77c837 req-ddb7f265-ab11-4fc1-ae0c-08ff9a08e4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b7df88-e3f5-4a15-9f5f-499bb4a48194", "tag": "ea01d2d4-9a5e-4fb9-93bf-72602e913d51"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:41:13.393940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7d06180d-fa39-4734-841c-af59ab77c837 req-ddb7f265-ab11-4fc1-ae0c-08ff9a08e4a0 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:13.394845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7d06180d-fa39-4734-841c-af59ab77c837 req-ddb7f265-ab11-4fc1-ae0c-08ff9a08e4a0 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:13.409293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-7d06180d-fa39-4734-841c-af59ab77c837 req-ddb7f265-ab11-4fc1-ae0c-08ff9a08e4a0 service nova] Creating event network-changed:ea01d2d4-9a5e-4fb9-93bf-72602e913d51 for instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 on hv-cinder-73306 Mar 08 04:41:13.417612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-7d06180d-fa39-4734-841c-af59ab77c837 req-ddb7f265-ab11-4fc1-ae0c-08ff9a08e4a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039798 Mar 08 04:41:13.418575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1142/2229] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:41:13.431420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e42ddea3-e6a7-47b7-8f7d-22d173002186 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:13.439563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e42ddea3-e6a7-47b7-8f7d-22d173002186 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1367 microversion: 2.1 time: 0.233542 Mar 08 04:41:13.440280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1088/2230] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:13 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:14.383098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-654dda29-152d-4582-a16a-372ac58f4aeb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:14.384314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-654dda29-152d-4582-a16a-372ac58f4aeb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:14.390321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-654dda29-152d-4582-a16a-372ac58f4aeb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:14.390771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-654dda29-152d-4582-a16a-372ac58f4aeb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:14.391530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-654dda29-152d-4582-a16a-372ac58f4aeb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:14.391969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-654dda29-152d-4582-a16a-372ac58f4aeb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:14.455688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bacac904-8839-44a5-a3ff-d29e2423d21e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:14.456274 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bacac904-8839-44a5-a3ff-d29e2423d21e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:14.462660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bacac904-8839-44a5-a3ff-d29e2423d21e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:14.463103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bacac904-8839-44a5-a3ff-d29e2423d21e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:14.463863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bacac904-8839-44a5-a3ff-d29e2423d21e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:14.464293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bacac904-8839-44a5-a3ff-d29e2423d21e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:14.553235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-654dda29-152d-4582-a16a-372ac58f4aeb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:14.562480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-654dda29-152d-4582-a16a-372ac58f4aeb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.183962 Mar 08 04:41:14.563162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1143/2231] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:14 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:14.619046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bacac904-8839-44a5-a3ff-d29e2423d21e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:14.626304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bacac904-8839-44a5-a3ff-d29e2423d21e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1367 microversion: 2.1 time: 0.174427 Mar 08 04:41:14.626853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1089/2232] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:14 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:15.360811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:41:15.360956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:41:15.582247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5dd86ae4-3e47-449a-838b-925ca4d5114d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:15.582850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5dd86ae4-3e47-449a-838b-925ca4d5114d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:15.589723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dd86ae4-3e47-449a-838b-925ca4d5114d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:15.590172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dd86ae4-3e47-449a-838b-925ca4d5114d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:15.590937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dd86ae4-3e47-449a-838b-925ca4d5114d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:15.591368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5dd86ae4-3e47-449a-838b-925ca4d5114d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:15.643270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f4e09f51-4878-44b5-82fd-54ea77fedcd9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:15.643806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f4e09f51-4878-44b5-82fd-54ea77fedcd9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:15.651886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4e09f51-4878-44b5-82fd-54ea77fedcd9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:15.652345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4e09f51-4878-44b5-82fd-54ea77fedcd9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:15.653122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4e09f51-4878-44b5-82fd-54ea77fedcd9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:15.653563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4e09f51-4878-44b5-82fd-54ea77fedcd9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:15.754310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5dd86ae4-3e47-449a-838b-925ca4d5114d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:15.764050 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5dd86ae4-3e47-449a-838b-925ca4d5114d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.186194 Mar 08 04:41:15.764633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1144/2233] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:15 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:15.818273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f4e09f51-4878-44b5-82fd-54ea77fedcd9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:15.825531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f4e09f51-4878-44b5-82fd-54ea77fedcd9 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1367 microversion: 2.1 time: 0.186202 Mar 08 04:41:15.826116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1090/2234] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:15 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:16.780487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-33fbe559-ea24-4d06-a5fd-d3934fe3b354 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:16.781135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-33fbe559-ea24-4d06-a5fd-d3934fe3b354 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:16.787386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33fbe559-ea24-4d06-a5fd-d3934fe3b354 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:16.787837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33fbe559-ea24-4d06-a5fd-d3934fe3b354 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:16.788598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33fbe559-ea24-4d06-a5fd-d3934fe3b354 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:16.789039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33fbe559-ea24-4d06-a5fd-d3934fe3b354 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:16.842631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-988bb702-d1e5-4250-8b46-91e6d3955915 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:16.843241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-988bb702-d1e5-4250-8b46-91e6d3955915 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:16.849533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-988bb702-d1e5-4250-8b46-91e6d3955915 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:16.850286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-988bb702-d1e5-4250-8b46-91e6d3955915 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:16.851248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-988bb702-d1e5-4250-8b46-91e6d3955915 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:16.851973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-988bb702-d1e5-4250-8b46-91e6d3955915 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:16.954393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-33fbe559-ea24-4d06-a5fd-d3934fe3b354 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:16.962038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-33fbe559-ea24-4d06-a5fd-d3934fe3b354 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.185378 Mar 08 04:41:16.962604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1145/2235] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:16 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:17.015000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-988bb702-d1e5-4250-8b46-91e6d3955915 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:17.022282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-988bb702-d1e5-4250-8b46-91e6d3955915 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1367 microversion: 2.1 time: 0.183578 Mar 08 04:41:17.022836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1091/2236] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:16 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:17.979505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2fe676eb-e9b8-4d71-8e9f-fbf3b38d7cbe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:17.980118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2fe676eb-e9b8-4d71-8e9f-fbf3b38d7cbe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:17.986177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2fe676eb-e9b8-4d71-8e9f-fbf3b38d7cbe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:17.986627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2fe676eb-e9b8-4d71-8e9f-fbf3b38d7cbe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:17.987407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2fe676eb-e9b8-4d71-8e9f-fbf3b38d7cbe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:17.987846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2fe676eb-e9b8-4d71-8e9f-fbf3b38d7cbe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:18.042131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5197455a-12e0-4558-a866-4fa75c2d340c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:18.042774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5197455a-12e0-4558-a866-4fa75c2d340c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:18.049004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5197455a-12e0-4558-a866-4fa75c2d340c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:18.049455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5197455a-12e0-4558-a866-4fa75c2d340c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:18.050249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5197455a-12e0-4558-a866-4fa75c2d340c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:18.050690 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5197455a-12e0-4558-a866-4fa75c2d340c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:18.146029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2fe676eb-e9b8-4d71-8e9f-fbf3b38d7cbe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:18.154607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2fe676eb-e9b8-4d71-8e9f-fbf3b38d7cbe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.179586 Mar 08 04:41:18.155172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1146/2237] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:17 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:18.211531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5197455a-12e0-4558-a866-4fa75c2d340c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:18.218703 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5197455a-12e0-4558-a866-4fa75c2d340c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1367 microversion: 2.1 time: 0.181305 Mar 08 04:41:18.219254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1092/2238] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:18 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:19.171576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-85fad47c-f5d1-424a-8142-37a5ebec287b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:19.172811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-85fad47c-f5d1-424a-8142-37a5ebec287b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:19.179581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-85fad47c-f5d1-424a-8142-37a5ebec287b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:19.180933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-85fad47c-f5d1-424a-8142-37a5ebec287b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:19.181738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-85fad47c-f5d1-424a-8142-37a5ebec287b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:19.182187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-85fad47c-f5d1-424a-8142-37a5ebec287b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:19.285728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-95115f6b-4dcd-4e31-b27c-edeb0b29aee6 req-7b9e91b2-3646-459b-94c3-3be0d2a60dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b7df88-e3f5-4a15-9f5f-499bb4a48194", "name": "network-vif-plugged", "status": "completed", "tag": "ea01d2d4-9a5e-4fb9-93bf-72602e913d51"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:41:19.295018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-95115f6b-4dcd-4e31-b27c-edeb0b29aee6 req-7b9e91b2-3646-459b-94c3-3be0d2a60dba service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:19.295964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-95115f6b-4dcd-4e31-b27c-edeb0b29aee6 req-7b9e91b2-3646-459b-94c3-3be0d2a60dba service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:19.315908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-95115f6b-4dcd-4e31-b27c-edeb0b29aee6 req-7b9e91b2-3646-459b-94c3-3be0d2a60dba service nova] Creating event network-vif-plugged:ea01d2d4-9a5e-4fb9-93bf-72602e913d51 for instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 on hv-cinder-73306 Mar 08 04:41:19.323224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-95115f6b-4dcd-4e31-b27c-edeb0b29aee6 req-7b9e91b2-3646-459b-94c3-3be0d2a60dba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125705 Mar 08 04:41:19.323856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1093/2239] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:41:19.333188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d67f053e-b78e-4d28-9e72-404728a84591 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:19.334075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d67f053e-b78e-4d28-9e72-404728a84591 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:19.341167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d67f053e-b78e-4d28-9e72-404728a84591 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:19.342094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d67f053e-b78e-4d28-9e72-404728a84591 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:19.343041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d67f053e-b78e-4d28-9e72-404728a84591 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:19.343937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d67f053e-b78e-4d28-9e72-404728a84591 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:19.382880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-85fad47c-f5d1-424a-8142-37a5ebec287b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:19.391110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-85fad47c-f5d1-424a-8142-37a5ebec287b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.223361 Mar 08 04:41:19.391684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1147/2240] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:19 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:19.507640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d67f053e-b78e-4d28-9e72-404728a84591 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:19.515862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d67f053e-b78e-4d28-9e72-404728a84591 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1367 microversion: 2.1 time: 0.190946 Mar 08 04:41:19.516418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1094/2241] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:19 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:20.408121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-56a2ffa4-283a-4304-998c-b8d8fe6afed7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:20.408731 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-56a2ffa4-283a-4304-998c-b8d8fe6afed7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:20.415347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-56a2ffa4-283a-4304-998c-b8d8fe6afed7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:20.415805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-56a2ffa4-283a-4304-998c-b8d8fe6afed7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:20.416573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-56a2ffa4-283a-4304-998c-b8d8fe6afed7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:20.417010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-56a2ffa4-283a-4304-998c-b8d8fe6afed7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:20.533584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-31cf626c-cc7f-4c88-98b8-3dec98871c71 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:20.534274 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-31cf626c-cc7f-4c88-98b8-3dec98871c71 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:20.540458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31cf626c-cc7f-4c88-98b8-3dec98871c71 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:20.540908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31cf626c-cc7f-4c88-98b8-3dec98871c71 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:20.541700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31cf626c-cc7f-4c88-98b8-3dec98871c71 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:20.542143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31cf626c-cc7f-4c88-98b8-3dec98871c71 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:20.548814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-56a2ffa4-283a-4304-998c-b8d8fe6afed7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:20.557126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-56a2ffa4-283a-4304-998c-b8d8fe6afed7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152830 Mar 08 04:41:20.557797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1148/2242] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:20 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:20.673373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-31cf626c-cc7f-4c88-98b8-3dec98871c71 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:20.681270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-31cf626c-cc7f-4c88-98b8-3dec98871c71 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1367 microversion: 2.1 time: 0.151463 Mar 08 04:41:20.681859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1095/2243] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:20 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:21.574009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3ef5970b-cc4a-4aeb-b8fc-8b26f79ed79c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:21.574621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3ef5970b-cc4a-4aeb-b8fc-8b26f79ed79c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:21.581011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3ef5970b-cc4a-4aeb-b8fc-8b26f79ed79c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:21.581468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3ef5970b-cc4a-4aeb-b8fc-8b26f79ed79c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:21.582256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3ef5970b-cc4a-4aeb-b8fc-8b26f79ed79c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:21.582700 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3ef5970b-cc4a-4aeb-b8fc-8b26f79ed79c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:21.698184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5a2b00c7-2287-4ef5-9f67-0a268712330a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:21.698917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5a2b00c7-2287-4ef5-9f67-0a268712330a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:21.705121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a2b00c7-2287-4ef5-9f67-0a268712330a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:21.705565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a2b00c7-2287-4ef5-9f67-0a268712330a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:21.706355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a2b00c7-2287-4ef5-9f67-0a268712330a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:21.706788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a2b00c7-2287-4ef5-9f67-0a268712330a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:21.713429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3ef5970b-cc4a-4aeb-b8fc-8b26f79ed79c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:21.720956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3ef5970b-cc4a-4aeb-b8fc-8b26f79ed79c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150830 Mar 08 04:41:21.721515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1149/2244] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:21 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:21.838873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5a2b00c7-2287-4ef5-9f67-0a268712330a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:21.846157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5a2b00c7-2287-4ef5-9f67-0a268712330a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1557 microversion: 2.1 time: 0.151861 Mar 08 04:41:21.846712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1096/2245] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:21 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:21.862977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-caa9deae-74a0-43d1-93b2-d5f01f891851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:21.863473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-caa9deae-74a0-43d1-93b2-d5f01f891851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:21.869650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-caa9deae-74a0-43d1-93b2-d5f01f891851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:21.870402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-caa9deae-74a0-43d1-93b2-d5f01f891851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:21.871186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-caa9deae-74a0-43d1-93b2-d5f01f891851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:21.871624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-caa9deae-74a0-43d1-93b2-d5f01f891851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:21.951283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-caa9deae-74a0-43d1-93b2-d5f01f891851 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092085 Mar 08 04:41:21.951871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1150/2246] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 04:41:21 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:41:22.738173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5e0bb382-f7e7-4c9b-93a0-b061b15c747a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:22.738759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5e0bb382-f7e7-4c9b-93a0-b061b15c747a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:22.745689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e0bb382-f7e7-4c9b-93a0-b061b15c747a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:22.746140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e0bb382-f7e7-4c9b-93a0-b061b15c747a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:22.746900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e0bb382-f7e7-4c9b-93a0-b061b15c747a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:22.747335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e0bb382-f7e7-4c9b-93a0-b061b15c747a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:23.206152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5e0bb382-f7e7-4c9b-93a0-b061b15c747a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:23.215417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5e0bb382-f7e7-4c9b-93a0-b061b15c747a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.481064 Mar 08 04:41:23.215984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1097/2247] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:22 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:23.253999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-7f6ecc70-75ac-44cb-b3f3-dc652167ee2c req-4fed0c37-32b5-4fa8-9be1-442c4e00ec22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b7df88-e3f5-4a15-9f5f-499bb4a48194", "tag": "ea01d2d4-9a5e-4fb9-93bf-72602e913d51"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:41:23.262310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7f6ecc70-75ac-44cb-b3f3-dc652167ee2c req-4fed0c37-32b5-4fa8-9be1-442c4e00ec22 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:23.262821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7f6ecc70-75ac-44cb-b3f3-dc652167ee2c req-4fed0c37-32b5-4fa8-9be1-442c4e00ec22 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:23.274696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-7f6ecc70-75ac-44cb-b3f3-dc652167ee2c req-4fed0c37-32b5-4fa8-9be1-442c4e00ec22 service nova] Creating event network-changed:ea01d2d4-9a5e-4fb9-93bf-72602e913d51 for instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 on hv-cinder-73306 Mar 08 04:41:23.279870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-7f6ecc70-75ac-44cb-b3f3-dc652167ee2c req-4fed0c37-32b5-4fa8-9be1-442c4e00ec22 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092036 Mar 08 04:41:23.280629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1151/2248] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:41:24.232983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3ab94929-c70c-4f20-a535-99e66853cc13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:24.233521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3ab94929-c70c-4f20-a535-99e66853cc13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:24.239484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ab94929-c70c-4f20-a535-99e66853cc13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:24.239937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ab94929-c70c-4f20-a535-99e66853cc13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:24.240704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ab94929-c70c-4f20-a535-99e66853cc13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:24.241143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ab94929-c70c-4f20-a535-99e66853cc13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:24.376374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3ab94929-c70c-4f20-a535-99e66853cc13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:24.384341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3ab94929-c70c-4f20-a535-99e66853cc13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155303 Mar 08 04:41:24.384892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1098/2249] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:24 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:41:25.402524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5eb84276-9cc8-4710-995b-c6fc4c1d6523 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:25.403223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5eb84276-9cc8-4710-995b-c6fc4c1d6523 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:25.409278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5eb84276-9cc8-4710-995b-c6fc4c1d6523 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:25.409767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5eb84276-9cc8-4710-995b-c6fc4c1d6523 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:25.410530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5eb84276-9cc8-4710-995b-c6fc4c1d6523 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:25.410968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5eb84276-9cc8-4710-995b-c6fc4c1d6523 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:25.540936 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5eb84276-9cc8-4710-995b-c6fc4c1d6523 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:25.548629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5eb84276-9cc8-4710-995b-c6fc4c1d6523 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151202 Mar 08 04:41:25.549194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1152/2250] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:25 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:26.566197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-adbb4b56-2b03-4a7e-9f38-cca0858177f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:26.566732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-adbb4b56-2b03-4a7e-9f38-cca0858177f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:26.573682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adbb4b56-2b03-4a7e-9f38-cca0858177f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:26.574136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adbb4b56-2b03-4a7e-9f38-cca0858177f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:26.574892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adbb4b56-2b03-4a7e-9f38-cca0858177f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:26.575324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adbb4b56-2b03-4a7e-9f38-cca0858177f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:26.706094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-adbb4b56-2b03-4a7e-9f38-cca0858177f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:26.713858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-adbb4b56-2b03-4a7e-9f38-cca0858177f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151674 Mar 08 04:41:26.714417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1099/2251] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:26 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:27.731603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-66d0a063-f21e-4d9b-bcaf-b323164402a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:27.732219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-66d0a063-f21e-4d9b-bcaf-b323164402a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:27.739045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66d0a063-f21e-4d9b-bcaf-b323164402a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:27.739493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66d0a063-f21e-4d9b-bcaf-b323164402a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:27.740263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66d0a063-f21e-4d9b-bcaf-b323164402a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:27.740702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-66d0a063-f21e-4d9b-bcaf-b323164402a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:27.875655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-66d0a063-f21e-4d9b-bcaf-b323164402a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:27.883550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-66d0a063-f21e-4d9b-bcaf-b323164402a3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155781 Mar 08 04:41:27.884116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1153/2252] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:27 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:28.900320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fbdd6789-6478-403a-92ab-4b7e5f17db68 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:28.900927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fbdd6789-6478-403a-92ab-4b7e5f17db68 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:28.907343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fbdd6789-6478-403a-92ab-4b7e5f17db68 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:28.907796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fbdd6789-6478-403a-92ab-4b7e5f17db68 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:28.908584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fbdd6789-6478-403a-92ab-4b7e5f17db68 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:28.909022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fbdd6789-6478-403a-92ab-4b7e5f17db68 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:29.037839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fbdd6789-6478-403a-92ab-4b7e5f17db68 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:29.046096 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fbdd6789-6478-403a-92ab-4b7e5f17db68 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149892 Mar 08 04:41:29.046766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1100/2253] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:28 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:30.064060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e0c761f3-bdba-432c-9837-19434254d758 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:30.064603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e0c761f3-bdba-432c-9837-19434254d758 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:30.071012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0c761f3-bdba-432c-9837-19434254d758 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:30.071454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0c761f3-bdba-432c-9837-19434254d758 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:30.072218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0c761f3-bdba-432c-9837-19434254d758 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:30.072656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e0c761f3-bdba-432c-9837-19434254d758 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:30.203302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e0c761f3-bdba-432c-9837-19434254d758 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:30.211560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e0c761f3-bdba-432c-9837-19434254d758 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151371 Mar 08 04:41:30.212124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1154/2254] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:30 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:31.228244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c29ddfc9-9f49-42ec-af57-cb5a67137209 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:31.228834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c29ddfc9-9f49-42ec-af57-cb5a67137209 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:31.235252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c29ddfc9-9f49-42ec-af57-cb5a67137209 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:31.235701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c29ddfc9-9f49-42ec-af57-cb5a67137209 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:31.236467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c29ddfc9-9f49-42ec-af57-cb5a67137209 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:31.236934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c29ddfc9-9f49-42ec-af57-cb5a67137209 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:31.366315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c29ddfc9-9f49-42ec-af57-cb5a67137209 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:31.374072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c29ddfc9-9f49-42ec-af57-cb5a67137209 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149829 Mar 08 04:41:31.374633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1101/2255] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:31 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:32.391151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1c47f9a6-8f01-42b6-9f69-e95350c9818b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:32.391768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1c47f9a6-8f01-42b6-9f69-e95350c9818b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:32.398515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c47f9a6-8f01-42b6-9f69-e95350c9818b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:32.398965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c47f9a6-8f01-42b6-9f69-e95350c9818b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:32.400041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c47f9a6-8f01-42b6-9f69-e95350c9818b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:32.400478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c47f9a6-8f01-42b6-9f69-e95350c9818b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:32.528455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1c47f9a6-8f01-42b6-9f69-e95350c9818b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:32.536144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1c47f9a6-8f01-42b6-9f69-e95350c9818b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.148861 Mar 08 04:41:32.536713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1155/2256] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:32 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:33.553678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2ebb5e2a-196e-4e14-961f-e2ee72c05e94 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:33.554303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2ebb5e2a-196e-4e14-961f-e2ee72c05e94 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:33.561263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ebb5e2a-196e-4e14-961f-e2ee72c05e94 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:33.561739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ebb5e2a-196e-4e14-961f-e2ee72c05e94 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:33.562500 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ebb5e2a-196e-4e14-961f-e2ee72c05e94 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:33.562936 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ebb5e2a-196e-4e14-961f-e2ee72c05e94 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:33.696841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ebb5e2a-196e-4e14-961f-e2ee72c05e94 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:33.704454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2ebb5e2a-196e-4e14-961f-e2ee72c05e94 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154660 Mar 08 04:41:33.705003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1102/2257] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:33 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:34.720932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ad0584ca-714a-43a0-a32e-0c75c5173903 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:34.721548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ad0584ca-714a-43a0-a32e-0c75c5173903 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:34.728562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad0584ca-714a-43a0-a32e-0c75c5173903 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:34.729009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad0584ca-714a-43a0-a32e-0c75c5173903 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:34.729835 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad0584ca-714a-43a0-a32e-0c75c5173903 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:34.730277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad0584ca-714a-43a0-a32e-0c75c5173903 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:34.862236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ad0584ca-714a-43a0-a32e-0c75c5173903 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:34.870106 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ad0584ca-714a-43a0-a32e-0c75c5173903 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152997 Mar 08 04:41:34.870675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1156/2258] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:34 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:35.887037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dd090e9f-8df8-4be6-9a41-93b956ac9a52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:35.887642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dd090e9f-8df8-4be6-9a41-93b956ac9a52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:35.893647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd090e9f-8df8-4be6-9a41-93b956ac9a52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:35.894119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd090e9f-8df8-4be6-9a41-93b956ac9a52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:35.894895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd090e9f-8df8-4be6-9a41-93b956ac9a52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:35.895346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd090e9f-8df8-4be6-9a41-93b956ac9a52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:36.027908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dd090e9f-8df8-4be6-9a41-93b956ac9a52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:36.035867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dd090e9f-8df8-4be6-9a41-93b956ac9a52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152844 Mar 08 04:41:36.036418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1103/2259] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:35 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:37.053316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a4afb996-4f74-4f7b-98e4-4ad07c2a3c4a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:37.053945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a4afb996-4f74-4f7b-98e4-4ad07c2a3c4a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:37.060126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4afb996-4f74-4f7b-98e4-4ad07c2a3c4a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:37.060567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4afb996-4f74-4f7b-98e4-4ad07c2a3c4a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:37.061326 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4afb996-4f74-4f7b-98e4-4ad07c2a3c4a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:37.061815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a4afb996-4f74-4f7b-98e4-4ad07c2a3c4a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:37.196881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a4afb996-4f74-4f7b-98e4-4ad07c2a3c4a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:37.204714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a4afb996-4f74-4f7b-98e4-4ad07c2a3c4a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155227 Mar 08 04:41:37.205280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1157/2260] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:37 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:38.221223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7adb6bec-5acb-496b-94a1-7ff342e7057b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:38.221850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7adb6bec-5acb-496b-94a1-7ff342e7057b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:38.228567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7adb6bec-5acb-496b-94a1-7ff342e7057b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:38.229026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7adb6bec-5acb-496b-94a1-7ff342e7057b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:38.229831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7adb6bec-5acb-496b-94a1-7ff342e7057b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:38.230275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7adb6bec-5acb-496b-94a1-7ff342e7057b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:38.363652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7adb6bec-5acb-496b-94a1-7ff342e7057b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:38.371514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7adb6bec-5acb-496b-94a1-7ff342e7057b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154108 Mar 08 04:41:38.372066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1104/2261] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:38 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:39.388811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-907f4620-0c90-4622-bda1-cbe2de9911d7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:39.389417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-907f4620-0c90-4622-bda1-cbe2de9911d7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:39.396357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-907f4620-0c90-4622-bda1-cbe2de9911d7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:39.396807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-907f4620-0c90-4622-bda1-cbe2de9911d7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:39.397560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-907f4620-0c90-4622-bda1-cbe2de9911d7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:39.398023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-907f4620-0c90-4622-bda1-cbe2de9911d7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:39.526350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-907f4620-0c90-4622-bda1-cbe2de9911d7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:39.533940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-907f4620-0c90-4622-bda1-cbe2de9911d7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149010 Mar 08 04:41:39.534502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1158/2262] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:39 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:40.551234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-da1be55d-c561-4e93-bd12-3330f0f7e155 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:40.551877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-da1be55d-c561-4e93-bd12-3330f0f7e155 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:40.558760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-da1be55d-c561-4e93-bd12-3330f0f7e155 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:40.559164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-da1be55d-c561-4e93-bd12-3330f0f7e155 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:40.559928 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-da1be55d-c561-4e93-bd12-3330f0f7e155 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:40.560493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-da1be55d-c561-4e93-bd12-3330f0f7e155 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:40.688630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-da1be55d-c561-4e93-bd12-3330f0f7e155 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:40.697078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-da1be55d-c561-4e93-bd12-3330f0f7e155 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149669 Mar 08 04:41:40.697629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1105/2263] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:40 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:41.714013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-67fecf5a-a859-41a5-bded-0ce8d9c0a8f7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:41.714677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-67fecf5a-a859-41a5-bded-0ce8d9c0a8f7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:41.720876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67fecf5a-a859-41a5-bded-0ce8d9c0a8f7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:41.721349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67fecf5a-a859-41a5-bded-0ce8d9c0a8f7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:41.722146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67fecf5a-a859-41a5-bded-0ce8d9c0a8f7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:41.722579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67fecf5a-a859-41a5-bded-0ce8d9c0a8f7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:41.855476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-67fecf5a-a859-41a5-bded-0ce8d9c0a8f7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:41.863248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-67fecf5a-a859-41a5-bded-0ce8d9c0a8f7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153296 Mar 08 04:41:41.863801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1159/2264] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:41 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:42.881009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7ec264a3-2227-4d6f-af9d-014b5af540f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:42.881645 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7ec264a3-2227-4d6f-af9d-014b5af540f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:42.888051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ec264a3-2227-4d6f-af9d-014b5af540f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:42.888492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ec264a3-2227-4d6f-af9d-014b5af540f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:42.889237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ec264a3-2227-4d6f-af9d-014b5af540f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:42.889682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ec264a3-2227-4d6f-af9d-014b5af540f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:43.017403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7ec264a3-2227-4d6f-af9d-014b5af540f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:43.025835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7ec264a3-2227-4d6f-af9d-014b5af540f6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.148650 Mar 08 04:41:43.026388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1106/2265] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:42 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:44.042730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4e474d05-b4b7-4aa4-be59-bbac26f4ca38 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:44.043348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4e474d05-b4b7-4aa4-be59-bbac26f4ca38 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:44.049945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e474d05-b4b7-4aa4-be59-bbac26f4ca38 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:44.050761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e474d05-b4b7-4aa4-be59-bbac26f4ca38 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:44.051548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e474d05-b4b7-4aa4-be59-bbac26f4ca38 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:44.051987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4e474d05-b4b7-4aa4-be59-bbac26f4ca38 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:44.188428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4e474d05-b4b7-4aa4-be59-bbac26f4ca38 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:44.196896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4e474d05-b4b7-4aa4-be59-bbac26f4ca38 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.158021 Mar 08 04:41:44.197464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1160/2266] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:44 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:45.214275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5116d65e-274d-4b2d-8874-0bb821ae356c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:45.214882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5116d65e-274d-4b2d-8874-0bb821ae356c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:45.221051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5116d65e-274d-4b2d-8874-0bb821ae356c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:45.221500 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5116d65e-274d-4b2d-8874-0bb821ae356c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:45.222299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5116d65e-274d-4b2d-8874-0bb821ae356c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:45.222758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5116d65e-274d-4b2d-8874-0bb821ae356c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:45.351796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5116d65e-274d-4b2d-8874-0bb821ae356c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:45.359816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5116d65e-274d-4b2d-8874-0bb821ae356c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149687 Mar 08 04:41:45.360388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1107/2267] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:45 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:46.380091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2ee7304d-da19-4585-a02b-aa4c99c498af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:46.380705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2ee7304d-da19-4585-a02b-aa4c99c498af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:46.387306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ee7304d-da19-4585-a02b-aa4c99c498af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:46.387747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ee7304d-da19-4585-a02b-aa4c99c498af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:46.388510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ee7304d-da19-4585-a02b-aa4c99c498af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:46.388943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2ee7304d-da19-4585-a02b-aa4c99c498af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:46.517265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2ee7304d-da19-4585-a02b-aa4c99c498af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:46.525817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2ee7304d-da19-4585-a02b-aa4c99c498af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149572 Mar 08 04:41:46.526429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1161/2268] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:46 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:47.542915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-72422ca9-c3df-4040-881d-59adf367cda2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:47.543516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-72422ca9-c3df-4040-881d-59adf367cda2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:47.549860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72422ca9-c3df-4040-881d-59adf367cda2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:47.550316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72422ca9-c3df-4040-881d-59adf367cda2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:47.551078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72422ca9-c3df-4040-881d-59adf367cda2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:47.551516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72422ca9-c3df-4040-881d-59adf367cda2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:47.685277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-72422ca9-c3df-4040-881d-59adf367cda2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:47.693064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-72422ca9-c3df-4040-881d-59adf367cda2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154190 Mar 08 04:41:47.693848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1108/2269] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:47 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:48.709417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8b27922e-3148-4f8b-8871-d6ee0da3e330 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:48.710066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8b27922e-3148-4f8b-8871-d6ee0da3e330 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:48.716205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8b27922e-3148-4f8b-8871-d6ee0da3e330 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:48.716656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8b27922e-3148-4f8b-8871-d6ee0da3e330 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:48.717423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8b27922e-3148-4f8b-8871-d6ee0da3e330 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:48.717888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8b27922e-3148-4f8b-8871-d6ee0da3e330 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:48.850972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8b27922e-3148-4f8b-8871-d6ee0da3e330 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:48.859447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8b27922e-3148-4f8b-8871-d6ee0da3e330 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154011 Mar 08 04:41:48.860013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1162/2270] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:48 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:49.876014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1077a12a-e26b-4307-a733-6e80d4cc231c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:49.876649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1077a12a-e26b-4307-a733-6e80d4cc231c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:49.882834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1077a12a-e26b-4307-a733-6e80d4cc231c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:49.883891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1077a12a-e26b-4307-a733-6e80d4cc231c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:49.884650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1077a12a-e26b-4307-a733-6e80d4cc231c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:49.885082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1077a12a-e26b-4307-a733-6e80d4cc231c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:50.016345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1077a12a-e26b-4307-a733-6e80d4cc231c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:50.024670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1077a12a-e26b-4307-a733-6e80d4cc231c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151930 Mar 08 04:41:50.025168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1109/2271] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:49 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:51.042964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e1c3f633-221e-487f-b18d-a2b20c1c71a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:51.043518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e1c3f633-221e-487f-b18d-a2b20c1c71a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:51.049585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1c3f633-221e-487f-b18d-a2b20c1c71a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:51.050059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1c3f633-221e-487f-b18d-a2b20c1c71a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:51.050815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1c3f633-221e-487f-b18d-a2b20c1c71a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:51.051248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e1c3f633-221e-487f-b18d-a2b20c1c71a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:51.189282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e1c3f633-221e-487f-b18d-a2b20c1c71a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:51.197861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e1c3f633-221e-487f-b18d-a2b20c1c71a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.159620 Mar 08 04:41:51.198427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1163/2272] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:51 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:52.215600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-008608ad-d3b8-4be0-8e75-551cf87511ce tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:52.216204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-008608ad-d3b8-4be0-8e75-551cf87511ce tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:52.222412 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-008608ad-d3b8-4be0-8e75-551cf87511ce tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:52.222855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-008608ad-d3b8-4be0-8e75-551cf87511ce tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:52.223609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-008608ad-d3b8-4be0-8e75-551cf87511ce tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:52.224039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-008608ad-d3b8-4be0-8e75-551cf87511ce tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:52.357501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-008608ad-d3b8-4be0-8e75-551cf87511ce tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:52.365229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-008608ad-d3b8-4be0-8e75-551cf87511ce tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154186 Mar 08 04:41:52.365977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1110/2273] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:52 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:53.382680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-00e38a4d-9e0b-4bab-8174-8775624e23d8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:53.383294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-00e38a4d-9e0b-4bab-8174-8775624e23d8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:53.390120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00e38a4d-9e0b-4bab-8174-8775624e23d8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:53.390565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00e38a4d-9e0b-4bab-8174-8775624e23d8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:53.391325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00e38a4d-9e0b-4bab-8174-8775624e23d8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:53.391764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00e38a4d-9e0b-4bab-8174-8775624e23d8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:53.522491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-00e38a4d-9e0b-4bab-8174-8775624e23d8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:53.531048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-00e38a4d-9e0b-4bab-8174-8775624e23d8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152260 Mar 08 04:41:53.531615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1164/2274] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:53 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:54.547968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-91f32b1e-38bc-4290-8854-13d3330345b3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:54.548553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-91f32b1e-38bc-4290-8854-13d3330345b3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:54.554724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91f32b1e-38bc-4290-8854-13d3330345b3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:54.555167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91f32b1e-38bc-4290-8854-13d3330345b3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:54.555924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91f32b1e-38bc-4290-8854-13d3330345b3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:54.557044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91f32b1e-38bc-4290-8854-13d3330345b3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:54.689130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-91f32b1e-38bc-4290-8854-13d3330345b3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:54.696698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-91f32b1e-38bc-4290-8854-13d3330345b3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152658 Mar 08 04:41:54.697955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1111/2275] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:54 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:55.713803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ece39ae9-69bb-4366-8eb2-5fcc64cf6430 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:55.714458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ece39ae9-69bb-4366-8eb2-5fcc64cf6430 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:55.720746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece39ae9-69bb-4366-8eb2-5fcc64cf6430 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:55.721200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece39ae9-69bb-4366-8eb2-5fcc64cf6430 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:55.721994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece39ae9-69bb-4366-8eb2-5fcc64cf6430 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:55.722442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece39ae9-69bb-4366-8eb2-5fcc64cf6430 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:55.858942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ece39ae9-69bb-4366-8eb2-5fcc64cf6430 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:55.866670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ece39ae9-69bb-4366-8eb2-5fcc64cf6430 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.157398 Mar 08 04:41:55.867231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1165/2276] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:55 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:56.883490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1a634085-50e0-4690-a3b8-0719c150977d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:56.884102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1a634085-50e0-4690-a3b8-0719c150977d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:56.890864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a634085-50e0-4690-a3b8-0719c150977d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:56.891315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a634085-50e0-4690-a3b8-0719c150977d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:56.892071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a634085-50e0-4690-a3b8-0719c150977d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:56.892505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1a634085-50e0-4690-a3b8-0719c150977d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:57.021584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1a634085-50e0-4690-a3b8-0719c150977d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:57.030261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1a634085-50e0-4690-a3b8-0719c150977d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150549 Mar 08 04:41:57.030829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1112/2277] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:56 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:58.047698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6f68924e-2c37-4822-a81e-21b9cde92716 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:58.048309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6f68924e-2c37-4822-a81e-21b9cde92716 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:58.054566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f68924e-2c37-4822-a81e-21b9cde92716 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:58.055016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f68924e-2c37-4822-a81e-21b9cde92716 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:58.055771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f68924e-2c37-4822-a81e-21b9cde92716 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:58.056265 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f68924e-2c37-4822-a81e-21b9cde92716 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:58.187934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6f68924e-2c37-4822-a81e-21b9cde92716 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:58.195617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6f68924e-2c37-4822-a81e-21b9cde92716 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151833 Mar 08 04:41:58.196181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1166/2278] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:58 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:41:58.507721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b2682613-ab35-420e-a1f6-c25c95cd6931 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:58.508286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b2682613-ab35-420e-a1f6-c25c95cd6931 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:58.514558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2682613-ab35-420e-a1f6-c25c95cd6931 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:58.515001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2682613-ab35-420e-a1f6-c25c95cd6931 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:58.515751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2682613-ab35-420e-a1f6-c25c95cd6931 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:58.516181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b2682613-ab35-420e-a1f6-c25c95cd6931 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:58.538497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b2682613-ab35-420e-a1f6-c25c95cd6931 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194/ips" status: 200 len: 150 microversion: 2.1 time: 0.034602 Mar 08 04:41:58.539043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1113/2279] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:41:58 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:41:59.215711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f049b5d6-dcb2-4261-a966-058e7d8ac92b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:41:59.216327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f049b5d6-dcb2-4261-a966-058e7d8ac92b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:41:59.222611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f049b5d6-dcb2-4261-a966-058e7d8ac92b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:59.223063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f049b5d6-dcb2-4261-a966-058e7d8ac92b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:59.223831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f049b5d6-dcb2-4261-a966-058e7d8ac92b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:41:59.224273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f049b5d6-dcb2-4261-a966-058e7d8ac92b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:41:59.355367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f049b5d6-dcb2-4261-a966-058e7d8ac92b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:41:59.363388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f049b5d6-dcb2-4261-a966-058e7d8ac92b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152160 Mar 08 04:41:59.363963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1167/2280] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:41:59 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:00.377706 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-60b5b525-ec70-4060-9605-68d6b776bc99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:00.378223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-60b5b525-ec70-4060-9605-68d6b776bc99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:00.379856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-92861970-cc47-4651-a89a-8b40570b25a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:00.380955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-92861970-cc47-4651-a89a-8b40570b25a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:00.385505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-60b5b525-ec70-4060-9605-68d6b776bc99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:00.385998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-60b5b525-ec70-4060-9605-68d6b776bc99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:00.386820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-60b5b525-ec70-4060-9605-68d6b776bc99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:00.387380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-60b5b525-ec70-4060-9605-68d6b776bc99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:00.388040 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92861970-cc47-4651-a89a-8b40570b25a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:00.388485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92861970-cc47-4651-a89a-8b40570b25a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:00.389253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92861970-cc47-4651-a89a-8b40570b25a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:00.389704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92861970-cc47-4651-a89a-8b40570b25a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:00.418128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-60b5b525-ec70-4060-9605-68d6b776bc99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:42:00.511380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-60b5b525-ec70-4060-9605-68d6b776bc99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 204 len: 0 microversion: 2.1 time: 0.137039 Mar 08 04:42:00.512596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1114/2281] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:42:00 2022] DELETE /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:42:00.521208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7898f728-0370-4fd6-9c75-a9c4ac3e0498 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:00.522051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7898f728-0370-4fd6-9c75-a9c4ac3e0498 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:00.528792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7898f728-0370-4fd6-9c75-a9c4ac3e0498 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:00.529298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7898f728-0370-4fd6-9c75-a9c4ac3e0498 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:00.530037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7898f728-0370-4fd6-9c75-a9c4ac3e0498 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:00.530473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7898f728-0370-4fd6-9c75-a9c4ac3e0498 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:00.542442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-92861970-cc47-4651-a89a-8b40570b25a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:00.550232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-92861970-cc47-4651-a89a-8b40570b25a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.174093 Mar 08 04:42:00.550808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1168/2282] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:00 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:00.666689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7898f728-0370-4fd6-9c75-a9c4ac3e0498 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:00.674358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7898f728-0370-4fd6-9c75-a9c4ac3e0498 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.157614 Mar 08 04:42:00.674914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1115/2283] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:01.567184 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0aa37345-334d-4663-a60a-2d9e6c3e37c7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:01.567793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0aa37345-334d-4663-a60a-2d9e6c3e37c7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:01.574276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aa37345-334d-4663-a60a-2d9e6c3e37c7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:01.574741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aa37345-334d-4663-a60a-2d9e6c3e37c7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:01.575546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aa37345-334d-4663-a60a-2d9e6c3e37c7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:01.575986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0aa37345-334d-4663-a60a-2d9e6c3e37c7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:01.691381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9d91ba76-73bc-4afb-be93-ab06fc9ecab7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:01.691987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9d91ba76-73bc-4afb-be93-ab06fc9ecab7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:01.698489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d91ba76-73bc-4afb-be93-ab06fc9ecab7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:01.698944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d91ba76-73bc-4afb-be93-ab06fc9ecab7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:01.699717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d91ba76-73bc-4afb-be93-ab06fc9ecab7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:01.700157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d91ba76-73bc-4afb-be93-ab06fc9ecab7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:01.707014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0aa37345-334d-4663-a60a-2d9e6c3e37c7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:01.715541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0aa37345-334d-4663-a60a-2d9e6c3e37c7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152150 Mar 08 04:42:01.716127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1169/2284] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:01 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:01.836918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9d91ba76-73bc-4afb-be93-ab06fc9ecab7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:01.845348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9d91ba76-73bc-4afb-be93-ab06fc9ecab7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.157817 Mar 08 04:42:01.845935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1116/2285] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:02.734595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d56f29d1-1b70-4372-b91e-7fcee9e6c746 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:02.735208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d56f29d1-1b70-4372-b91e-7fcee9e6c746 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:02.741433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d56f29d1-1b70-4372-b91e-7fcee9e6c746 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:02.741917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d56f29d1-1b70-4372-b91e-7fcee9e6c746 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:02.742688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d56f29d1-1b70-4372-b91e-7fcee9e6c746 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:02.743128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d56f29d1-1b70-4372-b91e-7fcee9e6c746 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:02.863063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-25837714-b393-4212-b20f-b684cf43edc5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:02.863654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-25837714-b393-4212-b20f-b684cf43edc5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:02.870427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25837714-b393-4212-b20f-b684cf43edc5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:02.870874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25837714-b393-4212-b20f-b684cf43edc5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:02.871643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25837714-b393-4212-b20f-b684cf43edc5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:02.872082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-25837714-b393-4212-b20f-b684cf43edc5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:02.874280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d56f29d1-1b70-4372-b91e-7fcee9e6c746 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:02.882064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d56f29d1-1b70-4372-b91e-7fcee9e6c746 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151313 Mar 08 04:42:02.882639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1170/2286] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:02 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:03.007845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-25837714-b393-4212-b20f-b684cf43edc5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:03.015748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-25837714-b393-4212-b20f-b684cf43edc5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.156626 Mar 08 04:42:03.016312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1117/2287] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:03.898351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7b802727-efb5-4b57-95c5-d3447ed2571c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:03.899139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7b802727-efb5-4b57-95c5-d3447ed2571c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:03.905943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b802727-efb5-4b57-95c5-d3447ed2571c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:03.906388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b802727-efb5-4b57-95c5-d3447ed2571c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:03.907137 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b802727-efb5-4b57-95c5-d3447ed2571c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:03.907570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b802727-efb5-4b57-95c5-d3447ed2571c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:04.032305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5d6b5afa-ee44-4b56-b5a9-539b858d45b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:04.032939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5d6b5afa-ee44-4b56-b5a9-539b858d45b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:04.036484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7b802727-efb5-4b57-95c5-d3447ed2571c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:04.039428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5d6b5afa-ee44-4b56-b5a9-539b858d45b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:04.039876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5d6b5afa-ee44-4b56-b5a9-539b858d45b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:04.040638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5d6b5afa-ee44-4b56-b5a9-539b858d45b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:04.041099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5d6b5afa-ee44-4b56-b5a9-539b858d45b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:04.044468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7b802727-efb5-4b57-95c5-d3447ed2571c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149982 Mar 08 04:42:04.045115 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1171/2288] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:03 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:04.173311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5d6b5afa-ee44-4b56-b5a9-539b858d45b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:04.181033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5d6b5afa-ee44-4b56-b5a9-539b858d45b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.152632 Mar 08 04:42:04.181590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1118/2289] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:04 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:05.062306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-64c1b624-11b8-4325-b22b-4de2b12e1560 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:05.062914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-64c1b624-11b8-4325-b22b-4de2b12e1560 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:05.068803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64c1b624-11b8-4325-b22b-4de2b12e1560 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:05.069245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64c1b624-11b8-4325-b22b-4de2b12e1560 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:05.070026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64c1b624-11b8-4325-b22b-4de2b12e1560 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:05.070465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64c1b624-11b8-4325-b22b-4de2b12e1560 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:05.198854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fcca386d-80ad-4020-b972-08ea54306738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:05.199543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fcca386d-80ad-4020-b972-08ea54306738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:05.205712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fcca386d-80ad-4020-b972-08ea54306738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:05.205954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-64c1b624-11b8-4325-b22b-4de2b12e1560 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:05.206167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fcca386d-80ad-4020-b972-08ea54306738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:05.206930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fcca386d-80ad-4020-b972-08ea54306738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:05.207362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fcca386d-80ad-4020-b972-08ea54306738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:05.214002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-64c1b624-11b8-4325-b22b-4de2b12e1560 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155996 Mar 08 04:42:05.215446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1172/2290] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:05 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:05.335889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fcca386d-80ad-4020-b972-08ea54306738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:05.344035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fcca386d-80ad-4020-b972-08ea54306738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.149139 Mar 08 04:42:05.344581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1119/2291] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:06.232146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1c3dede3-47c3-480f-9379-b48d78541ad9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:06.232760 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1c3dede3-47c3-480f-9379-b48d78541ad9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:06.239034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c3dede3-47c3-480f-9379-b48d78541ad9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:06.239487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c3dede3-47c3-480f-9379-b48d78541ad9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:06.240253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c3dede3-47c3-480f-9379-b48d78541ad9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:06.240696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c3dede3-47c3-480f-9379-b48d78541ad9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:06.360935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c0529386-00b2-46e7-bf84-2057b0d1b6f0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:06.361541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c0529386-00b2-46e7-bf84-2057b0d1b6f0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:06.367446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c0529386-00b2-46e7-bf84-2057b0d1b6f0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:06.367897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c0529386-00b2-46e7-bf84-2057b0d1b6f0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:06.368662 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c0529386-00b2-46e7-bf84-2057b0d1b6f0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:06.369103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c0529386-00b2-46e7-bf84-2057b0d1b6f0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:06.373652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1c3dede3-47c3-480f-9379-b48d78541ad9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:06.381322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1c3dede3-47c3-480f-9379-b48d78541ad9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153417 Mar 08 04:42:06.381920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1173/2292] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:06 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:06.497509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c0529386-00b2-46e7-bf84-2057b0d1b6f0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:06.505265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c0529386-00b2-46e7-bf84-2057b0d1b6f0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.148285 Mar 08 04:42:06.505845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1120/2293] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:07.398314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9367808d-6295-45be-a941-b7c5f3e2d92a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:07.399152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9367808d-6295-45be-a941-b7c5f3e2d92a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:07.406095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9367808d-6295-45be-a941-b7c5f3e2d92a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:07.406542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9367808d-6295-45be-a941-b7c5f3e2d92a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:07.407298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9367808d-6295-45be-a941-b7c5f3e2d92a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:07.407733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9367808d-6295-45be-a941-b7c5f3e2d92a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:07.522749 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e1f806ce-714a-492e-9f21-77dc41221db3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:07.523356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e1f806ce-714a-492e-9f21-77dc41221db3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:07.529971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1f806ce-714a-492e-9f21-77dc41221db3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:07.530418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1f806ce-714a-492e-9f21-77dc41221db3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:07.531180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1f806ce-714a-492e-9f21-77dc41221db3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:07.531616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e1f806ce-714a-492e-9f21-77dc41221db3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:07.540745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9367808d-6295-45be-a941-b7c5f3e2d92a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:07.548773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9367808d-6295-45be-a941-b7c5f3e2d92a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154312 Mar 08 04:42:07.549350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1174/2294] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:07 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:07.666074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e1f806ce-714a-492e-9f21-77dc41221db3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:07.673744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e1f806ce-714a-492e-9f21-77dc41221db3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.154993 Mar 08 04:42:07.674307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1121/2295] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:07 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:08.690567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ebbbf1de-63bc-44f3-8086-97db08c05ddf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:08.691206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ebbbf1de-63bc-44f3-8086-97db08c05ddf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:08.697377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ebbbf1de-63bc-44f3-8086-97db08c05ddf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:08.697868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ebbbf1de-63bc-44f3-8086-97db08c05ddf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:08.698883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ebbbf1de-63bc-44f3-8086-97db08c05ddf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:08.699320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ebbbf1de-63bc-44f3-8086-97db08c05ddf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:08.708065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7a2c22fb-2ce2-44b3-9da3-2a7c31ef0433 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:08.708684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7a2c22fb-2ce2-44b3-9da3-2a7c31ef0433 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:08.714479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a2c22fb-2ce2-44b3-9da3-2a7c31ef0433 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:08.714935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a2c22fb-2ce2-44b3-9da3-2a7c31ef0433 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:08.715707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a2c22fb-2ce2-44b3-9da3-2a7c31ef0433 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:08.716142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a2c22fb-2ce2-44b3-9da3-2a7c31ef0433 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:08.901272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ebbbf1de-63bc-44f3-8086-97db08c05ddf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:08.907993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7a2c22fb-2ce2-44b3-9da3-2a7c31ef0433 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:08.909007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ebbbf1de-63bc-44f3-8086-97db08c05ddf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.222236 Mar 08 04:42:08.909571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1122/2296] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:08 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:08.915718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7a2c22fb-2ce2-44b3-9da3-2a7c31ef0433 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.353416 Mar 08 04:42:08.916295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1175/2297] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:08 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:09.926754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-267ab7ea-6b8e-44ef-bc53-d832005f446c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:09.927480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-267ab7ea-6b8e-44ef-bc53-d832005f446c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:09.932140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9cd32e55-9955-4282-98e3-3fe66d4540ed tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:09.933357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9cd32e55-9955-4282-98e3-3fe66d4540ed tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:09.934303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-267ab7ea-6b8e-44ef-bc53-d832005f446c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:09.934755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-267ab7ea-6b8e-44ef-bc53-d832005f446c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:09.935521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-267ab7ea-6b8e-44ef-bc53-d832005f446c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:09.935954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-267ab7ea-6b8e-44ef-bc53-d832005f446c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:09.939460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9cd32e55-9955-4282-98e3-3fe66d4540ed tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:09.939904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9cd32e55-9955-4282-98e3-3fe66d4540ed tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:09.940686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9cd32e55-9955-4282-98e3-3fe66d4540ed tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:09.941117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9cd32e55-9955-4282-98e3-3fe66d4540ed tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:10.129680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-267ab7ea-6b8e-44ef-bc53-d832005f446c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:10.133652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9cd32e55-9955-4282-98e3-3fe66d4540ed tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:10.137571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-267ab7ea-6b8e-44ef-bc53-d832005f446c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.214656 Mar 08 04:42:10.138169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1123/2298] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:09 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:10.141402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9cd32e55-9955-4282-98e3-3fe66d4540ed tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.213042 Mar 08 04:42:10.141972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1176/2299] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:09 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:11.154850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1c9d30ff-93a3-4149-925e-47c53fdcb3d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:11.155377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1c9d30ff-93a3-4149-925e-47c53fdcb3d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:11.158361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b0442393-07b8-48af-baa6-26b203439a6a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:11.158973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b0442393-07b8-48af-baa6-26b203439a6a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:11.161650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c9d30ff-93a3-4149-925e-47c53fdcb3d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:11.162136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c9d30ff-93a3-4149-925e-47c53fdcb3d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:11.162907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c9d30ff-93a3-4149-925e-47c53fdcb3d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:11.163352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c9d30ff-93a3-4149-925e-47c53fdcb3d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:11.164989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0442393-07b8-48af-baa6-26b203439a6a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:11.165432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0442393-07b8-48af-baa6-26b203439a6a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:11.166308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0442393-07b8-48af-baa6-26b203439a6a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:11.166739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0442393-07b8-48af-baa6-26b203439a6a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:11.360355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1c9d30ff-93a3-4149-925e-47c53fdcb3d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:11.364817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b0442393-07b8-48af-baa6-26b203439a6a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:11.368292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1c9d30ff-93a3-4149-925e-47c53fdcb3d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.218123 Mar 08 04:42:11.368858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1124/2300] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:11.373287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b0442393-07b8-48af-baa6-26b203439a6a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218656 Mar 08 04:42:11.373889 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1177/2301] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:11 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:12.386747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9253c0bb-1752-4c13-b6f2-cf329ff0ce29 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:12.387392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9253c0bb-1752-4c13-b6f2-cf329ff0ce29 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:12.398228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-575c8cc2-0d92-4523-9ab4-e28a636ccebc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:12.398228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-575c8cc2-0d92-4523-9ab4-e28a636ccebc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:12.398767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9253c0bb-1752-4c13-b6f2-cf329ff0ce29 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:12.398767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9253c0bb-1752-4c13-b6f2-cf329ff0ce29 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:12.398767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9253c0bb-1752-4c13-b6f2-cf329ff0ce29 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:12.398767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9253c0bb-1752-4c13-b6f2-cf329ff0ce29 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:12.399398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-575c8cc2-0d92-4523-9ab4-e28a636ccebc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:12.399398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-575c8cc2-0d92-4523-9ab4-e28a636ccebc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:12.399398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-575c8cc2-0d92-4523-9ab4-e28a636ccebc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:12.399398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-575c8cc2-0d92-4523-9ab4-e28a636ccebc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:12.587049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-575c8cc2-0d92-4523-9ab4-e28a636ccebc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:12.594126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9253c0bb-1752-4c13-b6f2-cf329ff0ce29 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:12.595871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-575c8cc2-0d92-4523-9ab4-e28a636ccebc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.208819 Mar 08 04:42:12.596445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1178/2302] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:12 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:12.601792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9253c0bb-1752-4c13-b6f2-cf329ff0ce29 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.219486 Mar 08 04:42:12.602334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1125/2303] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:13.612826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-86a4db2c-672b-4619-a86a-b743a644b816 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:13.613467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-86a4db2c-672b-4619-a86a-b743a644b816 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:13.618750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e10dfad2-b889-402d-9b5e-02bc3ea01abd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:13.619303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e10dfad2-b889-402d-9b5e-02bc3ea01abd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:13.619746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86a4db2c-672b-4619-a86a-b743a644b816 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:13.620194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86a4db2c-672b-4619-a86a-b743a644b816 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:13.620961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86a4db2c-672b-4619-a86a-b743a644b816 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:13.621389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-86a4db2c-672b-4619-a86a-b743a644b816 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:13.625712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e10dfad2-b889-402d-9b5e-02bc3ea01abd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:13.626170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e10dfad2-b889-402d-9b5e-02bc3ea01abd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:13.626933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e10dfad2-b889-402d-9b5e-02bc3ea01abd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:13.627377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e10dfad2-b889-402d-9b5e-02bc3ea01abd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:13.818655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-86a4db2c-672b-4619-a86a-b743a644b816 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:13.821531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e10dfad2-b889-402d-9b5e-02bc3ea01abd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:13.827273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-86a4db2c-672b-4619-a86a-b743a644b816 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218261 Mar 08 04:42:13.827863 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1179/2304] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:13 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:13.829948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e10dfad2-b889-402d-9b5e-02bc3ea01abd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.215010 Mar 08 04:42:13.830636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1126/2305] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:13 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:14.844611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-44674d7c-40ed-474c-a124-7c3e5d70768c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:14.845129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-44674d7c-40ed-474c-a124-7c3e5d70768c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:14.846669 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-91b1450b-cfb3-4d96-92fc-1f4ec2a2a4c7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:14.847311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-91b1450b-cfb3-4d96-92fc-1f4ec2a2a4c7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:14.852449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44674d7c-40ed-474c-a124-7c3e5d70768c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:14.852956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44674d7c-40ed-474c-a124-7c3e5d70768c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:14.853697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91b1450b-cfb3-4d96-92fc-1f4ec2a2a4c7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:14.855061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44674d7c-40ed-474c-a124-7c3e5d70768c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:14.855165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91b1450b-cfb3-4d96-92fc-1f4ec2a2a4c7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:14.855277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44674d7c-40ed-474c-a124-7c3e5d70768c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:14.855696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91b1450b-cfb3-4d96-92fc-1f4ec2a2a4c7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:14.856182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91b1450b-cfb3-4d96-92fc-1f4ec2a2a4c7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:15.053642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-44674d7c-40ed-474c-a124-7c3e5d70768c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:15.059848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-91b1450b-cfb3-4d96-92fc-1f4ec2a2a4c7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:15.061517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-44674d7c-40ed-474c-a124-7c3e5d70768c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.220934 Mar 08 04:42:15.062116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1180/2306] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:14 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:15.067779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-91b1450b-cfb3-4d96-92fc-1f4ec2a2a4c7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.224864 Mar 08 04:42:15.068342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1127/2307] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:16.079328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8512d485-eb90-4b94-bf85-81c8425ce4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:16.079950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8512d485-eb90-4b94-bf85-81c8425ce4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:16.086020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cd3cca83-e25a-4b7f-8c5a-13bad8e98e22 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:16.086532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8512d485-eb90-4b94-bf85-81c8425ce4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:16.086664 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cd3cca83-e25a-4b7f-8c5a-13bad8e98e22 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:16.086771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8512d485-eb90-4b94-bf85-81c8425ce4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:16.087483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8512d485-eb90-4b94-bf85-81c8425ce4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:16.087912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8512d485-eb90-4b94-bf85-81c8425ce4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:16.094876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd3cca83-e25a-4b7f-8c5a-13bad8e98e22 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:16.095327 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd3cca83-e25a-4b7f-8c5a-13bad8e98e22 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:16.096110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd3cca83-e25a-4b7f-8c5a-13bad8e98e22 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:16.096547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd3cca83-e25a-4b7f-8c5a-13bad8e98e22 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:16.287258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8512d485-eb90-4b94-bf85-81c8425ce4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:16.290351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cd3cca83-e25a-4b7f-8c5a-13bad8e98e22 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:16.295578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8512d485-eb90-4b94-bf85-81c8425ce4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.220075 Mar 08 04:42:16.296063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1181/2308] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:16 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:16.298163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cd3cca83-e25a-4b7f-8c5a-13bad8e98e22 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.216299 Mar 08 04:42:16.298737 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1128/2309] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:16 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:17.312607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c624a990-e474-40b6-b3e5-8c825f1e613a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:17.313216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c624a990-e474-40b6-b3e5-8c825f1e613a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:17.314682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c25b9bdb-ac00-496a-a0b5-1a864ff37a20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:17.315277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c25b9bdb-ac00-496a-a0b5-1a864ff37a20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:17.319961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c624a990-e474-40b6-b3e5-8c825f1e613a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:17.320374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c624a990-e474-40b6-b3e5-8c825f1e613a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:17.321121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c624a990-e474-40b6-b3e5-8c825f1e613a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:17.321398 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c25b9bdb-ac00-496a-a0b5-1a864ff37a20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:17.321552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c624a990-e474-40b6-b3e5-8c825f1e613a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:17.321879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c25b9bdb-ac00-496a-a0b5-1a864ff37a20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:17.322639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c25b9bdb-ac00-496a-a0b5-1a864ff37a20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:17.323810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c25b9bdb-ac00-496a-a0b5-1a864ff37a20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:17.519365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c25b9bdb-ac00-496a-a0b5-1a864ff37a20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:17.523393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c624a990-e474-40b6-b3e5-8c825f1e613a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:17.527858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c25b9bdb-ac00-496a-a0b5-1a864ff37a20 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.216880 Mar 08 04:42:17.528420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1129/2310] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:17.531458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c624a990-e474-40b6-b3e5-8c825f1e613a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.222883 Mar 08 04:42:17.532007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1182/2311] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:17 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:18.545355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8ad78169-30d8-4c43-83a4-2fe8b0d0ea18 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:18.545927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8ad78169-30d8-4c43-83a4-2fe8b0d0ea18 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:18.548077 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-546f037f-2fb2-4b72-a8b6-17f4c629de05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:18.548684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-546f037f-2fb2-4b72-a8b6-17f4c629de05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:18.552150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ad78169-30d8-4c43-83a4-2fe8b0d0ea18 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:18.552593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ad78169-30d8-4c43-83a4-2fe8b0d0ea18 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:18.553358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ad78169-30d8-4c43-83a4-2fe8b0d0ea18 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:18.553829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ad78169-30d8-4c43-83a4-2fe8b0d0ea18 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:18.554556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-546f037f-2fb2-4b72-a8b6-17f4c629de05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:18.555003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-546f037f-2fb2-4b72-a8b6-17f4c629de05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:18.555753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-546f037f-2fb2-4b72-a8b6-17f4c629de05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:18.556187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-546f037f-2fb2-4b72-a8b6-17f4c629de05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:18.748725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8ad78169-30d8-4c43-83a4-2fe8b0d0ea18 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:18.755493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-546f037f-2fb2-4b72-a8b6-17f4c629de05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:18.756477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8ad78169-30d8-4c43-83a4-2fe8b0d0ea18 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.215667 Mar 08 04:42:18.757048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1130/2312] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:18 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:18.763699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-546f037f-2fb2-4b72-a8b6-17f4c629de05 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219404 Mar 08 04:42:18.764359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1183/2313] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:18 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:19.774075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6ca2c911-cdc9-43df-b1e9-2722ca9d3019 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:19.774684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6ca2c911-cdc9-43df-b1e9-2722ca9d3019 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:19.780343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5670cd94-d50e-4209-9d27-5d8fdb80513e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:19.780917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ca2c911-cdc9-43df-b1e9-2722ca9d3019 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:19.781049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5670cd94-d50e-4209-9d27-5d8fdb80513e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:19.781361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ca2c911-cdc9-43df-b1e9-2722ca9d3019 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:19.782146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ca2c911-cdc9-43df-b1e9-2722ca9d3019 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:19.782591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ca2c911-cdc9-43df-b1e9-2722ca9d3019 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:19.787083 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5670cd94-d50e-4209-9d27-5d8fdb80513e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:19.787542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5670cd94-d50e-4209-9d27-5d8fdb80513e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:19.788307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5670cd94-d50e-4209-9d27-5d8fdb80513e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:19.788744 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5670cd94-d50e-4209-9d27-5d8fdb80513e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:19.978635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6ca2c911-cdc9-43df-b1e9-2722ca9d3019 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:19.982148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5670cd94-d50e-4209-9d27-5d8fdb80513e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:19.987165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6ca2c911-cdc9-43df-b1e9-2722ca9d3019 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.217164 Mar 08 04:42:19.987730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1131/2314] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:19 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:19.990089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5670cd94-d50e-4209-9d27-5d8fdb80513e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.213435 Mar 08 04:42:19.990647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1184/2315] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:19 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:21.004954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d08527ed-6d53-4714-bb71-5fde97d645db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:21.005486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d08527ed-6d53-4714-bb71-5fde97d645db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:21.007285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c7577893-cb67-45b4-912e-c0ef035c0c0b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:21.007901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c7577893-cb67-45b4-912e-c0ef035c0c0b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:21.011795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d08527ed-6d53-4714-bb71-5fde97d645db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:21.012229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d08527ed-6d53-4714-bb71-5fde97d645db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:21.012985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d08527ed-6d53-4714-bb71-5fde97d645db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:21.013445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d08527ed-6d53-4714-bb71-5fde97d645db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:21.014144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c7577893-cb67-45b4-912e-c0ef035c0c0b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:21.014592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c7577893-cb67-45b4-912e-c0ef035c0c0b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:21.015354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c7577893-cb67-45b4-912e-c0ef035c0c0b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:21.015790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c7577893-cb67-45b4-912e-c0ef035c0c0b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:21.208985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d08527ed-6d53-4714-bb71-5fde97d645db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:21.213235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c7577893-cb67-45b4-912e-c0ef035c0c0b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:21.217822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d08527ed-6d53-4714-bb71-5fde97d645db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.216722 Mar 08 04:42:21.218391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1132/2316] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:21.221882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c7577893-cb67-45b4-912e-c0ef035c0c0b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218334 Mar 08 04:42:21.222513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1185/2317] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:21 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:22.235425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-171034be-70bf-4455-8215-2dbcc099fbc4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:22.236029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-171034be-70bf-4455-8215-2dbcc099fbc4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:22.239025 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-186cfc40-70a5-4f91-9481-296c2957b27a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:22.239640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-186cfc40-70a5-4f91-9481-296c2957b27a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:22.242341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-171034be-70bf-4455-8215-2dbcc099fbc4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:22.242787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-171034be-70bf-4455-8215-2dbcc099fbc4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:22.243543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-171034be-70bf-4455-8215-2dbcc099fbc4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:22.243974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-171034be-70bf-4455-8215-2dbcc099fbc4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:22.246634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-186cfc40-70a5-4f91-9481-296c2957b27a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:22.247140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-186cfc40-70a5-4f91-9481-296c2957b27a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:22.247911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-186cfc40-70a5-4f91-9481-296c2957b27a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:22.248352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-186cfc40-70a5-4f91-9481-296c2957b27a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:22.439440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-171034be-70bf-4455-8215-2dbcc099fbc4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:22.442710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-186cfc40-70a5-4f91-9481-296c2957b27a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:22.447415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-171034be-70bf-4455-8215-2dbcc099fbc4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.215797 Mar 08 04:42:22.449695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1133/2318] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:22.453078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-186cfc40-70a5-4f91-9481-296c2957b27a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.217825 Mar 08 04:42:22.453818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1186/2319] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:22 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:23.464876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bfee2717-5787-4ae3-b2ce-588ada97a134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:23.465491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bfee2717-5787-4ae3-b2ce-588ada97a134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:23.472023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfee2717-5787-4ae3-b2ce-588ada97a134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:23.472529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfee2717-5787-4ae3-b2ce-588ada97a134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:23.472657 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-94116451-d2c5-4fb0-a784-00afde454001 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:23.473162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-94116451-d2c5-4fb0-a784-00afde454001 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:23.473448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfee2717-5787-4ae3-b2ce-588ada97a134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:23.473916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfee2717-5787-4ae3-b2ce-588ada97a134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:23.479225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94116451-d2c5-4fb0-a784-00afde454001 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:23.479683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94116451-d2c5-4fb0-a784-00afde454001 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:23.480465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94116451-d2c5-4fb0-a784-00afde454001 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:23.480906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-94116451-d2c5-4fb0-a784-00afde454001 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:23.685134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bfee2717-5787-4ae3-b2ce-588ada97a134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:23.689244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-94116451-d2c5-4fb0-a784-00afde454001 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:23.692999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bfee2717-5787-4ae3-b2ce-588ada97a134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.232971 Mar 08 04:42:23.693569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1134/2320] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:23.696935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-94116451-d2c5-4fb0-a784-00afde454001 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.228621 Mar 08 04:42:23.698320 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1187/2321] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:23 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:24.710756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0911258d-8953-4f81-8a65-85eda60a7cbf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:24.711365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0911258d-8953-4f81-8a65-85eda60a7cbf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:24.715689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-73890dc0-8538-44a6-af56-aea9f75177df tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:24.716337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-73890dc0-8538-44a6-af56-aea9f75177df tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:24.718479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0911258d-8953-4f81-8a65-85eda60a7cbf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:24.718925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0911258d-8953-4f81-8a65-85eda60a7cbf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:24.719700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0911258d-8953-4f81-8a65-85eda60a7cbf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:24.720126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0911258d-8953-4f81-8a65-85eda60a7cbf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:24.722501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73890dc0-8538-44a6-af56-aea9f75177df tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:24.722952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73890dc0-8538-44a6-af56-aea9f75177df tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:24.723725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73890dc0-8538-44a6-af56-aea9f75177df tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:24.724166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73890dc0-8538-44a6-af56-aea9f75177df tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:24.920446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0911258d-8953-4f81-8a65-85eda60a7cbf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:24.927345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-73890dc0-8538-44a6-af56-aea9f75177df tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:24.928167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0911258d-8953-4f81-8a65-85eda60a7cbf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.221454 Mar 08 04:42:24.928902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1135/2322] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:24.935868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-73890dc0-8538-44a6-af56-aea9f75177df tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.224881 Mar 08 04:42:24.936499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1188/2323] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:24 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:25.945828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-04541e33-bb13-4a0b-9af3-bdbf8992955e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:25.946438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-04541e33-bb13-4a0b-9af3-bdbf8992955e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:25.952549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d36b7c7a-2745-49c9-882f-923950081aa4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:25.953153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d36b7c7a-2745-49c9-882f-923950081aa4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:25.953566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04541e33-bb13-4a0b-9af3-bdbf8992955e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:25.954053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04541e33-bb13-4a0b-9af3-bdbf8992955e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:25.954820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04541e33-bb13-4a0b-9af3-bdbf8992955e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:25.955262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-04541e33-bb13-4a0b-9af3-bdbf8992955e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:25.959323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36b7c7a-2745-49c9-882f-923950081aa4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:25.959767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36b7c7a-2745-49c9-882f-923950081aa4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:25.960526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36b7c7a-2745-49c9-882f-923950081aa4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:25.960956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d36b7c7a-2745-49c9-882f-923950081aa4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:26.156846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-04541e33-bb13-4a0b-9af3-bdbf8992955e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:26.159948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d36b7c7a-2745-49c9-882f-923950081aa4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:26.164915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-04541e33-bb13-4a0b-9af3-bdbf8992955e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.222932 Mar 08 04:42:26.165487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1136/2324] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:26.169437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d36b7c7a-2745-49c9-882f-923950081aa4 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219848 Mar 08 04:42:26.169437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1189/2325] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:25 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:27.182945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-23923595-bfb0-4da7-8d91-e3e46bd51de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:27.183547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-23923595-bfb0-4da7-8d91-e3e46bd51de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:27.185864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3508d351-705c-43f9-b82f-dcad7e9c930a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:27.186503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3508d351-705c-43f9-b82f-dcad7e9c930a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:27.189907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-23923595-bfb0-4da7-8d91-e3e46bd51de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:27.190361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-23923595-bfb0-4da7-8d91-e3e46bd51de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:27.191147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-23923595-bfb0-4da7-8d91-e3e46bd51de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:27.191560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-23923595-bfb0-4da7-8d91-e3e46bd51de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:27.192582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3508d351-705c-43f9-b82f-dcad7e9c930a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:27.193033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3508d351-705c-43f9-b82f-dcad7e9c930a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:27.193815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3508d351-705c-43f9-b82f-dcad7e9c930a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:27.194246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3508d351-705c-43f9-b82f-dcad7e9c930a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:27.386923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3508d351-705c-43f9-b82f-dcad7e9c930a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:27.393938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-23923595-bfb0-4da7-8d91-e3e46bd51de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:27.394702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3508d351-705c-43f9-b82f-dcad7e9c930a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.213221 Mar 08 04:42:27.395263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1190/2326] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:27 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:27.402107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-23923595-bfb0-4da7-8d91-e3e46bd51de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.223533 Mar 08 04:42:27.402664 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1137/2327] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:27 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:28.411935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-10ddef52-8a27-4501-86d8-ffeccf77e725 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:28.412571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-10ddef52-8a27-4501-86d8-ffeccf77e725 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:28.419159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6d5d0c2c-ea5b-48b0-b6fc-69de405b4023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:28.419640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10ddef52-8a27-4501-86d8-ffeccf77e725 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:28.419754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6d5d0c2c-ea5b-48b0-b6fc-69de405b4023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:28.419852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10ddef52-8a27-4501-86d8-ffeccf77e725 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:28.420584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10ddef52-8a27-4501-86d8-ffeccf77e725 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:28.421017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10ddef52-8a27-4501-86d8-ffeccf77e725 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:28.425743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d5d0c2c-ea5b-48b0-b6fc-69de405b4023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:28.426190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d5d0c2c-ea5b-48b0-b6fc-69de405b4023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:28.426955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d5d0c2c-ea5b-48b0-b6fc-69de405b4023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:28.427391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d5d0c2c-ea5b-48b0-b6fc-69de405b4023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:28.615781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-10ddef52-8a27-4501-86d8-ffeccf77e725 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:28.619094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6d5d0c2c-ea5b-48b0-b6fc-69de405b4023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:28.624018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-10ddef52-8a27-4501-86d8-ffeccf77e725 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.215893 Mar 08 04:42:28.624600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1191/2328] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:28 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:28.626849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6d5d0c2c-ea5b-48b0-b6fc-69de405b4023 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.211969 Mar 08 04:42:28.627395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1138/2329] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:28 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:29.641250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b31bd6b2-df3f-45d1-a42e-220997bf4728 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:29.641855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b31bd6b2-df3f-45d1-a42e-220997bf4728 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:29.642599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2c182e0e-02ef-43fb-a73d-3c571457543b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:29.643215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2c182e0e-02ef-43fb-a73d-3c571457543b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:29.647942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b31bd6b2-df3f-45d1-a42e-220997bf4728 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:29.648383 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b31bd6b2-df3f-45d1-a42e-220997bf4728 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:29.649408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b31bd6b2-df3f-45d1-a42e-220997bf4728 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:29.649718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2c182e0e-02ef-43fb-a73d-3c571457543b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:29.649869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b31bd6b2-df3f-45d1-a42e-220997bf4728 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:29.650178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2c182e0e-02ef-43fb-a73d-3c571457543b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:29.651034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2c182e0e-02ef-43fb-a73d-3c571457543b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:29.651735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2c182e0e-02ef-43fb-a73d-3c571457543b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:29.845378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2c182e0e-02ef-43fb-a73d-3c571457543b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:29.849231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b31bd6b2-df3f-45d1-a42e-220997bf4728 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:29.853570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2c182e0e-02ef-43fb-a73d-3c571457543b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.214654 Mar 08 04:42:29.855347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1139/2330] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:29.858788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b31bd6b2-df3f-45d1-a42e-220997bf4728 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.221512 Mar 08 04:42:29.859353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1192/2331] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:29 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:30.871937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-31bb3488-747c-4b17-bdf3-a61809a38562 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:30.872559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-31bb3488-747c-4b17-bdf3-a61809a38562 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:30.876223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dda076f1-b6d6-4591-8c6a-7d4c1a86a660 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:30.876831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dda076f1-b6d6-4591-8c6a-7d4c1a86a660 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:30.878910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31bb3488-747c-4b17-bdf3-a61809a38562 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:30.879367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31bb3488-747c-4b17-bdf3-a61809a38562 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:30.880141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31bb3488-747c-4b17-bdf3-a61809a38562 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:30.880579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31bb3488-747c-4b17-bdf3-a61809a38562 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:30.882747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dda076f1-b6d6-4591-8c6a-7d4c1a86a660 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:30.883191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dda076f1-b6d6-4591-8c6a-7d4c1a86a660 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:30.883952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dda076f1-b6d6-4591-8c6a-7d4c1a86a660 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:30.884388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dda076f1-b6d6-4591-8c6a-7d4c1a86a660 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:31.079939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-31bb3488-747c-4b17-bdf3-a61809a38562 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:31.083995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dda076f1-b6d6-4591-8c6a-7d4c1a86a660 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:31.087804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-31bb3488-747c-4b17-bdf3-a61809a38562 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.220447 Mar 08 04:42:31.088414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1140/2332] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:31.091763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dda076f1-b6d6-4591-8c6a-7d4c1a86a660 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219394 Mar 08 04:42:31.092317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1193/2333] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:30 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:32.106218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4bcc7b63-a943-494c-873f-d9e8c00b710a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:32.106745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4bcc7b63-a943-494c-873f-d9e8c00b710a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:32.108554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ff98ff2a-a493-4f35-9a8d-2340adb0ce1c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:32.109192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ff98ff2a-a493-4f35-9a8d-2340adb0ce1c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:32.113028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4bcc7b63-a943-494c-873f-d9e8c00b710a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:32.113479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4bcc7b63-a943-494c-873f-d9e8c00b710a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:32.114275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4bcc7b63-a943-494c-873f-d9e8c00b710a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:32.114710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4bcc7b63-a943-494c-873f-d9e8c00b710a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:32.115291 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff98ff2a-a493-4f35-9a8d-2340adb0ce1c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:32.115738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff98ff2a-a493-4f35-9a8d-2340adb0ce1c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:32.116491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff98ff2a-a493-4f35-9a8d-2340adb0ce1c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:32.116932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff98ff2a-a493-4f35-9a8d-2340adb0ce1c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:32.317454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ff98ff2a-a493-4f35-9a8d-2340adb0ce1c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:32.320686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4bcc7b63-a943-494c-873f-d9e8c00b710a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:32.326402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ff98ff2a-a493-4f35-9a8d-2340adb0ce1c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.221578 Mar 08 04:42:32.326970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1194/2334] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:32 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:32.329140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4bcc7b63-a943-494c-873f-d9e8c00b710a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.227607 Mar 08 04:42:32.329850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1141/2335] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:32 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:33.344398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a02513d8-9cf4-4a59-a290-f2e038097302 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:33.345038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a02513d8-9cf4-4a59-a290-f2e038097302 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:33.346206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-511e0cab-3bed-445e-8d56-cbc5c72fc348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:33.346812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-511e0cab-3bed-445e-8d56-cbc5c72fc348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:33.351261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a02513d8-9cf4-4a59-a290-f2e038097302 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:33.351707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a02513d8-9cf4-4a59-a290-f2e038097302 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:33.352464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a02513d8-9cf4-4a59-a290-f2e038097302 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:33.352898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a02513d8-9cf4-4a59-a290-f2e038097302 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:33.353061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-511e0cab-3bed-445e-8d56-cbc5c72fc348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:33.353509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-511e0cab-3bed-445e-8d56-cbc5c72fc348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:33.354296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-511e0cab-3bed-445e-8d56-cbc5c72fc348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:33.354784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-511e0cab-3bed-445e-8d56-cbc5c72fc348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:33.549785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-511e0cab-3bed-445e-8d56-cbc5c72fc348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:33.552643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a02513d8-9cf4-4a59-a290-f2e038097302 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:33.558242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-511e0cab-3bed-445e-8d56-cbc5c72fc348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.215312 Mar 08 04:42:33.558757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1142/2336] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:33.562186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a02513d8-9cf4-4a59-a290-f2e038097302 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.221313 Mar 08 04:42:33.562942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1195/2337] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:33 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:34.575712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-72a0f74e-3d81-4336-b8c9-8b3859b3afca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:34.576331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-72a0f74e-3d81-4336-b8c9-8b3859b3afca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:34.580249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7cb0d81a-e565-40a2-893c-614bdf181fec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:34.580853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7cb0d81a-e565-40a2-893c-614bdf181fec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:34.582640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72a0f74e-3d81-4336-b8c9-8b3859b3afca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:34.583094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72a0f74e-3d81-4336-b8c9-8b3859b3afca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:34.583874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72a0f74e-3d81-4336-b8c9-8b3859b3afca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:34.584387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-72a0f74e-3d81-4336-b8c9-8b3859b3afca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:34.586629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7cb0d81a-e565-40a2-893c-614bdf181fec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:34.587079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7cb0d81a-e565-40a2-893c-614bdf181fec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:34.587837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7cb0d81a-e565-40a2-893c-614bdf181fec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:34.588275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7cb0d81a-e565-40a2-893c-614bdf181fec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:34.781380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-72a0f74e-3d81-4336-b8c9-8b3859b3afca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:34.784507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7cb0d81a-e565-40a2-893c-614bdf181fec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:34.789166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-72a0f74e-3d81-4336-b8c9-8b3859b3afca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.217983 Mar 08 04:42:34.789857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1143/2338] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:34.793154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7cb0d81a-e565-40a2-893c-614bdf181fec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.217079 Mar 08 04:42:34.793853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1196/2339] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:34 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:35.806976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-11a4d98f-afd4-4590-9567-263d93b33d13 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:35.808210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-11a4d98f-afd4-4590-9567-263d93b33d13 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:35.810672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-13b0a3d3-4ab5-4f7c-90f7-03cb9482bc8c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:35.811287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-13b0a3d3-4ab5-4f7c-90f7-03cb9482bc8c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:35.814518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11a4d98f-afd4-4590-9567-263d93b33d13 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:35.814963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11a4d98f-afd4-4590-9567-263d93b33d13 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:35.815730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11a4d98f-afd4-4590-9567-263d93b33d13 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:35.816160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11a4d98f-afd4-4590-9567-263d93b33d13 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:35.817486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13b0a3d3-4ab5-4f7c-90f7-03cb9482bc8c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:35.817977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13b0a3d3-4ab5-4f7c-90f7-03cb9482bc8c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:35.818966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13b0a3d3-4ab5-4f7c-90f7-03cb9482bc8c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:35.819407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-13b0a3d3-4ab5-4f7c-90f7-03cb9482bc8c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:36.013343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-11a4d98f-afd4-4590-9567-263d93b33d13 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:36.016399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-13b0a3d3-4ab5-4f7c-90f7-03cb9482bc8c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:36.021076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-11a4d98f-afd4-4590-9567-263d93b33d13 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.218197 Mar 08 04:42:36.021643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1144/2340] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:35 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:36.024517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-13b0a3d3-4ab5-4f7c-90f7-03cb9482bc8c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218593 Mar 08 04:42:36.025159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1197/2341] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:35 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:37.038670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-977ef7d1-5f98-4cca-997f-18d8cd15c914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:37.039283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-977ef7d1-5f98-4cca-997f-18d8cd15c914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:37.041181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0045817c-ef53-4b58-8900-d700c677a1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:37.042342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0045817c-ef53-4b58-8900-d700c677a1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:37.047015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-977ef7d1-5f98-4cca-997f-18d8cd15c914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:37.047372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-977ef7d1-5f98-4cca-997f-18d8cd15c914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:37.048167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-977ef7d1-5f98-4cca-997f-18d8cd15c914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:37.048479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0045817c-ef53-4b58-8900-d700c677a1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:37.048598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-977ef7d1-5f98-4cca-997f-18d8cd15c914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:37.048988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0045817c-ef53-4b58-8900-d700c677a1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:37.049787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0045817c-ef53-4b58-8900-d700c677a1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:37.050225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0045817c-ef53-4b58-8900-d700c677a1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:37.245210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-977ef7d1-5f98-4cca-997f-18d8cd15c914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:37.248096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0045817c-ef53-4b58-8900-d700c677a1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:37.253197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-977ef7d1-5f98-4cca-997f-18d8cd15c914 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.218369 Mar 08 04:42:37.253785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1145/2342] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:37 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:37.255789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0045817c-ef53-4b58-8900-d700c677a1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218426 Mar 08 04:42:37.256338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1198/2343] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:37 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:38.270557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c15739d6-77de-444f-90a7-2e5dc7657c7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:38.271172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c15739d6-77de-444f-90a7-2e5dc7657c7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:38.272033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a0d2ac75-b543-4643-8d7d-19e31e03d019 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:38.272636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a0d2ac75-b543-4643-8d7d-19e31e03d019 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:38.277798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c15739d6-77de-444f-90a7-2e5dc7657c7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:38.278253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c15739d6-77de-444f-90a7-2e5dc7657c7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:38.279028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c15739d6-77de-444f-90a7-2e5dc7657c7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:38.279178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d2ac75-b543-4643-8d7d-19e31e03d019 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:38.279490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c15739d6-77de-444f-90a7-2e5dc7657c7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:38.279642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d2ac75-b543-4643-8d7d-19e31e03d019 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:38.280376 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d2ac75-b543-4643-8d7d-19e31e03d019 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:38.280806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d2ac75-b543-4643-8d7d-19e31e03d019 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:38.475315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c15739d6-77de-444f-90a7-2e5dc7657c7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:38.478382 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a0d2ac75-b543-4643-8d7d-19e31e03d019 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:38.483320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c15739d6-77de-444f-90a7-2e5dc7657c7b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.216610 Mar 08 04:42:38.483907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1146/2344] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:38 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:38.486436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a0d2ac75-b543-4643-8d7d-19e31e03d019 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218216 Mar 08 04:42:38.486998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1199/2345] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:38 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:39.500694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ee6e2806-9302-48a2-a047-6f2f21b7d164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:39.501243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ee6e2806-9302-48a2-a047-6f2f21b7d164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:39.503470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-98a4676d-c9e9-4277-b457-0f296274ea14 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:39.504076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-98a4676d-c9e9-4277-b457-0f296274ea14 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:39.507649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee6e2806-9302-48a2-a047-6f2f21b7d164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:39.508098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee6e2806-9302-48a2-a047-6f2f21b7d164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:39.508868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee6e2806-9302-48a2-a047-6f2f21b7d164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:39.509376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee6e2806-9302-48a2-a047-6f2f21b7d164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:39.510143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a4676d-c9e9-4277-b457-0f296274ea14 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:39.511357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a4676d-c9e9-4277-b457-0f296274ea14 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:39.512130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a4676d-c9e9-4277-b457-0f296274ea14 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:39.512562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a4676d-c9e9-4277-b457-0f296274ea14 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:39.929819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-98a4676d-c9e9-4277-b457-0f296274ea14 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:39.932903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ee6e2806-9302-48a2-a047-6f2f21b7d164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:39.937673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-98a4676d-c9e9-4277-b457-0f296274ea14 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.437925 Mar 08 04:42:39.938255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1200/2346] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:39 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:39.940750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ee6e2806-9302-48a2-a047-6f2f21b7d164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.443936 Mar 08 04:42:39.941302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1147/2347] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:39 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:40.954958 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-23fa3964-8dc2-400e-a17d-d469e6c2e51e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:40.955561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-23fa3964-8dc2-400e-a17d-d469e6c2e51e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:40.957512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-45008b1a-b86f-4844-b498-ff6f66f1f5c8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:40.958155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-45008b1a-b86f-4844-b498-ff6f66f1f5c8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:40.961851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23fa3964-8dc2-400e-a17d-d469e6c2e51e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:40.962300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23fa3964-8dc2-400e-a17d-d469e6c2e51e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:40.963089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23fa3964-8dc2-400e-a17d-d469e6c2e51e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:40.963522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23fa3964-8dc2-400e-a17d-d469e6c2e51e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:40.964985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45008b1a-b86f-4844-b498-ff6f66f1f5c8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:40.965433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45008b1a-b86f-4844-b498-ff6f66f1f5c8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:40.966228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45008b1a-b86f-4844-b498-ff6f66f1f5c8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:40.966666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45008b1a-b86f-4844-b498-ff6f66f1f5c8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:41.163398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-23fa3964-8dc2-400e-a17d-d469e6c2e51e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:41.166446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-45008b1a-b86f-4844-b498-ff6f66f1f5c8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:41.171443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-23fa3964-8dc2-400e-a17d-d469e6c2e51e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.220296 Mar 08 04:42:41.172107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1201/2348] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:40 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:41.174535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-45008b1a-b86f-4844-b498-ff6f66f1f5c8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.220780 Mar 08 04:42:41.175099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1148/2349] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:42.189087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7b630321-5b5c-446b-96bd-f6bcf74dec7b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:42.189725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7b630321-5b5c-446b-96bd-f6bcf74dec7b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:42.191884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-14ca6568-c41a-407d-a8e0-ee66be339b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:42.192496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-14ca6568-c41a-407d-a8e0-ee66be339b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:42.196045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b630321-5b5c-446b-96bd-f6bcf74dec7b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:42.196491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b630321-5b5c-446b-96bd-f6bcf74dec7b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:42.197255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b630321-5b5c-446b-96bd-f6bcf74dec7b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:42.197707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b630321-5b5c-446b-96bd-f6bcf74dec7b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:42.199514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-14ca6568-c41a-407d-a8e0-ee66be339b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:42.199967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-14ca6568-c41a-407d-a8e0-ee66be339b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:42.200735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-14ca6568-c41a-407d-a8e0-ee66be339b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:42.201173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-14ca6568-c41a-407d-a8e0-ee66be339b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:42.408056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7b630321-5b5c-446b-96bd-f6bcf74dec7b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:42.411014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-14ca6568-c41a-407d-a8e0-ee66be339b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:42.416028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7b630321-5b5c-446b-96bd-f6bcf74dec7b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.230771 Mar 08 04:42:42.416601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1202/2350] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:42 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:42.418968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-14ca6568-c41a-407d-a8e0-ee66be339b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.230901 Mar 08 04:42:42.419523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1149/2351] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:42 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:43.431732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-36cad1a5-75a9-4dc9-a3f9-85ab260f32a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:43.432371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-36cad1a5-75a9-4dc9-a3f9-85ab260f32a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:43.434563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e8459f17-32e5-4d13-b3c3-cbd4a1013de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:43.435188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e8459f17-32e5-4d13-b3c3-cbd4a1013de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:43.438652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-36cad1a5-75a9-4dc9-a3f9-85ab260f32a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:43.439168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-36cad1a5-75a9-4dc9-a3f9-85ab260f32a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:43.439997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-36cad1a5-75a9-4dc9-a3f9-85ab260f32a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:43.440434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-36cad1a5-75a9-4dc9-a3f9-85ab260f32a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:43.441253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8459f17-32e5-4d13-b3c3-cbd4a1013de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:43.441738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8459f17-32e5-4d13-b3c3-cbd4a1013de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:43.442506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8459f17-32e5-4d13-b3c3-cbd4a1013de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:43.443134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8459f17-32e5-4d13-b3c3-cbd4a1013de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:43.635487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e8459f17-32e5-4d13-b3c3-cbd4a1013de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:43.638737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-36cad1a5-75a9-4dc9-a3f9-85ab260f32a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:43.645572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e8459f17-32e5-4d13-b3c3-cbd4a1013de2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.214344 Mar 08 04:42:43.646469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-36cad1a5-75a9-4dc9-a3f9-85ab260f32a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218574 Mar 08 04:42:43.646812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1150/2352] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:43.647315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1203/2353] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:43 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:44.666090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cfc388d4-a810-4449-8b5c-99e3a7a90093 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:44.666667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e36dfa7e-5b7a-4ed0-bc3e-991e2c4e65e9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:44.667046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cfc388d4-a810-4449-8b5c-99e3a7a90093 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:44.667151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e36dfa7e-5b7a-4ed0-bc3e-991e2c4e65e9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:44.673460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfc388d4-a810-4449-8b5c-99e3a7a90093 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:44.673606 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e36dfa7e-5b7a-4ed0-bc3e-991e2c4e65e9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:44.673935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfc388d4-a810-4449-8b5c-99e3a7a90093 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:44.674055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e36dfa7e-5b7a-4ed0-bc3e-991e2c4e65e9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:44.674689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfc388d4-a810-4449-8b5c-99e3a7a90093 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:44.674797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e36dfa7e-5b7a-4ed0-bc3e-991e2c4e65e9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:44.675119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfc388d4-a810-4449-8b5c-99e3a7a90093 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:44.675224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e36dfa7e-5b7a-4ed0-bc3e-991e2c4e65e9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:44.873758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cfc388d4-a810-4449-8b5c-99e3a7a90093 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:44.876678 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e36dfa7e-5b7a-4ed0-bc3e-991e2c4e65e9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:44.881824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cfc388d4-a810-4449-8b5c-99e3a7a90093 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219485 Mar 08 04:42:44.882389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1151/2354] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:44 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:44.884393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e36dfa7e-5b7a-4ed0-bc3e-991e2c4e65e9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.222099 Mar 08 04:42:44.884953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1204/2355] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:45.898711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bcbc043e-1951-46f3-aa64-87fe79101100 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:45.899436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bcbc043e-1951-46f3-aa64-87fe79101100 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:45.900371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6d574bb4-9108-4327-bd82-6c28034efafd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:45.900978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6d574bb4-9108-4327-bd82-6c28034efafd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:45.905516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bcbc043e-1951-46f3-aa64-87fe79101100 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:45.905999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bcbc043e-1951-46f3-aa64-87fe79101100 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:45.906766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bcbc043e-1951-46f3-aa64-87fe79101100 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:45.907200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bcbc043e-1951-46f3-aa64-87fe79101100 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:45.907464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d574bb4-9108-4327-bd82-6c28034efafd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:45.907915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d574bb4-9108-4327-bd82-6c28034efafd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:45.908679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d574bb4-9108-4327-bd82-6c28034efafd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:45.909113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d574bb4-9108-4327-bd82-6c28034efafd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:46.103621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bcbc043e-1951-46f3-aa64-87fe79101100 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:46.108220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6d574bb4-9108-4327-bd82-6c28034efafd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:46.111784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bcbc043e-1951-46f3-aa64-87fe79101100 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.217104 Mar 08 04:42:46.112538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1152/2356] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:45 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:46.116173 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6d574bb4-9108-4327-bd82-6c28034efafd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.219876 Mar 08 04:42:46.116738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1205/2357] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:45 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:47.129554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7fbc2465-196e-49b9-9025-3a520eb0b680 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:47.130129 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7fbc2465-196e-49b9-9025-3a520eb0b680 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:47.133352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-654f2624-b3b1-4b6c-a693-3beaa4d94164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:47.133991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-654f2624-b3b1-4b6c-a693-3beaa4d94164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:47.137252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fbc2465-196e-49b9-9025-3a520eb0b680 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:47.137623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fbc2465-196e-49b9-9025-3a520eb0b680 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:47.138415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fbc2465-196e-49b9-9025-3a520eb0b680 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:47.138846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7fbc2465-196e-49b9-9025-3a520eb0b680 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:47.140872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-654f2624-b3b1-4b6c-a693-3beaa4d94164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:47.141330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-654f2624-b3b1-4b6c-a693-3beaa4d94164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:47.142131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-654f2624-b3b1-4b6c-a693-3beaa4d94164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:47.142571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-654f2624-b3b1-4b6c-a693-3beaa4d94164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:47.340928 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7fbc2465-196e-49b9-9025-3a520eb0b680 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:47.343426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-654f2624-b3b1-4b6c-a693-3beaa4d94164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:47.348729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7fbc2465-196e-49b9-9025-3a520eb0b680 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.223193 Mar 08 04:42:47.349290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1153/2358] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:47 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:47.351147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-654f2624-b3b1-4b6c-a693-3beaa4d94164 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.221548 Mar 08 04:42:47.351705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1206/2359] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:47 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:48.365753 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1d8e9999-1bb6-458b-9c60-2e4a025c049c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:48.366360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1d8e9999-1bb6-458b-9c60-2e4a025c049c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:48.368212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4619f33a-1533-431c-abed-c4bd46e4cb38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:48.368897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4619f33a-1533-431c-abed-c4bd46e4cb38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:48.372763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d8e9999-1bb6-458b-9c60-2e4a025c049c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:48.373207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d8e9999-1bb6-458b-9c60-2e4a025c049c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:48.373988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d8e9999-1bb6-458b-9c60-2e4a025c049c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:48.374422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d8e9999-1bb6-458b-9c60-2e4a025c049c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:48.374639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4619f33a-1533-431c-abed-c4bd46e4cb38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:48.375094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4619f33a-1533-431c-abed-c4bd46e4cb38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:48.375858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4619f33a-1533-431c-abed-c4bd46e4cb38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:48.376295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4619f33a-1533-431c-abed-c4bd46e4cb38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:48.572990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1d8e9999-1bb6-458b-9c60-2e4a025c049c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:48.576669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4619f33a-1533-431c-abed-c4bd46e4cb38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:48.581695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1d8e9999-1bb6-458b-9c60-2e4a025c049c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219786 Mar 08 04:42:48.582259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1154/2360] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:48 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:48.584440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4619f33a-1533-431c-abed-c4bd46e4cb38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.220263 Mar 08 04:42:48.585045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1207/2361] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:48 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:49.600026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c3829a20-8618-4266-9506-33502e62a22e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:49.600628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c3829a20-8618-4266-9506-33502e62a22e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:49.601544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5019cafc-be8b-43c9-ae97-8eccd23c4755 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:49.602191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5019cafc-be8b-43c9-ae97-8eccd23c4755 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:49.607691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3829a20-8618-4266-9506-33502e62a22e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:49.608134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3829a20-8618-4266-9506-33502e62a22e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:49.608893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3829a20-8618-4266-9506-33502e62a22e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:49.609157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5019cafc-be8b-43c9-ae97-8eccd23c4755 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:49.609332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3829a20-8618-4266-9506-33502e62a22e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:49.609609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5019cafc-be8b-43c9-ae97-8eccd23c4755 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:49.610415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5019cafc-be8b-43c9-ae97-8eccd23c4755 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:49.610854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5019cafc-be8b-43c9-ae97-8eccd23c4755 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:49.807313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c3829a20-8618-4266-9506-33502e62a22e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:49.810263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5019cafc-be8b-43c9-ae97-8eccd23c4755 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:49.815333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c3829a20-8618-4266-9506-33502e62a22e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.219132 Mar 08 04:42:49.816152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1155/2362] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:49 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:49.818114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5019cafc-be8b-43c9-ae97-8eccd23c4755 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.220233 Mar 08 04:42:49.818807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1208/2363] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:49 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:50.833432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f002aa06-ec72-4e84-8c83-4567e75a9e64 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:50.834084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f002aa06-ec72-4e84-8c83-4567e75a9e64 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:50.835222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-25356b27-a4fa-4c04-94f5-bf0ce6bdb4b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:50.835868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-25356b27-a4fa-4c04-94f5-bf0ce6bdb4b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:50.840987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f002aa06-ec72-4e84-8c83-4567e75a9e64 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:50.841473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f002aa06-ec72-4e84-8c83-4567e75a9e64 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:50.842500 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f002aa06-ec72-4e84-8c83-4567e75a9e64 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:50.842910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25356b27-a4fa-4c04-94f5-bf0ce6bdb4b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:50.843045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f002aa06-ec72-4e84-8c83-4567e75a9e64 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:50.843399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25356b27-a4fa-4c04-94f5-bf0ce6bdb4b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:50.844201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25356b27-a4fa-4c04-94f5-bf0ce6bdb4b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:50.844648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25356b27-a4fa-4c04-94f5-bf0ce6bdb4b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:51.040091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-25356b27-a4fa-4c04-94f5-bf0ce6bdb4b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:51.045852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f002aa06-ec72-4e84-8c83-4567e75a9e64 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:51.049197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-25356b27-a4fa-4c04-94f5-bf0ce6bdb4b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.217678 Mar 08 04:42:51.049839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1209/2364] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:50 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:51.054230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f002aa06-ec72-4e84-8c83-4567e75a9e64 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.224637 Mar 08 04:42:51.054862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1156/2365] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:50 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:52.066702 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7af2ed4d-0e93-42c3-bf46-fcb47794e89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:52.067239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7af2ed4d-0e93-42c3-bf46-fcb47794e89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:52.071023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c3519cba-3114-4c71-a417-026808a2eff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:52.071628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c3519cba-3114-4c71-a417-026808a2eff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:52.074076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7af2ed4d-0e93-42c3-bf46-fcb47794e89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:52.074520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7af2ed4d-0e93-42c3-bf46-fcb47794e89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:52.075278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7af2ed4d-0e93-42c3-bf46-fcb47794e89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:52.075710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7af2ed4d-0e93-42c3-bf46-fcb47794e89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:52.078537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3519cba-3114-4c71-a417-026808a2eff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:52.078984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3519cba-3114-4c71-a417-026808a2eff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:52.079736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3519cba-3114-4c71-a417-026808a2eff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:52.080167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3519cba-3114-4c71-a417-026808a2eff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:52.270266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7af2ed4d-0e93-42c3-bf46-fcb47794e89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:52.278841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7af2ed4d-0e93-42c3-bf46-fcb47794e89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.216046 Mar 08 04:42:52.279423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1210/2366] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:52 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:52.281863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c3519cba-3114-4c71-a417-026808a2eff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:52.289842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c3519cba-3114-4c71-a417-026808a2eff2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.222545 Mar 08 04:42:52.290385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1157/2367] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:52 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:53.296235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f72d0dcd-3696-4a40-b2f4-8e9ebb6d28d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:53.296943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f72d0dcd-3696-4a40-b2f4-8e9ebb6d28d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:53.303626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f72d0dcd-3696-4a40-b2f4-8e9ebb6d28d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:53.304073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f72d0dcd-3696-4a40-b2f4-8e9ebb6d28d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:53.305003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f72d0dcd-3696-4a40-b2f4-8e9ebb6d28d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:53.305264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f72d0dcd-3696-4a40-b2f4-8e9ebb6d28d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:53.306278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4c46cd57-33b0-424e-a38e-6c03ba71e35c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:53.306903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4c46cd57-33b0-424e-a38e-6c03ba71e35c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:53.313391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c46cd57-33b0-424e-a38e-6c03ba71e35c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:53.313897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c46cd57-33b0-424e-a38e-6c03ba71e35c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:53.314703 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c46cd57-33b0-424e-a38e-6c03ba71e35c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:53.315136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c46cd57-33b0-424e-a38e-6c03ba71e35c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:53.501270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f72d0dcd-3696-4a40-b2f4-8e9ebb6d28d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:53.508173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4c46cd57-33b0-424e-a38e-6c03ba71e35c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:53.508966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f72d0dcd-3696-4a40-b2f4-8e9ebb6d28d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.217146 Mar 08 04:42:53.509534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1211/2368] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:53 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:53.517039 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4c46cd57-33b0-424e-a38e-6c03ba71e35c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.214499 Mar 08 04:42:53.517805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1158/2369] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:53 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:54.526672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3bd280ed-6547-409f-9e60-3da117253850 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:54.527227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3bd280ed-6547-409f-9e60-3da117253850 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:54.533677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3bd280ed-6547-409f-9e60-3da117253850 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:54.534159 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3bd280ed-6547-409f-9e60-3da117253850 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:54.534904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9646e575-064d-4fe5-8f7b-5a1fde18c00c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:54.535327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3bd280ed-6547-409f-9e60-3da117253850 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:54.535327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3bd280ed-6547-409f-9e60-3da117253850 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:54.535533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9646e575-064d-4fe5-8f7b-5a1fde18c00c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:54.542489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9646e575-064d-4fe5-8f7b-5a1fde18c00c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:54.543091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9646e575-064d-4fe5-8f7b-5a1fde18c00c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:54.543848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9646e575-064d-4fe5-8f7b-5a1fde18c00c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:54.544420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9646e575-064d-4fe5-8f7b-5a1fde18c00c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:54.730469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3bd280ed-6547-409f-9e60-3da117253850 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:54.738192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9646e575-064d-4fe5-8f7b-5a1fde18c00c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:54.738380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3bd280ed-6547-409f-9e60-3da117253850 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.215755 Mar 08 04:42:54.738793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1212/2370] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:54 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:54.746102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9646e575-064d-4fe5-8f7b-5a1fde18c00c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.215160 Mar 08 04:42:54.746756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1159/2371] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:54 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:55.759424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cdae42c3-d047-4b2b-b37e-8e94435969aa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:55.760040 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cdae42c3-d047-4b2b-b37e-8e94435969aa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:55.764654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-478abbec-e6c1-483c-ba82-beab0216d42f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:55.765614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-478abbec-e6c1-483c-ba82-beab0216d42f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:55.767154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdae42c3-d047-4b2b-b37e-8e94435969aa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:55.767605 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdae42c3-d047-4b2b-b37e-8e94435969aa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:55.768379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdae42c3-d047-4b2b-b37e-8e94435969aa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:55.768817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdae42c3-d047-4b2b-b37e-8e94435969aa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:55.771740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-478abbec-e6c1-483c-ba82-beab0216d42f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:55.772189 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-478abbec-e6c1-483c-ba82-beab0216d42f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:55.772961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-478abbec-e6c1-483c-ba82-beab0216d42f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:55.773692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-478abbec-e6c1-483c-ba82-beab0216d42f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:55.967561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cdae42c3-d047-4b2b-b37e-8e94435969aa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:55.969316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-478abbec-e6c1-483c-ba82-beab0216d42f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:55.974391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cdae42c3-d047-4b2b-b37e-8e94435969aa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.221812 Mar 08 04:42:55.974966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1213/2372] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:55 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:55.976984 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-478abbec-e6c1-483c-ba82-beab0216d42f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.217911 Mar 08 04:42:55.977540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1160/2373] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:55 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:56.992257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c96b7288-a74f-4086-b2e8-f0ba4976a4d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:56.992877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c96b7288-a74f-4086-b2e8-f0ba4976a4d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:56.993375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-10e19626-412b-49c1-a5f1-ea134072c84f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:56.994019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-10e19626-412b-49c1-a5f1-ea134072c84f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:56.999231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c96b7288-a74f-4086-b2e8-f0ba4976a4d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:56.999685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c96b7288-a74f-4086-b2e8-f0ba4976a4d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:57.000302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10e19626-412b-49c1-a5f1-ea134072c84f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:57.000486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c96b7288-a74f-4086-b2e8-f0ba4976a4d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:57.000758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10e19626-412b-49c1-a5f1-ea134072c84f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:57.000958 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c96b7288-a74f-4086-b2e8-f0ba4976a4d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:57.001540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10e19626-412b-49c1-a5f1-ea134072c84f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:57.002013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-10e19626-412b-49c1-a5f1-ea134072c84f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:57.196587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c96b7288-a74f-4086-b2e8-f0ba4976a4d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:57.200524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-10e19626-412b-49c1-a5f1-ea134072c84f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:57.205138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c96b7288-a74f-4086-b2e8-f0ba4976a4d5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.216916 Mar 08 04:42:57.205745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1214/2374] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:56 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:57.209677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-10e19626-412b-49c1-a5f1-ea134072c84f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.220179 Mar 08 04:42:57.210226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1161/2375] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:56 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:58.223665 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f1d19aac-f16f-4621-97ed-39fc059103dd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:58.224275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f1d19aac-f16f-4621-97ed-39fc059103dd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:58.226931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f9d903a3-60fb-4130-bbe0-9e266d77c04f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:58.227536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f9d903a3-60fb-4130-bbe0-9e266d77c04f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:58.231354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1d19aac-f16f-4621-97ed-39fc059103dd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:58.231807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1d19aac-f16f-4621-97ed-39fc059103dd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:58.232583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1d19aac-f16f-4621-97ed-39fc059103dd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:58.233020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1d19aac-f16f-4621-97ed-39fc059103dd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:58.234841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9d903a3-60fb-4130-bbe0-9e266d77c04f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:58.235298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9d903a3-60fb-4130-bbe0-9e266d77c04f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:58.236061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9d903a3-60fb-4130-bbe0-9e266d77c04f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:58.236472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f9d903a3-60fb-4130-bbe0-9e266d77c04f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:58.427675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f1d19aac-f16f-4621-97ed-39fc059103dd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:58.431837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f9d903a3-60fb-4130-bbe0-9e266d77c04f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:58.435571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f1d19aac-f16f-4621-97ed-39fc059103dd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.215820 Mar 08 04:42:58.436316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1215/2376] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:58 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:58.440021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f9d903a3-60fb-4130-bbe0-9e266d77c04f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.216779 Mar 08 04:42:58.440586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1162/2377] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:58 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:42:59.453480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-abccba0f-0e9b-47d6-a676-63324b562372 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:59.454190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-abccba0f-0e9b-47d6-a676-63324b562372 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:59.456502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-90d684ce-377b-436a-8ca9-f2390461eea8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:42:59.457130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-90d684ce-377b-436a-8ca9-f2390461eea8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:42:59.460468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-abccba0f-0e9b-47d6-a676-63324b562372 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:59.460912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-abccba0f-0e9b-47d6-a676-63324b562372 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:59.461685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-abccba0f-0e9b-47d6-a676-63324b562372 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:59.462122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-abccba0f-0e9b-47d6-a676-63324b562372 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:59.463822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90d684ce-377b-436a-8ca9-f2390461eea8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:59.464336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90d684ce-377b-436a-8ca9-f2390461eea8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:59.465227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90d684ce-377b-436a-8ca9-f2390461eea8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:42:59.465680 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-90d684ce-377b-436a-8ca9-f2390461eea8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:42:59.664503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-abccba0f-0e9b-47d6-a676-63324b562372 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:59.668196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-90d684ce-377b-436a-8ca9-f2390461eea8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:42:59.673091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-abccba0f-0e9b-47d6-a676-63324b562372 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.223493 Mar 08 04:42:59.673762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1216/2378] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:42:59.675858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-90d684ce-377b-436a-8ca9-f2390461eea8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.223170 Mar 08 04:42:59.676411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1163/2379] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:42:59 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:00.690149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8ffb851c-8d89-4e00-9a62-535ab8ce6978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:00.690765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8ffb851c-8d89-4e00-9a62-535ab8ce6978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:00.692934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1c63de6a-c59a-4fa8-abca-76d4877137c6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:00.696051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1c63de6a-c59a-4fa8-abca-76d4877137c6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:00.699780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ffb851c-8d89-4e00-9a62-535ab8ce6978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:00.700226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ffb851c-8d89-4e00-9a62-535ab8ce6978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:00.700754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c63de6a-c59a-4fa8-abca-76d4877137c6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:00.700994 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ffb851c-8d89-4e00-9a62-535ab8ce6978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:00.701199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c63de6a-c59a-4fa8-abca-76d4877137c6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:00.701429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ffb851c-8d89-4e00-9a62-535ab8ce6978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:00.702155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c63de6a-c59a-4fa8-abca-76d4877137c6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:00.704256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c63de6a-c59a-4fa8-abca-76d4877137c6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:00.900829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8ffb851c-8d89-4e00-9a62-535ab8ce6978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:00.904233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1c63de6a-c59a-4fa8-abca-76d4877137c6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:00.909379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8ffb851c-8d89-4e00-9a62-535ab8ce6978 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.223060 Mar 08 04:43:00.909985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1217/2380] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:00.911964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1c63de6a-c59a-4fa8-abca-76d4877137c6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.222760 Mar 08 04:43:00.912514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1164/2381] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:00 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:01.926639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c79aec37-34d3-4faf-9762-f0a19157183a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:01.927245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c79aec37-34d3-4faf-9762-f0a19157183a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:01.929483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ad16cd96-a2f9-4fb8-aa63-df9724b51910 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:01.930144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ad16cd96-a2f9-4fb8-aa63-df9724b51910 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:01.934244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c79aec37-34d3-4faf-9762-f0a19157183a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:01.934690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c79aec37-34d3-4faf-9762-f0a19157183a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:01.935453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c79aec37-34d3-4faf-9762-f0a19157183a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:01.935886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c79aec37-34d3-4faf-9762-f0a19157183a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:01.936815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad16cd96-a2f9-4fb8-aa63-df9724b51910 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:01.937270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad16cd96-a2f9-4fb8-aa63-df9724b51910 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:01.938059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad16cd96-a2f9-4fb8-aa63-df9724b51910 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:01.938499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad16cd96-a2f9-4fb8-aa63-df9724b51910 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:02.130108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c79aec37-34d3-4faf-9762-f0a19157183a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:02.133318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ad16cd96-a2f9-4fb8-aa63-df9724b51910 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:02.138480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c79aec37-34d3-4faf-9762-f0a19157183a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.215699 Mar 08 04:43:02.139145 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1218/2382] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:02.141143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ad16cd96-a2f9-4fb8-aa63-df9724b51910 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.215445 Mar 08 04:43:02.141806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1165/2383] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:01 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:03.155976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-80db0dec-3d03-46e1-8c56-820a32dae2a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:03.157201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-80db0dec-3d03-46e1-8c56-820a32dae2a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:03.158008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cf8a439f-3fba-47d3-953e-8976c2703169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:03.158619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cf8a439f-3fba-47d3-953e-8976c2703169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:03.163605 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-80db0dec-3d03-46e1-8c56-820a32dae2a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:03.164053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-80db0dec-3d03-46e1-8c56-820a32dae2a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:03.164674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf8a439f-3fba-47d3-953e-8976c2703169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:03.164794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-80db0dec-3d03-46e1-8c56-820a32dae2a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:03.165120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf8a439f-3fba-47d3-953e-8976c2703169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:03.165239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-80db0dec-3d03-46e1-8c56-820a32dae2a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:03.165897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf8a439f-3fba-47d3-953e-8976c2703169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:03.166340 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf8a439f-3fba-47d3-953e-8976c2703169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:03.367451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cf8a439f-3fba-47d3-953e-8976c2703169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:03.370809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-80db0dec-3d03-46e1-8c56-820a32dae2a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:03.375436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cf8a439f-3fba-47d3-953e-8976c2703169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.221147 Mar 08 04:43:03.376019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1166/2384] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:03 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:03.378561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-80db0dec-3d03-46e1-8c56-820a32dae2a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.226599 Mar 08 04:43:03.379128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1219/2385] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:03 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:04.392615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-94ece63d-c497-4f35-86d3-2a3bf58c9ad6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:04.393233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-94ece63d-c497-4f35-86d3-2a3bf58c9ad6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:04.395558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7ff430fe-dde8-4a79-8c4a-2dc6bf0928cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:04.396176 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7ff430fe-dde8-4a79-8c4a-2dc6bf0928cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:04.399890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94ece63d-c497-4f35-86d3-2a3bf58c9ad6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:04.400338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94ece63d-c497-4f35-86d3-2a3bf58c9ad6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:04.401632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94ece63d-c497-4f35-86d3-2a3bf58c9ad6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:04.402185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94ece63d-c497-4f35-86d3-2a3bf58c9ad6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:04.403208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7ff430fe-dde8-4a79-8c4a-2dc6bf0928cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:04.403659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7ff430fe-dde8-4a79-8c4a-2dc6bf0928cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:04.404426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7ff430fe-dde8-4a79-8c4a-2dc6bf0928cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:04.404869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7ff430fe-dde8-4a79-8c4a-2dc6bf0928cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:04.590688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7ff430fe-dde8-4a79-8c4a-2dc6bf0928cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:04.597500 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-94ece63d-c497-4f35-86d3-2a3bf58c9ad6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:04.598390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7ff430fe-dde8-4a79-8c4a-2dc6bf0928cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.206549 Mar 08 04:43:04.598967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1220/2386] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:04 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:04.606108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-94ece63d-c497-4f35-86d3-2a3bf58c9ad6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.217332 Mar 08 04:43:04.606672 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1167/2387] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:04 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:05.616254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-de495250-f230-4de6-b0dc-13df470c3784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:05.616798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-de495250-f230-4de6-b0dc-13df470c3784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:05.623211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-391c905d-04de-4484-82c2-781eca5dbdb1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:05.623819 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-391c905d-04de-4484-82c2-781eca5dbdb1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:05.624489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de495250-f230-4de6-b0dc-13df470c3784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:05.624941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de495250-f230-4de6-b0dc-13df470c3784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:05.625769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de495250-f230-4de6-b0dc-13df470c3784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:05.626197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-de495250-f230-4de6-b0dc-13df470c3784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:05.629695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-391c905d-04de-4484-82c2-781eca5dbdb1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:05.630144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-391c905d-04de-4484-82c2-781eca5dbdb1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:05.630903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-391c905d-04de-4484-82c2-781eca5dbdb1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:05.631336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-391c905d-04de-4484-82c2-781eca5dbdb1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:05.827609 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-391c905d-04de-4484-82c2-781eca5dbdb1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:05.830578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-de495250-f230-4de6-b0dc-13df470c3784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:05.835421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-391c905d-04de-4484-82c2-781eca5dbdb1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.216712 Mar 08 04:43:05.836073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1168/2388] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:05 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:05.838357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-de495250-f230-4de6-b0dc-13df470c3784 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.226069 Mar 08 04:43:05.839712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1221/2389] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:06.853767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4499f70b-9796-474b-9791-cce47a3bf63d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:06.854753 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4499f70b-9796-474b-9791-cce47a3bf63d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:06.856925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fe8472ac-fc13-4da4-a493-13cc1841a790 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:06.857675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fe8472ac-fc13-4da4-a493-13cc1841a790 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:06.861215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4499f70b-9796-474b-9791-cce47a3bf63d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:06.861684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4499f70b-9796-474b-9791-cce47a3bf63d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:06.862655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4499f70b-9796-474b-9791-cce47a3bf63d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:06.863088 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4499f70b-9796-474b-9791-cce47a3bf63d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:06.863733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe8472ac-fc13-4da4-a493-13cc1841a790 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:06.864190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe8472ac-fc13-4da4-a493-13cc1841a790 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:06.865062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe8472ac-fc13-4da4-a493-13cc1841a790 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:06.865509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fe8472ac-fc13-4da4-a493-13cc1841a790 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:07.059473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fe8472ac-fc13-4da4-a493-13cc1841a790 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:07.062007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4499f70b-9796-474b-9791-cce47a3bf63d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:07.067787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fe8472ac-fc13-4da4-a493-13cc1841a790 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.216381 Mar 08 04:43:07.068425 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1222/2390] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:07.070296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4499f70b-9796-474b-9791-cce47a3bf63d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.220531 Mar 08 04:43:07.070855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1169/2391] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:06 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:08.084311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fda33302-4d9a-4127-98ca-3bd75e7085a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:08.084925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fda33302-4d9a-4127-98ca-3bd75e7085a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:08.087040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d2bc0ef0-9e4a-4207-9cde-60ea0bae315e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:08.087642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d2bc0ef0-9e4a-4207-9cde-60ea0bae315e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:08.091494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fda33302-4d9a-4127-98ca-3bd75e7085a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:08.091979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fda33302-4d9a-4127-98ca-3bd75e7085a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:08.092748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fda33302-4d9a-4127-98ca-3bd75e7085a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:08.093194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fda33302-4d9a-4127-98ca-3bd75e7085a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:08.093824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2bc0ef0-9e4a-4207-9cde-60ea0bae315e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:08.094273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2bc0ef0-9e4a-4207-9cde-60ea0bae315e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:08.095025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2bc0ef0-9e4a-4207-9cde-60ea0bae315e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:08.095461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2bc0ef0-9e4a-4207-9cde-60ea0bae315e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:08.294018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d2bc0ef0-9e4a-4207-9cde-60ea0bae315e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:08.296661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fda33302-4d9a-4127-98ca-3bd75e7085a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:08.301706 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d2bc0ef0-9e4a-4207-9cde-60ea0bae315e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.218448 Mar 08 04:43:08.302378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1170/2392] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:08 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:08.304397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fda33302-4d9a-4127-98ca-3bd75e7085a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.223930 Mar 08 04:43:08.304954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1223/2393] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:08 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:09.317879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d4c22c63-3536-4b92-acdc-249072ba9750 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:09.318483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d4c22c63-3536-4b92-acdc-249072ba9750 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:09.321724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-46e4ef51-02c0-4cd0-924c-6cec5c416675 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:09.322149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-46e4ef51-02c0-4cd0-924c-6cec5c416675 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:09.325350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4c22c63-3536-4b92-acdc-249072ba9750 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:09.325837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4c22c63-3536-4b92-acdc-249072ba9750 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:09.326625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4c22c63-3536-4b92-acdc-249072ba9750 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:09.327059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4c22c63-3536-4b92-acdc-249072ba9750 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:09.328132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46e4ef51-02c0-4cd0-924c-6cec5c416675 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:09.328588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46e4ef51-02c0-4cd0-924c-6cec5c416675 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:09.329355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46e4ef51-02c0-4cd0-924c-6cec5c416675 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:09.329828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46e4ef51-02c0-4cd0-924c-6cec5c416675 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:09.526131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-46e4ef51-02c0-4cd0-924c-6cec5c416675 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:09.527939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d4c22c63-3536-4b92-acdc-249072ba9750 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:09.534943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-46e4ef51-02c0-4cd0-924c-6cec5c416675 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1719 microversion: 2.1 time: 0.217340 Mar 08 04:43:09.536974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d4c22c63-3536-4b92-acdc-249072ba9750 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.222386 Mar 08 04:43:09.545170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1224/2394] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:09 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:09.546646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1171/2395] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:09 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:10.274082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-55743a8c-d846-4858-83cd-d8995d406c1b req-f8b76ea6-9883-4aaf-bae6-b9bc8f921bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94db79bc-24f2-47d5-9d3b-f0a2c9da754f", "name": "network-vif-deleted", "tag": "8ccbc290-b8ca-4eec-be1b-6073afa94896"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:43:10.282830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-55743a8c-d846-4858-83cd-d8995d406c1b req-f8b76ea6-9883-4aaf-bae6-b9bc8f921bf5 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:10.283603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-55743a8c-d846-4858-83cd-d8995d406c1b req-f8b76ea6-9883-4aaf-bae6-b9bc8f921bf5 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:10.295965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-55743a8c-d846-4858-83cd-d8995d406c1b req-f8b76ea6-9883-4aaf-bae6-b9bc8f921bf5 service nova] Creating event network-vif-deleted:8ccbc290-b8ca-4eec-be1b-6073afa94896 for instance 94db79bc-24f2-47d5-9d3b-f0a2c9da754f on hv-cinder-73306 Mar 08 04:43:10.302076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-55743a8c-d846-4858-83cd-d8995d406c1b req-f8b76ea6-9883-4aaf-bae6-b9bc8f921bf5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031914 Mar 08 04:43:10.302676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1225/2396] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:43:10.552435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ef1b4b1b-52aa-4616-bf17-0b57c24fa146 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:10.553687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ef1b4b1b-52aa-4616-bf17-0b57c24fa146 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:10.554111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f9df7ead-88e7-46c4-9919-2aac9ba46359 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:10.554834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f9df7ead-88e7-46c4-9919-2aac9ba46359 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:10.560030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef1b4b1b-52aa-4616-bf17-0b57c24fa146 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:10.560703 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef1b4b1b-52aa-4616-bf17-0b57c24fa146 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:10.561217 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9df7ead-88e7-46c4-9919-2aac9ba46359 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:10.561487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef1b4b1b-52aa-4616-bf17-0b57c24fa146 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:10.561954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ef1b4b1b-52aa-4616-bf17-0b57c24fa146 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:10.562110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9df7ead-88e7-46c4-9919-2aac9ba46359 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:10.562875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9df7ead-88e7-46c4-9919-2aac9ba46359 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:10.563640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9df7ead-88e7-46c4-9919-2aac9ba46359 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:10.630806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ef1b4b1b-52aa-4616-bf17-0b57c24fa146 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:10.638931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ef1b4b1b-52aa-4616-bf17-0b57c24fa146 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.090224 Mar 08 04:43:10.648652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1172/2397] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:10 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:10.717493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f9df7ead-88e7-46c4-9919-2aac9ba46359 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:10.725365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f9df7ead-88e7-46c4-9919-2aac9ba46359 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.176212 Mar 08 04:43:10.726054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1226/2398] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:10 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:11.656466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cfd938f1-e964-4892-9fb0-1d7a3afb9a47 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:11.657014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cfd938f1-e964-4892-9fb0-1d7a3afb9a47 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:11.663463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfd938f1-e964-4892-9fb0-1d7a3afb9a47 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:11.663895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfd938f1-e964-4892-9fb0-1d7a3afb9a47 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:11.664649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfd938f1-e964-4892-9fb0-1d7a3afb9a47 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:11.665081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfd938f1-e964-4892-9fb0-1d7a3afb9a47 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:11.727858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cfd938f1-e964-4892-9fb0-1d7a3afb9a47 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:11.736219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cfd938f1-e964-4892-9fb0-1d7a3afb9a47 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083683 Mar 08 04:43:11.736799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1173/2399] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:11.742898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-39a9e2ed-97b6-4a6d-8a82-985ba2c82ba3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:11.743512 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-39a9e2ed-97b6-4a6d-8a82-985ba2c82ba3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:11.750602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39a9e2ed-97b6-4a6d-8a82-985ba2c82ba3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:11.751057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39a9e2ed-97b6-4a6d-8a82-985ba2c82ba3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:11.751822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39a9e2ed-97b6-4a6d-8a82-985ba2c82ba3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:11.752261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-39a9e2ed-97b6-4a6d-8a82-985ba2c82ba3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:11.886710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-39a9e2ed-97b6-4a6d-8a82-985ba2c82ba3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:11.894422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-39a9e2ed-97b6-4a6d-8a82-985ba2c82ba3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155400 Mar 08 04:43:11.894984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1227/2400] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:11 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:12.753783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e45db764-d880-4659-8241-387dfa4fb927 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:12.754374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e45db764-d880-4659-8241-387dfa4fb927 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:12.760542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e45db764-d880-4659-8241-387dfa4fb927 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:12.761588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e45db764-d880-4659-8241-387dfa4fb927 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:12.762378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e45db764-d880-4659-8241-387dfa4fb927 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:12.762809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e45db764-d880-4659-8241-387dfa4fb927 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:12.820813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e45db764-d880-4659-8241-387dfa4fb927 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:12.829201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e45db764-d880-4659-8241-387dfa4fb927 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079335 Mar 08 04:43:12.829802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1174/2401] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:12.911954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9bc9c170-7ccc-4fc4-a30a-d62a9862d203 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:12.912563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9bc9c170-7ccc-4fc4-a30a-d62a9862d203 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:12.918922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bc9c170-7ccc-4fc4-a30a-d62a9862d203 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:12.919366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bc9c170-7ccc-4fc4-a30a-d62a9862d203 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:12.920129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bc9c170-7ccc-4fc4-a30a-d62a9862d203 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:12.920561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bc9c170-7ccc-4fc4-a30a-d62a9862d203 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:13.052365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9bc9c170-7ccc-4fc4-a30a-d62a9862d203 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:13.060715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9bc9c170-7ccc-4fc4-a30a-d62a9862d203 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152555 Mar 08 04:43:13.061283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1228/2402] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:12 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:13.847002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5e288b09-9256-457a-b0f0-b0119b170b90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:13.847605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5e288b09-9256-457a-b0f0-b0119b170b90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:13.853950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e288b09-9256-457a-b0f0-b0119b170b90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:13.854674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e288b09-9256-457a-b0f0-b0119b170b90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:13.855147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e288b09-9256-457a-b0f0-b0119b170b90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:13.855582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e288b09-9256-457a-b0f0-b0119b170b90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:13.915427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5e288b09-9256-457a-b0f0-b0119b170b90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:13.923031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5e288b09-9256-457a-b0f0-b0119b170b90 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080338 Mar 08 04:43:13.923590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1175/2403] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:13 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:14.078391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9a9cc807-b3a1-4efa-aa84-913f0e9ba4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:14.079010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9a9cc807-b3a1-4efa-aa84-913f0e9ba4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:14.085298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a9cc807-b3a1-4efa-aa84-913f0e9ba4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:14.085772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a9cc807-b3a1-4efa-aa84-913f0e9ba4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:14.086536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a9cc807-b3a1-4efa-aa84-913f0e9ba4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:14.086979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9a9cc807-b3a1-4efa-aa84-913f0e9ba4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:14.217014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9a9cc807-b3a1-4efa-aa84-913f0e9ba4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:14.224655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9a9cc807-b3a1-4efa-aa84-913f0e9ba4a8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151138 Mar 08 04:43:14.225223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1229/2404] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:14 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:14.939512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-265a6a73-55bf-4426-bca7-8919ba32e0da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:14.940124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-265a6a73-55bf-4426-bca7-8919ba32e0da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:14.946245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-265a6a73-55bf-4426-bca7-8919ba32e0da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:14.946687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-265a6a73-55bf-4426-bca7-8919ba32e0da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:14.947439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-265a6a73-55bf-4426-bca7-8919ba32e0da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:14.947868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-265a6a73-55bf-4426-bca7-8919ba32e0da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:15.009916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-265a6a73-55bf-4426-bca7-8919ba32e0da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:15.017715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-265a6a73-55bf-4426-bca7-8919ba32e0da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082009 Mar 08 04:43:15.018299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1176/2405] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:15.242142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c335c372-c20d-44ec-b4e9-514ff1964c8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:15.242757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c335c372-c20d-44ec-b4e9-514ff1964c8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:15.249133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c335c372-c20d-44ec-b4e9-514ff1964c8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:15.249584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c335c372-c20d-44ec-b4e9-514ff1964c8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:15.250397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c335c372-c20d-44ec-b4e9-514ff1964c8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:15.250836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c335c372-c20d-44ec-b4e9-514ff1964c8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:15.379389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c335c372-c20d-44ec-b4e9-514ff1964c8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:15.387621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c335c372-c20d-44ec-b4e9-514ff1964c8f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149350 Mar 08 04:43:15.388297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1230/2406] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:15 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:16.035634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-11c9b4b2-421d-48b3-8e80-95bacd7cce3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:16.036326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-11c9b4b2-421d-48b3-8e80-95bacd7cce3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:16.043599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11c9b4b2-421d-48b3-8e80-95bacd7cce3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:16.044045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11c9b4b2-421d-48b3-8e80-95bacd7cce3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:16.044804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11c9b4b2-421d-48b3-8e80-95bacd7cce3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:16.045238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11c9b4b2-421d-48b3-8e80-95bacd7cce3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:16.102878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-11c9b4b2-421d-48b3-8e80-95bacd7cce3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:16.111090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-11c9b4b2-421d-48b3-8e80-95bacd7cce3b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079337 Mar 08 04:43:16.111576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1177/2407] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:16 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:16.408282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ed4f1ca5-3df4-45aa-a954-fae1ddca13f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:16.408816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ed4f1ca5-3df4-45aa-a954-fae1ddca13f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:16.415030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed4f1ca5-3df4-45aa-a954-fae1ddca13f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:16.415476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed4f1ca5-3df4-45aa-a954-fae1ddca13f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:16.416233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed4f1ca5-3df4-45aa-a954-fae1ddca13f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:16.416668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ed4f1ca5-3df4-45aa-a954-fae1ddca13f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:16.547529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ed4f1ca5-3df4-45aa-a954-fae1ddca13f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:16.555216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ed4f1ca5-3df4-45aa-a954-fae1ddca13f1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151027 Mar 08 04:43:16.555807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1231/2408] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:16 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:17.128304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5b80503b-c70e-49ea-8198-04862a4c24f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:17.128887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5b80503b-c70e-49ea-8198-04862a4c24f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:17.135189 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5b80503b-c70e-49ea-8198-04862a4c24f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:17.135640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5b80503b-c70e-49ea-8198-04862a4c24f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:17.136402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5b80503b-c70e-49ea-8198-04862a4c24f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:17.136839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5b80503b-c70e-49ea-8198-04862a4c24f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:17.195455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5b80503b-c70e-49ea-8198-04862a4c24f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:17.203774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5b80503b-c70e-49ea-8198-04862a4c24f9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079484 Mar 08 04:43:17.204333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1178/2409] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:17.571957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a8073dae-d68b-4524-86c4-23e6dea9878f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:17.572688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a8073dae-d68b-4524-86c4-23e6dea9878f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:17.578970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8073dae-d68b-4524-86c4-23e6dea9878f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:17.579420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8073dae-d68b-4524-86c4-23e6dea9878f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:17.580186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8073dae-d68b-4524-86c4-23e6dea9878f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:17.580624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a8073dae-d68b-4524-86c4-23e6dea9878f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:17.710087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a8073dae-d68b-4524-86c4-23e6dea9878f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:17.718031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a8073dae-d68b-4524-86c4-23e6dea9878f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149863 Mar 08 04:43:17.718611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1232/2410] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:17 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:18.221071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2156c1d0-30d6-49b4-91de-f794a7d80a4c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:18.221684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2156c1d0-30d6-49b4-91de-f794a7d80a4c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:18.227896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2156c1d0-30d6-49b4-91de-f794a7d80a4c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:18.228345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2156c1d0-30d6-49b4-91de-f794a7d80a4c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:18.229099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2156c1d0-30d6-49b4-91de-f794a7d80a4c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:18.229535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2156c1d0-30d6-49b4-91de-f794a7d80a4c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:18.291251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2156c1d0-30d6-49b4-91de-f794a7d80a4c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:18.298958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2156c1d0-30d6-49b4-91de-f794a7d80a4c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081754 Mar 08 04:43:18.299512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1179/2411] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:18 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:18.735516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4d675db2-412e-48ed-aa4a-9dda6bdd472a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:18.736143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4d675db2-412e-48ed-aa4a-9dda6bdd472a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:18.742032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d675db2-412e-48ed-aa4a-9dda6bdd472a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:18.742481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d675db2-412e-48ed-aa4a-9dda6bdd472a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:18.743240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d675db2-412e-48ed-aa4a-9dda6bdd472a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:18.743673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d675db2-412e-48ed-aa4a-9dda6bdd472a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:19.095717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4d675db2-412e-48ed-aa4a-9dda6bdd472a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:19.103471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4d675db2-412e-48ed-aa4a-9dda6bdd472a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.372522 Mar 08 04:43:19.104029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1233/2412] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:18 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:19.315801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-08adceba-83d1-476e-989d-6962f589d95f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:19.316345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-08adceba-83d1-476e-989d-6962f589d95f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:19.322568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08adceba-83d1-476e-989d-6962f589d95f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:19.323012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08adceba-83d1-476e-989d-6962f589d95f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:19.323765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08adceba-83d1-476e-989d-6962f589d95f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:19.324194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-08adceba-83d1-476e-989d-6962f589d95f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:19.385397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-08adceba-83d1-476e-989d-6962f589d95f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:19.393612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-08adceba-83d1-476e-989d-6962f589d95f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081793 Mar 08 04:43:19.394201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1180/2413] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:19 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:20.121633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-144a6d0b-f4a1-481c-b13f-41bfbc50e169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:20.122211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-144a6d0b-f4a1-481c-b13f-41bfbc50e169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:20.129560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-144a6d0b-f4a1-481c-b13f-41bfbc50e169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:20.130066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-144a6d0b-f4a1-481c-b13f-41bfbc50e169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:20.130859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-144a6d0b-f4a1-481c-b13f-41bfbc50e169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:20.131294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-144a6d0b-f4a1-481c-b13f-41bfbc50e169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:20.262135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-144a6d0b-f4a1-481c-b13f-41bfbc50e169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:20.270002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-144a6d0b-f4a1-481c-b13f-41bfbc50e169 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152294 Mar 08 04:43:20.270564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1234/2414] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:20 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:20.409953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4d7e322d-1b9d-4c1f-af9c-b72c8f08a581 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:20.410479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4d7e322d-1b9d-4c1f-af9c-b72c8f08a581 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:20.416742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4d7e322d-1b9d-4c1f-af9c-b72c8f08a581 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:20.417193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4d7e322d-1b9d-4c1f-af9c-b72c8f08a581 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:20.417981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4d7e322d-1b9d-4c1f-af9c-b72c8f08a581 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:20.418422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4d7e322d-1b9d-4c1f-af9c-b72c8f08a581 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:20.478673 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4d7e322d-1b9d-4c1f-af9c-b72c8f08a581 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:20.487145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4d7e322d-1b9d-4c1f-af9c-b72c8f08a581 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081183 Mar 08 04:43:20.487708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1181/2415] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:21.287728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e927ab77-7941-4d23-831e-5cc331a90f26 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:21.288345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e927ab77-7941-4d23-831e-5cc331a90f26 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:21.295026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e927ab77-7941-4d23-831e-5cc331a90f26 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:21.295543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e927ab77-7941-4d23-831e-5cc331a90f26 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:21.296356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e927ab77-7941-4d23-831e-5cc331a90f26 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:21.296800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e927ab77-7941-4d23-831e-5cc331a90f26 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:21.430804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e927ab77-7941-4d23-831e-5cc331a90f26 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:21.439690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e927ab77-7941-4d23-831e-5cc331a90f26 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155879 Mar 08 04:43:21.440302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1235/2416] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:21 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:21.504295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-52c7b85a-98e8-40f0-92b7-43637313e31a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:21.504904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-52c7b85a-98e8-40f0-92b7-43637313e31a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:21.511188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-52c7b85a-98e8-40f0-92b7-43637313e31a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:21.511632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-52c7b85a-98e8-40f0-92b7-43637313e31a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:21.512383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-52c7b85a-98e8-40f0-92b7-43637313e31a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:21.512814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-52c7b85a-98e8-40f0-92b7-43637313e31a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:21.574472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-52c7b85a-98e8-40f0-92b7-43637313e31a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:21.582580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-52c7b85a-98e8-40f0-92b7-43637313e31a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082146 Mar 08 04:43:21.583142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1182/2417] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:21 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:22.456848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5aceed63-28dc-4dfa-a49b-17b923c7dcf1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:22.457463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5aceed63-28dc-4dfa-a49b-17b923c7dcf1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:22.463727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5aceed63-28dc-4dfa-a49b-17b923c7dcf1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:22.464179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5aceed63-28dc-4dfa-a49b-17b923c7dcf1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:22.464945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5aceed63-28dc-4dfa-a49b-17b923c7dcf1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:22.465384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5aceed63-28dc-4dfa-a49b-17b923c7dcf1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:22.595694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5aceed63-28dc-4dfa-a49b-17b923c7dcf1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:22.599349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b4cda480-d3e2-4505-a970-2addc3ce763f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:22.599988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b4cda480-d3e2-4505-a970-2addc3ce763f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:22.603496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5aceed63-28dc-4dfa-a49b-17b923c7dcf1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150476 Mar 08 04:43:22.604062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1236/2418] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:22 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:22.606016 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4cda480-d3e2-4505-a970-2addc3ce763f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:22.606459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4cda480-d3e2-4505-a970-2addc3ce763f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:22.607246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4cda480-d3e2-4505-a970-2addc3ce763f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:22.607684 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4cda480-d3e2-4505-a970-2addc3ce763f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:22.666507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b4cda480-d3e2-4505-a970-2addc3ce763f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:22.674265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b4cda480-d3e2-4505-a970-2addc3ce763f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078643 Mar 08 04:43:22.674822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1183/2419] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:23.620785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-822ee19d-415c-461f-9b40-9a36c78d86f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:23.621333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-822ee19d-415c-461f-9b40-9a36c78d86f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:23.628386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-822ee19d-415c-461f-9b40-9a36c78d86f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:23.628827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-822ee19d-415c-461f-9b40-9a36c78d86f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:23.629590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-822ee19d-415c-461f-9b40-9a36c78d86f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:23.630046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-822ee19d-415c-461f-9b40-9a36c78d86f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:23.691388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-187d6fc1-3ed5-42b1-b0c5-1ca80295d4ff tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:23.692142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-187d6fc1-3ed5-42b1-b0c5-1ca80295d4ff tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:23.698264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-187d6fc1-3ed5-42b1-b0c5-1ca80295d4ff tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:23.698705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-187d6fc1-3ed5-42b1-b0c5-1ca80295d4ff tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:23.699460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-187d6fc1-3ed5-42b1-b0c5-1ca80295d4ff tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:23.699889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-187d6fc1-3ed5-42b1-b0c5-1ca80295d4ff tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:23.767158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-187d6fc1-3ed5-42b1-b0c5-1ca80295d4ff tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:23.775115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-187d6fc1-3ed5-42b1-b0c5-1ca80295d4ff tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.087523 Mar 08 04:43:23.775682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1184/2420] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:23.788089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-822ee19d-415c-461f-9b40-9a36c78d86f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:23.796427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-822ee19d-415c-461f-9b40-9a36c78d86f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.179452 Mar 08 04:43:23.796999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1237/2421] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:23 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:24.792271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-026abbdc-b30d-439d-8caf-4646e8dfd348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:24.792881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-026abbdc-b30d-439d-8caf-4646e8dfd348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:24.799976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-026abbdc-b30d-439d-8caf-4646e8dfd348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:24.800425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-026abbdc-b30d-439d-8caf-4646e8dfd348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:24.801192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-026abbdc-b30d-439d-8caf-4646e8dfd348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:24.801628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-026abbdc-b30d-439d-8caf-4646e8dfd348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:24.813965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5c339a05-fac7-40ec-86d8-c94dd4527e52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:24.814578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5c339a05-fac7-40ec-86d8-c94dd4527e52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:24.820934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c339a05-fac7-40ec-86d8-c94dd4527e52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:24.821379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c339a05-fac7-40ec-86d8-c94dd4527e52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:24.822173 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c339a05-fac7-40ec-86d8-c94dd4527e52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:24.822609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c339a05-fac7-40ec-86d8-c94dd4527e52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:24.866053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-026abbdc-b30d-439d-8caf-4646e8dfd348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:24.874999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-026abbdc-b30d-439d-8caf-4646e8dfd348 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.086555 Mar 08 04:43:24.875600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1185/2422] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:24.963518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5c339a05-fac7-40ec-86d8-c94dd4527e52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:24.971712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5c339a05-fac7-40ec-86d8-c94dd4527e52 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.162384 Mar 08 04:43:24.972271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1238/2423] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:24 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:25.891600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7684310b-73ad-4d46-ba4f-cef3743c9c84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:25.892213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7684310b-73ad-4d46-ba4f-cef3743c9c84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:25.898786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7684310b-73ad-4d46-ba4f-cef3743c9c84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:25.899316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7684310b-73ad-4d46-ba4f-cef3743c9c84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:25.900081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7684310b-73ad-4d46-ba4f-cef3743c9c84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:25.900524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7684310b-73ad-4d46-ba4f-cef3743c9c84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:25.962567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7684310b-73ad-4d46-ba4f-cef3743c9c84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:25.970273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7684310b-73ad-4d46-ba4f-cef3743c9c84 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083130 Mar 08 04:43:25.970837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1186/2424] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:25.988153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-06d92c2b-0237-460b-a557-620f047104f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:25.988773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-06d92c2b-0237-460b-a557-620f047104f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:25.995032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06d92c2b-0237-460b-a557-620f047104f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:25.995476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06d92c2b-0237-460b-a557-620f047104f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:25.996233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06d92c2b-0237-460b-a557-620f047104f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:25.996670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-06d92c2b-0237-460b-a557-620f047104f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:26.126684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-06d92c2b-0237-460b-a557-620f047104f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:26.134374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-06d92c2b-0237-460b-a557-620f047104f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150041 Mar 08 04:43:26.134939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1239/2425] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:25 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:26.986430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-46d60c85-cb9b-4caf-9517-be20a2f54193 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:26.987034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-46d60c85-cb9b-4caf-9517-be20a2f54193 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:26.993207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46d60c85-cb9b-4caf-9517-be20a2f54193 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:26.993701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46d60c85-cb9b-4caf-9517-be20a2f54193 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:26.994460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46d60c85-cb9b-4caf-9517-be20a2f54193 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:26.994893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-46d60c85-cb9b-4caf-9517-be20a2f54193 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:27.053780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-46d60c85-cb9b-4caf-9517-be20a2f54193 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:27.061685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-46d60c85-cb9b-4caf-9517-be20a2f54193 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079116 Mar 08 04:43:27.062252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1187/2426] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:26 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:27.151737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-16baeea2-d967-4a92-8871-cc82ea173d04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:27.152276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-16baeea2-d967-4a92-8871-cc82ea173d04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:27.159152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16baeea2-d967-4a92-8871-cc82ea173d04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:27.159595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16baeea2-d967-4a92-8871-cc82ea173d04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:27.160348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16baeea2-d967-4a92-8871-cc82ea173d04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:27.160778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-16baeea2-d967-4a92-8871-cc82ea173d04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:27.292125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-16baeea2-d967-4a92-8871-cc82ea173d04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:27.299938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-16baeea2-d967-4a92-8871-cc82ea173d04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152407 Mar 08 04:43:27.300504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1240/2427] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:27 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:28.079150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-62da2699-308b-428a-a7b6-4da782b677b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:28.079765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-62da2699-308b-428a-a7b6-4da782b677b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:28.085957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62da2699-308b-428a-a7b6-4da782b677b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:28.086447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62da2699-308b-428a-a7b6-4da782b677b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:28.087206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62da2699-308b-428a-a7b6-4da782b677b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:28.087643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62da2699-308b-428a-a7b6-4da782b677b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:28.147400 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-62da2699-308b-428a-a7b6-4da782b677b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:28.155391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-62da2699-308b-428a-a7b6-4da782b677b0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080780 Mar 08 04:43:28.155951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1188/2428] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:28 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:28.316928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3e1c92d7-fca6-4264-b4e1-77e30dff5832 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:28.317570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3e1c92d7-fca6-4264-b4e1-77e30dff5832 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:28.323812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e1c92d7-fca6-4264-b4e1-77e30dff5832 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:28.324261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e1c92d7-fca6-4264-b4e1-77e30dff5832 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:28.325027 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e1c92d7-fca6-4264-b4e1-77e30dff5832 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:28.325464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e1c92d7-fca6-4264-b4e1-77e30dff5832 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:28.453786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3e1c92d7-fca6-4264-b4e1-77e30dff5832 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:28.461519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3e1c92d7-fca6-4264-b4e1-77e30dff5832 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.148531 Mar 08 04:43:28.462111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1241/2429] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:28 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:29.171965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d87283ba-51a5-423c-b1a5-a762cbd71b43 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:29.172571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d87283ba-51a5-423c-b1a5-a762cbd71b43 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:29.178890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d87283ba-51a5-423c-b1a5-a762cbd71b43 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:29.179344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d87283ba-51a5-423c-b1a5-a762cbd71b43 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:29.180096 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d87283ba-51a5-423c-b1a5-a762cbd71b43 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:29.180527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d87283ba-51a5-423c-b1a5-a762cbd71b43 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:29.238096 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d87283ba-51a5-423c-b1a5-a762cbd71b43 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:29.245651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d87283ba-51a5-423c-b1a5-a762cbd71b43 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077551 Mar 08 04:43:29.246226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1189/2430] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:29.484437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fc1d65fb-7cd5-4ceb-903c-1566cb5547f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:29.485085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fc1d65fb-7cd5-4ceb-903c-1566cb5547f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:29.491388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc1d65fb-7cd5-4ceb-903c-1566cb5547f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:29.491845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc1d65fb-7cd5-4ceb-903c-1566cb5547f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:29.492618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc1d65fb-7cd5-4ceb-903c-1566cb5547f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:29.493052 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc1d65fb-7cd5-4ceb-903c-1566cb5547f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:29.627980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fc1d65fb-7cd5-4ceb-903c-1566cb5547f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:29.635651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fc1d65fb-7cd5-4ceb-903c-1566cb5547f0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155872 Mar 08 04:43:29.636218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1242/2431] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:29 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:30.262553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f7c58282-0743-453e-a932-c08be32e94cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:30.263806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f7c58282-0743-453e-a932-c08be32e94cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:30.270167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f7c58282-0743-453e-a932-c08be32e94cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:30.270610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f7c58282-0743-453e-a932-c08be32e94cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:30.271359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f7c58282-0743-453e-a932-c08be32e94cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:30.271788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f7c58282-0743-453e-a932-c08be32e94cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:30.331774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f7c58282-0743-453e-a932-c08be32e94cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:30.339635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f7c58282-0743-453e-a932-c08be32e94cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080902 Mar 08 04:43:30.340198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1190/2432] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:30.652855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4271576f-385b-470e-aeb5-7df938a1d7dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:30.653418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4271576f-385b-470e-aeb5-7df938a1d7dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:30.659909 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4271576f-385b-470e-aeb5-7df938a1d7dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:30.660361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4271576f-385b-470e-aeb5-7df938a1d7dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:30.661124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4271576f-385b-470e-aeb5-7df938a1d7dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:30.661567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4271576f-385b-470e-aeb5-7df938a1d7dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:30.792248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4271576f-385b-470e-aeb5-7df938a1d7dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:30.799983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4271576f-385b-470e-aeb5-7df938a1d7dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151076 Mar 08 04:43:30.800545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1243/2433] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:30 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:31.356360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-eae2dcbc-f0aa-4b57-ae39-1b64632325cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:31.357575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eae2dcbc-f0aa-4b57-ae39-1b64632325cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:31.363790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eae2dcbc-f0aa-4b57-ae39-1b64632325cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:31.364237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eae2dcbc-f0aa-4b57-ae39-1b64632325cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:31.364996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eae2dcbc-f0aa-4b57-ae39-1b64632325cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:31.365429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eae2dcbc-f0aa-4b57-ae39-1b64632325cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:31.425894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-eae2dcbc-f0aa-4b57-ae39-1b64632325cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:31.433716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eae2dcbc-f0aa-4b57-ae39-1b64632325cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081254 Mar 08 04:43:31.434267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1191/2434] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:31 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:31.816832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57807c3b-c73a-4985-b5a0-1abbbfc7d329 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:31.817441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-57807c3b-c73a-4985-b5a0-1abbbfc7d329 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:31.823786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57807c3b-c73a-4985-b5a0-1abbbfc7d329 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:31.824228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57807c3b-c73a-4985-b5a0-1abbbfc7d329 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:31.824988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57807c3b-c73a-4985-b5a0-1abbbfc7d329 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:31.825421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57807c3b-c73a-4985-b5a0-1abbbfc7d329 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:31.956018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-57807c3b-c73a-4985-b5a0-1abbbfc7d329 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:31.963626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-57807c3b-c73a-4985-b5a0-1abbbfc7d329 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150728 Mar 08 04:43:31.964184 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1244/2435] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:31 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:32.451333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4ca51260-7780-4b4f-8b39-626f87ffc945 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:32.452023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4ca51260-7780-4b4f-8b39-626f87ffc945 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:32.458241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ca51260-7780-4b4f-8b39-626f87ffc945 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:32.458686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ca51260-7780-4b4f-8b39-626f87ffc945 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:32.459434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ca51260-7780-4b4f-8b39-626f87ffc945 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:32.459864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ca51260-7780-4b4f-8b39-626f87ffc945 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:32.517919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4ca51260-7780-4b4f-8b39-626f87ffc945 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:32.525844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4ca51260-7780-4b4f-8b39-626f87ffc945 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078872 Mar 08 04:43:32.526397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1192/2436] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:32 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:32.981155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-509b205a-f0c5-438b-9a7e-c1ca738bc0aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:32.981784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-509b205a-f0c5-438b-9a7e-c1ca738bc0aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:32.988645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-509b205a-f0c5-438b-9a7e-c1ca738bc0aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:32.989091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-509b205a-f0c5-438b-9a7e-c1ca738bc0aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:32.989883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-509b205a-f0c5-438b-9a7e-c1ca738bc0aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:32.990318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-509b205a-f0c5-438b-9a7e-c1ca738bc0aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:33.129127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-509b205a-f0c5-438b-9a7e-c1ca738bc0aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:33.136867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-509b205a-f0c5-438b-9a7e-c1ca738bc0aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.159583 Mar 08 04:43:33.137549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1245/2437] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:32 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:33.542564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1d9ad017-883c-4833-b944-f1fa91318a28 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:33.543177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1d9ad017-883c-4833-b944-f1fa91318a28 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:33.549397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d9ad017-883c-4833-b944-f1fa91318a28 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:33.549911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d9ad017-883c-4833-b944-f1fa91318a28 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:33.550644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d9ad017-883c-4833-b944-f1fa91318a28 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:33.551078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d9ad017-883c-4833-b944-f1fa91318a28 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:33.609248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1d9ad017-883c-4833-b944-f1fa91318a28 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:33.617011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1d9ad017-883c-4833-b944-f1fa91318a28 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078293 Mar 08 04:43:33.617575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1193/2438] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:34.154393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0498cd41-1901-4451-8b97-772a889bb89a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:34.154944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0498cd41-1901-4451-8b97-772a889bb89a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:34.161089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0498cd41-1901-4451-8b97-772a889bb89a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:34.161530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0498cd41-1901-4451-8b97-772a889bb89a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:34.162314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0498cd41-1901-4451-8b97-772a889bb89a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:34.162750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0498cd41-1901-4451-8b97-772a889bb89a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:34.289403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0498cd41-1901-4451-8b97-772a889bb89a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:34.297688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0498cd41-1901-4451-8b97-772a889bb89a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.147174 Mar 08 04:43:34.298255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1246/2439] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:34 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:34.634829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e23cd881-5fa7-4222-b5d9-dd0562a1d90f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:34.635445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e23cd881-5fa7-4222-b5d9-dd0562a1d90f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:34.641687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e23cd881-5fa7-4222-b5d9-dd0562a1d90f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:34.642162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e23cd881-5fa7-4222-b5d9-dd0562a1d90f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:34.642922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e23cd881-5fa7-4222-b5d9-dd0562a1d90f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:34.643359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e23cd881-5fa7-4222-b5d9-dd0562a1d90f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:34.707429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e23cd881-5fa7-4222-b5d9-dd0562a1d90f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:34.715126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e23cd881-5fa7-4222-b5d9-dd0562a1d90f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.084202 Mar 08 04:43:34.715694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1194/2440] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:35.314440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-674d6c64-b0f6-4cbe-8fed-b0b6b384ab79 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:35.315048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-674d6c64-b0f6-4cbe-8fed-b0b6b384ab79 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:35.321247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-674d6c64-b0f6-4cbe-8fed-b0b6b384ab79 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:35.321749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-674d6c64-b0f6-4cbe-8fed-b0b6b384ab79 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:35.322506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-674d6c64-b0f6-4cbe-8fed-b0b6b384ab79 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:35.322933 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-674d6c64-b0f6-4cbe-8fed-b0b6b384ab79 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:35.452120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-674d6c64-b0f6-4cbe-8fed-b0b6b384ab79 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:35.459811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-674d6c64-b0f6-4cbe-8fed-b0b6b384ab79 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149205 Mar 08 04:43:35.460386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1247/2441] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:35 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:35.733064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0e282d70-02e8-42a5-bddc-d8c48928768c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:35.734515 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0e282d70-02e8-42a5-bddc-d8c48928768c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:35.741206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e282d70-02e8-42a5-bddc-d8c48928768c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:35.741692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e282d70-02e8-42a5-bddc-d8c48928768c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:35.742537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e282d70-02e8-42a5-bddc-d8c48928768c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:35.743237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e282d70-02e8-42a5-bddc-d8c48928768c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:35.808050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0e282d70-02e8-42a5-bddc-d8c48928768c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:35.816554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0e282d70-02e8-42a5-bddc-d8c48928768c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.088035 Mar 08 04:43:35.817962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1195/2442] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:35 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:36.477180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3af0ed8f-6e7a-4281-bb99-f2db1e993d13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:36.477825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3af0ed8f-6e7a-4281-bb99-f2db1e993d13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:36.484402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3af0ed8f-6e7a-4281-bb99-f2db1e993d13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:36.484857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3af0ed8f-6e7a-4281-bb99-f2db1e993d13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:36.485629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3af0ed8f-6e7a-4281-bb99-f2db1e993d13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:36.486098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3af0ed8f-6e7a-4281-bb99-f2db1e993d13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:36.619285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3af0ed8f-6e7a-4281-bb99-f2db1e993d13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:36.628738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3af0ed8f-6e7a-4281-bb99-f2db1e993d13 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155221 Mar 08 04:43:36.629319 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1248/2443] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:36 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:36.834512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9f0030ff-7d79-47a0-b0d2-97ef999eb885 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:36.835063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9f0030ff-7d79-47a0-b0d2-97ef999eb885 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:36.841392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f0030ff-7d79-47a0-b0d2-97ef999eb885 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:36.841882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f0030ff-7d79-47a0-b0d2-97ef999eb885 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:36.842669 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f0030ff-7d79-47a0-b0d2-97ef999eb885 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:36.843099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f0030ff-7d79-47a0-b0d2-97ef999eb885 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:36.902142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9f0030ff-7d79-47a0-b0d2-97ef999eb885 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:36.909764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9f0030ff-7d79-47a0-b0d2-97ef999eb885 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079147 Mar 08 04:43:36.910319 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1196/2444] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:36 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:37.646431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-49556974-5aad-4336-bc69-0897ae18fc15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:37.647036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-49556974-5aad-4336-bc69-0897ae18fc15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:37.654019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49556974-5aad-4336-bc69-0897ae18fc15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:37.654466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49556974-5aad-4336-bc69-0897ae18fc15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:37.655222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49556974-5aad-4336-bc69-0897ae18fc15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:37.655660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-49556974-5aad-4336-bc69-0897ae18fc15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:37.785307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-49556974-5aad-4336-bc69-0897ae18fc15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:37.793074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-49556974-5aad-4336-bc69-0897ae18fc15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150506 Mar 08 04:43:37.793637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1249/2445] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:37 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:37.925604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fc1e941b-a0be-455e-a725-67a39923a52f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:37.926251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fc1e941b-a0be-455e-a725-67a39923a52f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:37.932516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fc1e941b-a0be-455e-a725-67a39923a52f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:37.932966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fc1e941b-a0be-455e-a725-67a39923a52f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:37.933757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fc1e941b-a0be-455e-a725-67a39923a52f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:37.934198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fc1e941b-a0be-455e-a725-67a39923a52f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:37.995505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fc1e941b-a0be-455e-a725-67a39923a52f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:38.003256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fc1e941b-a0be-455e-a725-67a39923a52f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081512 Mar 08 04:43:38.003810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1197/2446] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:37 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:38.810932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e79f438c-4cfc-4fac-8933-4a43e1c7602a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:38.811546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e79f438c-4cfc-4fac-8933-4a43e1c7602a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:38.817981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e79f438c-4cfc-4fac-8933-4a43e1c7602a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:38.818441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e79f438c-4cfc-4fac-8933-4a43e1c7602a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:38.819215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e79f438c-4cfc-4fac-8933-4a43e1c7602a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:38.819655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e79f438c-4cfc-4fac-8933-4a43e1c7602a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:38.964031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e79f438c-4cfc-4fac-8933-4a43e1c7602a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:38.972018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e79f438c-4cfc-4fac-8933-4a43e1c7602a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.165135 Mar 08 04:43:38.972582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1250/2447] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:38 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:39.020007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b186e9e0-5052-4d6a-ad89-5261d00f1b38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:39.020617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b186e9e0-5052-4d6a-ad89-5261d00f1b38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:39.027105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b186e9e0-5052-4d6a-ad89-5261d00f1b38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:39.027552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b186e9e0-5052-4d6a-ad89-5261d00f1b38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:39.028337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b186e9e0-5052-4d6a-ad89-5261d00f1b38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:39.028802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b186e9e0-5052-4d6a-ad89-5261d00f1b38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:39.087587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b186e9e0-5052-4d6a-ad89-5261d00f1b38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:39.095237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b186e9e0-5052-4d6a-ad89-5261d00f1b38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079086 Mar 08 04:43:39.095791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1198/2448] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:39 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:39.988743 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4a06fbd0-77ec-4e9a-9ea2-f29763712469 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:39.989345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4a06fbd0-77ec-4e9a-9ea2-f29763712469 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:39.995603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a06fbd0-77ec-4e9a-9ea2-f29763712469 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:39.996048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a06fbd0-77ec-4e9a-9ea2-f29763712469 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:39.996803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a06fbd0-77ec-4e9a-9ea2-f29763712469 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:39.997235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a06fbd0-77ec-4e9a-9ea2-f29763712469 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:40.111647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ee4f5c48-2aad-4bd4-8da6-831f0d68c9da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:40.112292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ee4f5c48-2aad-4bd4-8da6-831f0d68c9da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:40.118587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee4f5c48-2aad-4bd4-8da6-831f0d68c9da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:40.119040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee4f5c48-2aad-4bd4-8da6-831f0d68c9da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:40.119841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee4f5c48-2aad-4bd4-8da6-831f0d68c9da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:40.120280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee4f5c48-2aad-4bd4-8da6-831f0d68c9da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:40.128955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4a06fbd0-77ec-4e9a-9ea2-f29763712469 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:40.136623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4a06fbd0-77ec-4e9a-9ea2-f29763712469 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151707 Mar 08 04:43:40.137174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1251/2449] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:39 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:40.179182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ee4f5c48-2aad-4bd4-8da6-831f0d68c9da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:40.186882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ee4f5c48-2aad-4bd4-8da6-831f0d68c9da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079182 Mar 08 04:43:40.187429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1199/2450] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:40.337622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:43:40.337882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:43:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:43:41.155380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-76970bde-db04-4f6e-ba5a-c8dc5e52d2af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:41.155949 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-76970bde-db04-4f6e-ba5a-c8dc5e52d2af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:41.162366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76970bde-db04-4f6e-ba5a-c8dc5e52d2af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:41.162818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76970bde-db04-4f6e-ba5a-c8dc5e52d2af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:41.163579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76970bde-db04-4f6e-ba5a-c8dc5e52d2af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:41.164016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76970bde-db04-4f6e-ba5a-c8dc5e52d2af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:41.202938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b5a77206-a922-4153-8cbd-2eafd7665f95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:41.203543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b5a77206-a922-4153-8cbd-2eafd7665f95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:41.210384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5a77206-a922-4153-8cbd-2eafd7665f95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:41.210853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5a77206-a922-4153-8cbd-2eafd7665f95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:41.211616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5a77206-a922-4153-8cbd-2eafd7665f95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:41.212046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5a77206-a922-4153-8cbd-2eafd7665f95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:41.279621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b5a77206-a922-4153-8cbd-2eafd7665f95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:41.287237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b5a77206-a922-4153-8cbd-2eafd7665f95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.088336 Mar 08 04:43:41.287801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1200/2451] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:41 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:41.313122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-76970bde-db04-4f6e-ba5a-c8dc5e52d2af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:41.320862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-76970bde-db04-4f6e-ba5a-c8dc5e52d2af tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.170091 Mar 08 04:43:41.321416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1252/2452] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:41 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:42.304902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ad8e6cf5-4944-4297-9edf-936ff4f6882b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:42.305534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ad8e6cf5-4944-4297-9edf-936ff4f6882b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:42.312587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad8e6cf5-4944-4297-9edf-936ff4f6882b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:42.313025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad8e6cf5-4944-4297-9edf-936ff4f6882b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:42.313802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad8e6cf5-4944-4297-9edf-936ff4f6882b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:42.314234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ad8e6cf5-4944-4297-9edf-936ff4f6882b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:42.338421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9fd15228-c54b-4e5e-961b-961f770c7ffc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:42.339032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9fd15228-c54b-4e5e-961b-961f770c7ffc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:42.345302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9fd15228-c54b-4e5e-961b-961f770c7ffc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:42.345785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9fd15228-c54b-4e5e-961b-961f770c7ffc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:42.346558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9fd15228-c54b-4e5e-961b-961f770c7ffc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:42.346996 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9fd15228-c54b-4e5e-961b-961f770c7ffc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:42.376578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ad8e6cf5-4944-4297-9edf-936ff4f6882b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:42.384458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ad8e6cf5-4944-4297-9edf-936ff4f6882b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083355 Mar 08 04:43:42.385026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1201/2453] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:42 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:42.475297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9fd15228-c54b-4e5e-961b-961f770c7ffc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:42.483707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9fd15228-c54b-4e5e-961b-961f770c7ffc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149128 Mar 08 04:43:42.484271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1253/2454] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:42 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:43.401451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4ad87288-854e-4f47-869e-56507e47479e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:43.402089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4ad87288-854e-4f47-869e-56507e47479e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:43.408397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ad87288-854e-4f47-869e-56507e47479e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:43.408844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ad87288-854e-4f47-869e-56507e47479e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:43.409604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ad87288-854e-4f47-869e-56507e47479e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:43.410061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ad87288-854e-4f47-869e-56507e47479e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:43.468845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4ad87288-854e-4f47-869e-56507e47479e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:43.476416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4ad87288-854e-4f47-869e-56507e47479e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079122 Mar 08 04:43:43.476978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1202/2455] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:43.500792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f17f7282-3391-4dc0-a983-8a0d69b142fe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:43.501407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f17f7282-3391-4dc0-a983-8a0d69b142fe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:43.507761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f17f7282-3391-4dc0-a983-8a0d69b142fe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:43.508219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f17f7282-3391-4dc0-a983-8a0d69b142fe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:43.508993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f17f7282-3391-4dc0-a983-8a0d69b142fe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:43.509436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f17f7282-3391-4dc0-a983-8a0d69b142fe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:43.642476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f17f7282-3391-4dc0-a983-8a0d69b142fe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:43.650387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f17f7282-3391-4dc0-a983-8a0d69b142fe tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154054 Mar 08 04:43:43.650956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1254/2456] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:43 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:44.492424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d52a3b41-4369-4f85-b0ac-2c0f78402700 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:44.493027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d52a3b41-4369-4f85-b0ac-2c0f78402700 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:44.499851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d52a3b41-4369-4f85-b0ac-2c0f78402700 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:44.500300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d52a3b41-4369-4f85-b0ac-2c0f78402700 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:44.501047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d52a3b41-4369-4f85-b0ac-2c0f78402700 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:44.501477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d52a3b41-4369-4f85-b0ac-2c0f78402700 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:44.560173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d52a3b41-4369-4f85-b0ac-2c0f78402700 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:44.567809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d52a3b41-4369-4f85-b0ac-2c0f78402700 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079226 Mar 08 04:43:44.568375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1203/2457] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:44.666911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-83be76c0-7489-4923-9262-8969734093e2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:44.667520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-83be76c0-7489-4923-9262-8969734093e2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:44.674233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-83be76c0-7489-4923-9262-8969734093e2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:44.674679 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-83be76c0-7489-4923-9262-8969734093e2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:44.675432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-83be76c0-7489-4923-9262-8969734093e2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:44.675866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-83be76c0-7489-4923-9262-8969734093e2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:44.808414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-83be76c0-7489-4923-9262-8969734093e2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:44.816911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-83be76c0-7489-4923-9262-8969734093e2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153738 Mar 08 04:43:44.817482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1255/2458] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:44 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:45.584450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e8d111df-d3ab-4c5b-bfb4-bc9b9eb64e77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:45.585061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e8d111df-d3ab-4c5b-bfb4-bc9b9eb64e77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:45.592273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8d111df-d3ab-4c5b-bfb4-bc9b9eb64e77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:45.592726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8d111df-d3ab-4c5b-bfb4-bc9b9eb64e77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:45.593492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8d111df-d3ab-4c5b-bfb4-bc9b9eb64e77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:45.593960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8d111df-d3ab-4c5b-bfb4-bc9b9eb64e77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:45.652454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e8d111df-d3ab-4c5b-bfb4-bc9b9eb64e77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:45.660505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e8d111df-d3ab-4c5b-bfb4-bc9b9eb64e77 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079903 Mar 08 04:43:45.661065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1204/2459] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:45 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:45.834029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-961a1bb0-fcad-4ce0-941a-bf55b5cd745d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:45.834568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-961a1bb0-fcad-4ce0-941a-bf55b5cd745d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:45.840935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-961a1bb0-fcad-4ce0-941a-bf55b5cd745d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:45.841346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-961a1bb0-fcad-4ce0-941a-bf55b5cd745d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:45.842133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-961a1bb0-fcad-4ce0-941a-bf55b5cd745d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:45.842569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-961a1bb0-fcad-4ce0-941a-bf55b5cd745d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:45.973855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-961a1bb0-fcad-4ce0-941a-bf55b5cd745d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:45.982008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-961a1bb0-fcad-4ce0-941a-bf55b5cd745d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151375 Mar 08 04:43:45.982589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1256/2460] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:45 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:46.677372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-204c07a4-a49d-4957-8e57-a2bf60902e0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:46.678031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-204c07a4-a49d-4957-8e57-a2bf60902e0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:46.684228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-204c07a4-a49d-4957-8e57-a2bf60902e0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:46.684869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-204c07a4-a49d-4957-8e57-a2bf60902e0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:46.685739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-204c07a4-a49d-4957-8e57-a2bf60902e0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:46.686229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-204c07a4-a49d-4957-8e57-a2bf60902e0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:46.745504 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-204c07a4-a49d-4957-8e57-a2bf60902e0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:46.753325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-204c07a4-a49d-4957-8e57-a2bf60902e0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079806 Mar 08 04:43:46.753917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1205/2461] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:46 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:46.998089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cf131291-5b41-4492-99c3-c13f5fbadf0a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:46.998620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cf131291-5b41-4492-99c3-c13f5fbadf0a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:47.004783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf131291-5b41-4492-99c3-c13f5fbadf0a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:47.005227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf131291-5b41-4492-99c3-c13f5fbadf0a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:47.006122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf131291-5b41-4492-99c3-c13f5fbadf0a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:47.006557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf131291-5b41-4492-99c3-c13f5fbadf0a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:47.140088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cf131291-5b41-4492-99c3-c13f5fbadf0a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:47.147782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cf131291-5b41-4492-99c3-c13f5fbadf0a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153650 Mar 08 04:43:47.148634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1257/2462] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:46 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:47.770683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-402dfe06-bfe4-47c2-8ef2-3abff1b6cf44 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:47.771306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-402dfe06-bfe4-47c2-8ef2-3abff1b6cf44 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:47.777626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-402dfe06-bfe4-47c2-8ef2-3abff1b6cf44 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:47.778116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-402dfe06-bfe4-47c2-8ef2-3abff1b6cf44 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:47.779597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-402dfe06-bfe4-47c2-8ef2-3abff1b6cf44 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:47.780032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-402dfe06-bfe4-47c2-8ef2-3abff1b6cf44 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:47.837803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-402dfe06-bfe4-47c2-8ef2-3abff1b6cf44 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:47.846428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-402dfe06-bfe4-47c2-8ef2-3abff1b6cf44 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079583 Mar 08 04:43:47.847037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1206/2463] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:47 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:48.164470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-12804259-420a-4520-8fae-0c5247fc8147 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:48.165112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-12804259-420a-4520-8fae-0c5247fc8147 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:48.170948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-12804259-420a-4520-8fae-0c5247fc8147 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:48.171400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-12804259-420a-4520-8fae-0c5247fc8147 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:48.172166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-12804259-420a-4520-8fae-0c5247fc8147 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:48.172603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-12804259-420a-4520-8fae-0c5247fc8147 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:48.300551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-12804259-420a-4520-8fae-0c5247fc8147 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:48.308175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-12804259-420a-4520-8fae-0c5247fc8147 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.147734 Mar 08 04:43:48.308734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1258/2464] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:48 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:48.863481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b6c3e914-aaf2-4435-a6da-c72ba1bdbe08 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:48.864089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b6c3e914-aaf2-4435-a6da-c72ba1bdbe08 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:48.870358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6c3e914-aaf2-4435-a6da-c72ba1bdbe08 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:48.870809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6c3e914-aaf2-4435-a6da-c72ba1bdbe08 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:48.871564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6c3e914-aaf2-4435-a6da-c72ba1bdbe08 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:48.872067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b6c3e914-aaf2-4435-a6da-c72ba1bdbe08 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:48.938939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b6c3e914-aaf2-4435-a6da-c72ba1bdbe08 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:48.946563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b6c3e914-aaf2-4435-a6da-c72ba1bdbe08 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.087045 Mar 08 04:43:48.947129 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1207/2465] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:48 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:49.325580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8abc634d-e553-4dbd-bbca-01ffbd945b15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:49.326223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8abc634d-e553-4dbd-bbca-01ffbd945b15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:49.332462 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8abc634d-e553-4dbd-bbca-01ffbd945b15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:49.332915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8abc634d-e553-4dbd-bbca-01ffbd945b15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:49.333762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8abc634d-e553-4dbd-bbca-01ffbd945b15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:49.334203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8abc634d-e553-4dbd-bbca-01ffbd945b15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:49.467271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8abc634d-e553-4dbd-bbca-01ffbd945b15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:49.474946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8abc634d-e553-4dbd-bbca-01ffbd945b15 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153737 Mar 08 04:43:49.475507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1259/2466] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:49 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:49.963237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-eafc331a-f4ac-4d47-86b5-ee2c8b9f6ba9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:49.963872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eafc331a-f4ac-4d47-86b5-ee2c8b9f6ba9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:49.970838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eafc331a-f4ac-4d47-86b5-ee2c8b9f6ba9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:49.971287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eafc331a-f4ac-4d47-86b5-ee2c8b9f6ba9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:49.972046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eafc331a-f4ac-4d47-86b5-ee2c8b9f6ba9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:49.972482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eafc331a-f4ac-4d47-86b5-ee2c8b9f6ba9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:50.031212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-eafc331a-f4ac-4d47-86b5-ee2c8b9f6ba9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:50.038894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eafc331a-f4ac-4d47-86b5-ee2c8b9f6ba9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079545 Mar 08 04:43:50.039453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1208/2467] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:49 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:50.492012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-98358e7b-5659-42ab-8229-1fb0fd805633 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:50.492617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-98358e7b-5659-42ab-8229-1fb0fd805633 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:50.499795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98358e7b-5659-42ab-8229-1fb0fd805633 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:50.500241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98358e7b-5659-42ab-8229-1fb0fd805633 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:50.500999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98358e7b-5659-42ab-8229-1fb0fd805633 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:50.501436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98358e7b-5659-42ab-8229-1fb0fd805633 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:50.628414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-98358e7b-5659-42ab-8229-1fb0fd805633 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:50.635926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-98358e7b-5659-42ab-8229-1fb0fd805633 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.147762 Mar 08 04:43:50.636476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1260/2468] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:50 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:51.056290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6fe0ca37-0868-4b64-a22a-d73f6aba2dcf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:51.057048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6fe0ca37-0868-4b64-a22a-d73f6aba2dcf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:51.063852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6fe0ca37-0868-4b64-a22a-d73f6aba2dcf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:51.064290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6fe0ca37-0868-4b64-a22a-d73f6aba2dcf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:51.065073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6fe0ca37-0868-4b64-a22a-d73f6aba2dcf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:51.065499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6fe0ca37-0868-4b64-a22a-d73f6aba2dcf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:51.127934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6fe0ca37-0868-4b64-a22a-d73f6aba2dcf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:51.135758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6fe0ca37-0868-4b64-a22a-d73f6aba2dcf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083852 Mar 08 04:43:51.136309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1209/2469] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:51 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:51.654129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a704b2f9-dd2b-40d0-98b0-c844a2b85620 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:51.654740 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a704b2f9-dd2b-40d0-98b0-c844a2b85620 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:51.660931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a704b2f9-dd2b-40d0-98b0-c844a2b85620 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:51.661373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a704b2f9-dd2b-40d0-98b0-c844a2b85620 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:51.662150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a704b2f9-dd2b-40d0-98b0-c844a2b85620 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:51.662584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a704b2f9-dd2b-40d0-98b0-c844a2b85620 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:51.791592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a704b2f9-dd2b-40d0-98b0-c844a2b85620 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:51.799782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a704b2f9-dd2b-40d0-98b0-c844a2b85620 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150166 Mar 08 04:43:51.800339 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1261/2470] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:51 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:52.154670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3088fd56-a986-4b92-8783-1dfb5b9831d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:52.155205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3088fd56-a986-4b92-8783-1dfb5b9831d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:52.161526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3088fd56-a986-4b92-8783-1dfb5b9831d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:52.162003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3088fd56-a986-4b92-8783-1dfb5b9831d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:52.162759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3088fd56-a986-4b92-8783-1dfb5b9831d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:52.163195 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3088fd56-a986-4b92-8783-1dfb5b9831d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:52.221150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3088fd56-a986-4b92-8783-1dfb5b9831d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:52.228738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3088fd56-a986-4b92-8783-1dfb5b9831d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078816 Mar 08 04:43:52.229279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1210/2471] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:52 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:52.816618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-75193a49-1f02-4ea5-b75b-b0ce93011c5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:52.817224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-75193a49-1f02-4ea5-b75b-b0ce93011c5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:52.823558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-75193a49-1f02-4ea5-b75b-b0ce93011c5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:52.824004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-75193a49-1f02-4ea5-b75b-b0ce93011c5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:52.824785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-75193a49-1f02-4ea5-b75b-b0ce93011c5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:52.825310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-75193a49-1f02-4ea5-b75b-b0ce93011c5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:52.959125 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-75193a49-1f02-4ea5-b75b-b0ce93011c5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:52.967529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-75193a49-1f02-4ea5-b75b-b0ce93011c5c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154732 Mar 08 04:43:52.968090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1262/2472] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:52 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:53.245983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-423d8de6-9c7f-4ebd-9663-c6c1a5401347 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:53.247091 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-423d8de6-9c7f-4ebd-9663-c6c1a5401347 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:53.253380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-423d8de6-9c7f-4ebd-9663-c6c1a5401347 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:53.253871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-423d8de6-9c7f-4ebd-9663-c6c1a5401347 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:53.254637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-423d8de6-9c7f-4ebd-9663-c6c1a5401347 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:53.255074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-423d8de6-9c7f-4ebd-9663-c6c1a5401347 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:53.314007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-423d8de6-9c7f-4ebd-9663-c6c1a5401347 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:53.321620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-423d8de6-9c7f-4ebd-9663-c6c1a5401347 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079472 Mar 08 04:43:53.322197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1211/2473] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:53 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:43:53.984192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b555da64-796a-4597-afa8-83750560b1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:53.984799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b555da64-796a-4597-afa8-83750560b1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:53.991221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b555da64-796a-4597-afa8-83750560b1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:53.991662 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b555da64-796a-4597-afa8-83750560b1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:53.992412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b555da64-796a-4597-afa8-83750560b1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:53.992841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b555da64-796a-4597-afa8-83750560b1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:54.119985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b555da64-796a-4597-afa8-83750560b1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:54.128262 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b555da64-796a-4597-afa8-83750560b1ad tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.147935 Mar 08 04:43:54.128830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1263/2474] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:53 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:54.340835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d77fb7bd-db8b-413a-baf1-2e57b9afb7a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:54.341499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d77fb7bd-db8b-413a-baf1-2e57b9afb7a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:54.349445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d77fb7bd-db8b-413a-baf1-2e57b9afb7a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:54.350154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d77fb7bd-db8b-413a-baf1-2e57b9afb7a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:54.351492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d77fb7bd-db8b-413a-baf1-2e57b9afb7a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:54.351945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d77fb7bd-db8b-413a-baf1-2e57b9afb7a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:54.421152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d77fb7bd-db8b-413a-baf1-2e57b9afb7a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:54.429085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d77fb7bd-db8b-413a-baf1-2e57b9afb7a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.093396 Mar 08 04:43:54.429646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1212/2475] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:54 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:55.146081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ce7dd3a1-aed6-4d56-ab41-59096289e336 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:55.146629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ce7dd3a1-aed6-4d56-ab41-59096289e336 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:55.154101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce7dd3a1-aed6-4d56-ab41-59096289e336 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:55.154554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce7dd3a1-aed6-4d56-ab41-59096289e336 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:55.155325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce7dd3a1-aed6-4d56-ab41-59096289e336 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:55.155766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce7dd3a1-aed6-4d56-ab41-59096289e336 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:55.284735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ce7dd3a1-aed6-4d56-ab41-59096289e336 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:55.292470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ce7dd3a1-aed6-4d56-ab41-59096289e336 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150520 Mar 08 04:43:55.293035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1264/2476] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:55 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:55.446396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-777e83d1-5258-460b-ac82-9443680cc419 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:55.447000 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-777e83d1-5258-460b-ac82-9443680cc419 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:55.453777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-777e83d1-5258-460b-ac82-9443680cc419 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:55.454225 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-777e83d1-5258-460b-ac82-9443680cc419 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:55.454977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-777e83d1-5258-460b-ac82-9443680cc419 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:55.455410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-777e83d1-5258-460b-ac82-9443680cc419 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:55.514227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-777e83d1-5258-460b-ac82-9443680cc419 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:55.521853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-777e83d1-5258-460b-ac82-9443680cc419 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079304 Mar 08 04:43:55.522408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1213/2477] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:55 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:56.308221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-acaf453c-3192-473d-b35e-1eb6bcee6898 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:56.308854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-acaf453c-3192-473d-b35e-1eb6bcee6898 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:56.315238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-acaf453c-3192-473d-b35e-1eb6bcee6898 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:56.315682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-acaf453c-3192-473d-b35e-1eb6bcee6898 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:56.316444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-acaf453c-3192-473d-b35e-1eb6bcee6898 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:56.316875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-acaf453c-3192-473d-b35e-1eb6bcee6898 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:56.447575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-acaf453c-3192-473d-b35e-1eb6bcee6898 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:56.455363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-acaf453c-3192-473d-b35e-1eb6bcee6898 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150979 Mar 08 04:43:56.455920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1265/2478] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:56 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:56.538643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b5f16d25-f573-451f-918d-e0a415b77744 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:56.539249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b5f16d25-f573-451f-918d-e0a415b77744 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:56.545494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5f16d25-f573-451f-918d-e0a415b77744 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:56.545965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5f16d25-f573-451f-918d-e0a415b77744 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:56.546714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5f16d25-f573-451f-918d-e0a415b77744 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:56.547145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5f16d25-f573-451f-918d-e0a415b77744 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:56.606251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b5f16d25-f573-451f-918d-e0a415b77744 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:56.613901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b5f16d25-f573-451f-918d-e0a415b77744 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079048 Mar 08 04:43:56.614459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1214/2479] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:56 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:57.472032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4d1fa03e-de7e-4279-a9d4-0c958054b52c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:57.472645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4d1fa03e-de7e-4279-a9d4-0c958054b52c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:57.478967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d1fa03e-de7e-4279-a9d4-0c958054b52c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:57.479436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d1fa03e-de7e-4279-a9d4-0c958054b52c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:57.480289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d1fa03e-de7e-4279-a9d4-0c958054b52c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:57.480622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4d1fa03e-de7e-4279-a9d4-0c958054b52c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:57.614079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4d1fa03e-de7e-4279-a9d4-0c958054b52c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:57.626118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4d1fa03e-de7e-4279-a9d4-0c958054b52c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.157782 Mar 08 04:43:57.626698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1266/2480] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:57 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:57.631026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-50154fde-3249-4e17-9b90-d9195a3960b4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:57.631638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-50154fde-3249-4e17-9b90-d9195a3960b4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:57.638775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-50154fde-3249-4e17-9b90-d9195a3960b4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:57.639218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-50154fde-3249-4e17-9b90-d9195a3960b4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:57.639986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-50154fde-3249-4e17-9b90-d9195a3960b4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:57.640418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-50154fde-3249-4e17-9b90-d9195a3960b4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:57.698850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-50154fde-3249-4e17-9b90-d9195a3960b4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:57.706441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-50154fde-3249-4e17-9b90-d9195a3960b4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079666 Mar 08 04:43:57.706998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1215/2481] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:57 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:58.642781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-af68f7b8-5fec-446d-86aa-b0b5ba5b0fff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:58.643392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-af68f7b8-5fec-446d-86aa-b0b5ba5b0fff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:58.649944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af68f7b8-5fec-446d-86aa-b0b5ba5b0fff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:58.650398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af68f7b8-5fec-446d-86aa-b0b5ba5b0fff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:58.651161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af68f7b8-5fec-446d-86aa-b0b5ba5b0fff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:58.651602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-af68f7b8-5fec-446d-86aa-b0b5ba5b0fff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:58.723416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fe9894ad-b58f-48f9-a922-f29c3e0c8a60 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:58.724035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fe9894ad-b58f-48f9-a922-f29c3e0c8a60 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:58.730373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe9894ad-b58f-48f9-a922-f29c3e0c8a60 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:58.731512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe9894ad-b58f-48f9-a922-f29c3e0c8a60 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:58.732325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe9894ad-b58f-48f9-a922-f29c3e0c8a60 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:58.732769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fe9894ad-b58f-48f9-a922-f29c3e0c8a60 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:58.801915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fe9894ad-b58f-48f9-a922-f29c3e0c8a60 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:58.809858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fe9894ad-b58f-48f9-a922-f29c3e0c8a60 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.090202 Mar 08 04:43:58.810430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1216/2482] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:58 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:58.888739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-af68f7b8-5fec-446d-86aa-b0b5ba5b0fff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:58.896353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-af68f7b8-5fec-446d-86aa-b0b5ba5b0fff tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.257377 Mar 08 04:43:58.896854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1267/2483] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:58 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:59.826821 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-be956c37-1e2e-42ab-b4d0-7a7b3cdbb1f1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:59.827342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-be956c37-1e2e-42ab-b4d0-7a7b3cdbb1f1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:59.833573 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be956c37-1e2e-42ab-b4d0-7a7b3cdbb1f1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:59.834066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be956c37-1e2e-42ab-b4d0-7a7b3cdbb1f1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:59.834822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be956c37-1e2e-42ab-b4d0-7a7b3cdbb1f1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:59.835257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be956c37-1e2e-42ab-b4d0-7a7b3cdbb1f1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:59.893976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-be956c37-1e2e-42ab-b4d0-7a7b3cdbb1f1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:43:59.901895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-be956c37-1e2e-42ab-b4d0-7a7b3cdbb1f1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079008 Mar 08 04:43:59.902454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1217/2484] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:43:59.913895 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-07f48319-3781-4cad-91ff-253373d729fc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:43:59.914543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-07f48319-3781-4cad-91ff-253373d729fc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:43:59.921433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07f48319-3781-4cad-91ff-253373d729fc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:59.921920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07f48319-3781-4cad-91ff-253373d729fc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:59.922686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07f48319-3781-4cad-91ff-253373d729fc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:43:59.923123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07f48319-3781-4cad-91ff-253373d729fc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:43:59.968950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:43:59.969211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef (ip 10.222.0.30) !!! Mar 08 04:44:00.052447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-07f48319-3781-4cad-91ff-253373d729fc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:00.060630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-07f48319-3781-4cad-91ff-253373d729fc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150509 Mar 08 04:44:00.061213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1268/2485] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:43:59 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:00.919647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-88d06c4e-283a-40f4-9abc-9aa1190f20b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:00.920260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-88d06c4e-283a-40f4-9abc-9aa1190f20b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:00.926586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88d06c4e-283a-40f4-9abc-9aa1190f20b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:00.927034 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88d06c4e-283a-40f4-9abc-9aa1190f20b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:00.927794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88d06c4e-283a-40f4-9abc-9aa1190f20b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:00.928232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88d06c4e-283a-40f4-9abc-9aa1190f20b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:00.987152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-88d06c4e-283a-40f4-9abc-9aa1190f20b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:00.994800 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-88d06c4e-283a-40f4-9abc-9aa1190f20b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079109 Mar 08 04:44:00.995359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1218/2486] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:01.078124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7982e5b6-0414-42c5-86b0-8e3b2294b53a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:01.078684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7982e5b6-0414-42c5-86b0-8e3b2294b53a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:01.084821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7982e5b6-0414-42c5-86b0-8e3b2294b53a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:01.085266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7982e5b6-0414-42c5-86b0-8e3b2294b53a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:01.086053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7982e5b6-0414-42c5-86b0-8e3b2294b53a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:01.086482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7982e5b6-0414-42c5-86b0-8e3b2294b53a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:01.217973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7982e5b6-0414-42c5-86b0-8e3b2294b53a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:01.225961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7982e5b6-0414-42c5-86b0-8e3b2294b53a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151926 Mar 08 04:44:01.226510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1269/2487] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:01 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:02.012553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2131787f-5b17-49f5-b364-2e18f19f9d38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:02.013168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2131787f-5b17-49f5-b364-2e18f19f9d38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:02.019460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2131787f-5b17-49f5-b364-2e18f19f9d38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:02.019910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2131787f-5b17-49f5-b364-2e18f19f9d38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:02.020668 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2131787f-5b17-49f5-b364-2e18f19f9d38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:02.021102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2131787f-5b17-49f5-b364-2e18f19f9d38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:02.136053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2131787f-5b17-49f5-b364-2e18f19f9d38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:02.144711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2131787f-5b17-49f5-b364-2e18f19f9d38 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.136543 Mar 08 04:44:02.145269 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1219/2488] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:02.243062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-26f78193-32c4-4047-8b7c-5fb596296813 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:02.243694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-26f78193-32c4-4047-8b7c-5fb596296813 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:02.250688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-26f78193-32c4-4047-8b7c-5fb596296813 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:02.251138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-26f78193-32c4-4047-8b7c-5fb596296813 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:02.251906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-26f78193-32c4-4047-8b7c-5fb596296813 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:02.252343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-26f78193-32c4-4047-8b7c-5fb596296813 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:02.385935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-26f78193-32c4-4047-8b7c-5fb596296813 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:02.394381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-26f78193-32c4-4047-8b7c-5fb596296813 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155115 Mar 08 04:44:02.394950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1270/2489] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:02 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:03.161572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-26e98df0-43e7-4902-b248-43d973fb1da3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:03.162242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-26e98df0-43e7-4902-b248-43d973fb1da3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:03.169180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-26e98df0-43e7-4902-b248-43d973fb1da3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:03.169628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-26e98df0-43e7-4902-b248-43d973fb1da3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:03.170419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-26e98df0-43e7-4902-b248-43d973fb1da3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:03.170859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-26e98df0-43e7-4902-b248-43d973fb1da3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:03.231720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-26e98df0-43e7-4902-b248-43d973fb1da3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:03.239543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-26e98df0-43e7-4902-b248-43d973fb1da3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081830 Mar 08 04:44:03.240094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1220/2490] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:03 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:03.411385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8cdf2d79-ac72-4373-824e-2615b4fbec5f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:03.412051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8cdf2d79-ac72-4373-824e-2615b4fbec5f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:03.418473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8cdf2d79-ac72-4373-824e-2615b4fbec5f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:03.418927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8cdf2d79-ac72-4373-824e-2615b4fbec5f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:03.419696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8cdf2d79-ac72-4373-824e-2615b4fbec5f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:03.420139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8cdf2d79-ac72-4373-824e-2615b4fbec5f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:03.550308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8cdf2d79-ac72-4373-824e-2615b4fbec5f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:03.557966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8cdf2d79-ac72-4373-824e-2615b4fbec5f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150392 Mar 08 04:44:03.558525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1271/2491] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:03 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:04.256139 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-36a56ed1-4c95-4a12-917a-e9365ea42fed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:04.256751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-36a56ed1-4c95-4a12-917a-e9365ea42fed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:04.263019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36a56ed1-4c95-4a12-917a-e9365ea42fed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:04.263459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36a56ed1-4c95-4a12-917a-e9365ea42fed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:04.264210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36a56ed1-4c95-4a12-917a-e9365ea42fed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:04.264639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36a56ed1-4c95-4a12-917a-e9365ea42fed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:04.324050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-36a56ed1-4c95-4a12-917a-e9365ea42fed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:04.331675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-36a56ed1-4c95-4a12-917a-e9365ea42fed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079413 Mar 08 04:44:04.332253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1221/2492] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:04 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:04.575182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-191345e5-3a0e-4ebc-b2c7-782bb2d58190 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:04.575182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-191345e5-3a0e-4ebc-b2c7-782bb2d58190 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:04.581367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-191345e5-3a0e-4ebc-b2c7-782bb2d58190 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:04.581853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-191345e5-3a0e-4ebc-b2c7-782bb2d58190 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:04.582612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-191345e5-3a0e-4ebc-b2c7-782bb2d58190 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:04.583042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-191345e5-3a0e-4ebc-b2c7-782bb2d58190 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:04.712824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-191345e5-3a0e-4ebc-b2c7-782bb2d58190 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:04.721140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-191345e5-3a0e-4ebc-b2c7-782bb2d58190 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150408 Mar 08 04:44:04.721716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1272/2493] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:04 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:05.161596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:44:05.161833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:44:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:44:05.350600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c4af0ccf-43aa-405f-b96c-dc81784e26a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:05.351210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c4af0ccf-43aa-405f-b96c-dc81784e26a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:05.357608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c4af0ccf-43aa-405f-b96c-dc81784e26a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:05.358089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c4af0ccf-43aa-405f-b96c-dc81784e26a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:05.358856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c4af0ccf-43aa-405f-b96c-dc81784e26a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:05.359293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c4af0ccf-43aa-405f-b96c-dc81784e26a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:05.418033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c4af0ccf-43aa-405f-b96c-dc81784e26a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:05.425682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c4af0ccf-43aa-405f-b96c-dc81784e26a0 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078936 Mar 08 04:44:05.426574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1222/2494] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:05.738131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-046d9c64-d626-4a5f-85c7-cfad96ebca54 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:05.738663 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-046d9c64-d626-4a5f-85c7-cfad96ebca54 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:05.744868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-046d9c64-d626-4a5f-85c7-cfad96ebca54 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:05.745318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-046d9c64-d626-4a5f-85c7-cfad96ebca54 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:05.746736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-046d9c64-d626-4a5f-85c7-cfad96ebca54 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:05.747174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-046d9c64-d626-4a5f-85c7-cfad96ebca54 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:05.880008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-046d9c64-d626-4a5f-85c7-cfad96ebca54 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:05.887953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-046d9c64-d626-4a5f-85c7-cfad96ebca54 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153766 Mar 08 04:44:05.888510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1273/2495] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:05 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:06.442565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-013de314-059e-4c7d-9fbf-a9756ad034fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:06.443180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-013de314-059e-4c7d-9fbf-a9756ad034fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:06.450126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-013de314-059e-4c7d-9fbf-a9756ad034fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:06.450582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-013de314-059e-4c7d-9fbf-a9756ad034fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:06.451409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-013de314-059e-4c7d-9fbf-a9756ad034fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:06.451848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-013de314-059e-4c7d-9fbf-a9756ad034fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:06.509424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-013de314-059e-4c7d-9fbf-a9756ad034fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:06.517985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-013de314-059e-4c7d-9fbf-a9756ad034fe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079262 Mar 08 04:44:06.518549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1223/2496] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:06.904652 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-201705e5-16e3-4516-8765-dc0bc4e03c88 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:06.905256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-201705e5-16e3-4516-8765-dc0bc4e03c88 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:06.911494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-201705e5-16e3-4516-8765-dc0bc4e03c88 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:06.911939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-201705e5-16e3-4516-8765-dc0bc4e03c88 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:06.912693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-201705e5-16e3-4516-8765-dc0bc4e03c88 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:06.913124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-201705e5-16e3-4516-8765-dc0bc4e03c88 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:07.045566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-201705e5-16e3-4516-8765-dc0bc4e03c88 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:07.053143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-201705e5-16e3-4516-8765-dc0bc4e03c88 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152445 Mar 08 04:44:07.053712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1274/2497] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:06 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:07.534760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ce92e573-7430-459c-9bcf-678461b6c2be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:07.535366 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ce92e573-7430-459c-9bcf-678461b6c2be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:07.541555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce92e573-7430-459c-9bcf-678461b6c2be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:07.542037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce92e573-7430-459c-9bcf-678461b6c2be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:07.542793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce92e573-7430-459c-9bcf-678461b6c2be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:07.543893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce92e573-7430-459c-9bcf-678461b6c2be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:07.601049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ce92e573-7430-459c-9bcf-678461b6c2be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:07.609363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ce92e573-7430-459c-9bcf-678461b6c2be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078462 Mar 08 04:44:07.609949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1224/2498] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:07 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:08.070736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6fad0839-0a38-4bd8-8fe0-dcac71244316 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:08.071372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6fad0839-0a38-4bd8-8fe0-dcac71244316 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:08.078116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6fad0839-0a38-4bd8-8fe0-dcac71244316 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:08.078565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6fad0839-0a38-4bd8-8fe0-dcac71244316 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:08.079328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6fad0839-0a38-4bd8-8fe0-dcac71244316 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:08.079770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6fad0839-0a38-4bd8-8fe0-dcac71244316 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:08.209427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6fad0839-0a38-4bd8-8fe0-dcac71244316 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:08.217056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6fad0839-0a38-4bd8-8fe0-dcac71244316 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150166 Mar 08 04:44:08.217619 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1275/2499] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:08 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:08.626297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0eb89ce8-f1ca-43b8-96b4-30db34afb332 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:08.626911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0eb89ce8-f1ca-43b8-96b4-30db34afb332 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:08.633169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0eb89ce8-f1ca-43b8-96b4-30db34afb332 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:08.633615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0eb89ce8-f1ca-43b8-96b4-30db34afb332 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:08.634399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0eb89ce8-f1ca-43b8-96b4-30db34afb332 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:08.634844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0eb89ce8-f1ca-43b8-96b4-30db34afb332 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:08.693059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0eb89ce8-f1ca-43b8-96b4-30db34afb332 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:08.700762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0eb89ce8-f1ca-43b8-96b4-30db34afb332 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078446 Mar 08 04:44:08.701319 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1225/2500] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:08 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:09.234393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7bfafe4e-be6d-4392-81be-5812594d6311 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:09.235035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7bfafe4e-be6d-4392-81be-5812594d6311 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:09.241238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bfafe4e-be6d-4392-81be-5812594d6311 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:09.241704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bfafe4e-be6d-4392-81be-5812594d6311 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:09.242491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bfafe4e-be6d-4392-81be-5812594d6311 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:09.242927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bfafe4e-be6d-4392-81be-5812594d6311 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:09.375476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7bfafe4e-be6d-4392-81be-5812594d6311 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:09.383098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7bfafe4e-be6d-4392-81be-5812594d6311 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153194 Mar 08 04:44:09.383658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1276/2501] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:09 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:09.718018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-69d4c498-92dc-4eff-8c93-351e07ed76b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:09.718624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-69d4c498-92dc-4eff-8c93-351e07ed76b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:09.724801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-69d4c498-92dc-4eff-8c93-351e07ed76b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:09.725247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-69d4c498-92dc-4eff-8c93-351e07ed76b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:09.726056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-69d4c498-92dc-4eff-8c93-351e07ed76b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:09.726490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-69d4c498-92dc-4eff-8c93-351e07ed76b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:09.785226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-69d4c498-92dc-4eff-8c93-351e07ed76b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:09.793560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-69d4c498-92dc-4eff-8c93-351e07ed76b7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079270 Mar 08 04:44:09.794136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1226/2502] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:09 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:10.400202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-95c71309-5d4e-4997-b55a-69d921394782 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:10.400810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-95c71309-5d4e-4997-b55a-69d921394782 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:10.407362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95c71309-5d4e-4997-b55a-69d921394782 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:10.407808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95c71309-5d4e-4997-b55a-69d921394782 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:10.408557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95c71309-5d4e-4997-b55a-69d921394782 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:10.408991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95c71309-5d4e-4997-b55a-69d921394782 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:10.539579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-95c71309-5d4e-4997-b55a-69d921394782 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:10.547270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-95c71309-5d4e-4997-b55a-69d921394782 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151251 Mar 08 04:44:10.547821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1277/2503] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:10 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:10.810730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0ba085ed-bac1-449a-99cd-bef4897dba8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:10.811338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0ba085ed-bac1-449a-99cd-bef4897dba8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:10.818304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba085ed-bac1-449a-99cd-bef4897dba8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:10.818749 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba085ed-bac1-449a-99cd-bef4897dba8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:10.819510 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba085ed-bac1-449a-99cd-bef4897dba8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:10.819940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ba085ed-bac1-449a-99cd-bef4897dba8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:10.883406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0ba085ed-bac1-449a-99cd-bef4897dba8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:10.891877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0ba085ed-bac1-449a-99cd-bef4897dba8e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.085578 Mar 08 04:44:10.892442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1227/2504] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:10 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:11.564360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-936aec2d-5dbd-4174-af5f-b05ffb032963 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:11.564978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-936aec2d-5dbd-4174-af5f-b05ffb032963 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:11.571315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-936aec2d-5dbd-4174-af5f-b05ffb032963 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:11.571769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-936aec2d-5dbd-4174-af5f-b05ffb032963 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:11.572544 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-936aec2d-5dbd-4174-af5f-b05ffb032963 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:11.572987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-936aec2d-5dbd-4174-af5f-b05ffb032963 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:11.701529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-936aec2d-5dbd-4174-af5f-b05ffb032963 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:11.709223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-936aec2d-5dbd-4174-af5f-b05ffb032963 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.148799 Mar 08 04:44:11.709808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1278/2505] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:11 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:11.909175 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-406e8391-338f-4432-818b-7aa56a1dd4a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:11.909810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-406e8391-338f-4432-818b-7aa56a1dd4a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:11.915972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-406e8391-338f-4432-818b-7aa56a1dd4a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:11.916418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-406e8391-338f-4432-818b-7aa56a1dd4a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:11.917167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-406e8391-338f-4432-818b-7aa56a1dd4a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:11.917599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-406e8391-338f-4432-818b-7aa56a1dd4a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:11.976214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-406e8391-338f-4432-818b-7aa56a1dd4a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:11.984320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-406e8391-338f-4432-818b-7aa56a1dd4a7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079009 Mar 08 04:44:11.984877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1228/2506] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:12.728795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d6c93b6b-5d5b-449b-8092-844ac98870dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:12.729386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d6c93b6b-5d5b-449b-8092-844ac98870dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:12.735804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d6c93b6b-5d5b-449b-8092-844ac98870dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:12.736251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d6c93b6b-5d5b-449b-8092-844ac98870dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:12.737009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d6c93b6b-5d5b-449b-8092-844ac98870dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:12.737438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d6c93b6b-5d5b-449b-8092-844ac98870dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:12.870120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d6c93b6b-5d5b-449b-8092-844ac98870dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:12.878301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d6c93b6b-5d5b-449b-8092-844ac98870dc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153597 Mar 08 04:44:12.878859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1279/2507] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:12 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:13.000837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-669ffa78-7df1-4b02-8805-bb8d13eb8860 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:13.001468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-669ffa78-7df1-4b02-8805-bb8d13eb8860 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:13.007625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-669ffa78-7df1-4b02-8805-bb8d13eb8860 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:13.008073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-669ffa78-7df1-4b02-8805-bb8d13eb8860 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:13.008842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-669ffa78-7df1-4b02-8805-bb8d13eb8860 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:13.009277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-669ffa78-7df1-4b02-8805-bb8d13eb8860 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:13.074828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-669ffa78-7df1-4b02-8805-bb8d13eb8860 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:13.082454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-669ffa78-7df1-4b02-8805-bb8d13eb8860 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.085531 Mar 08 04:44:13.083014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1229/2508] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:13.895726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-180d093e-ef6d-44ee-adbf-f9091ceb7874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:13.896331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-180d093e-ef6d-44ee-adbf-f9091ceb7874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:13.903467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-180d093e-ef6d-44ee-adbf-f9091ceb7874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:13.903911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-180d093e-ef6d-44ee-adbf-f9091ceb7874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:13.905928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-180d093e-ef6d-44ee-adbf-f9091ceb7874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:13.907812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-180d093e-ef6d-44ee-adbf-f9091ceb7874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:14.036435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-180d093e-ef6d-44ee-adbf-f9091ceb7874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:14.044351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-180d093e-ef6d-44ee-adbf-f9091ceb7874 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152411 Mar 08 04:44:14.044912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1280/2509] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:13 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:14.099592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-07bbf793-935f-4504-86f7-c0ad255c5041 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:14.100196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-07bbf793-935f-4504-86f7-c0ad255c5041 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:14.106602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07bbf793-935f-4504-86f7-c0ad255c5041 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:14.106995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07bbf793-935f-4504-86f7-c0ad255c5041 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:14.107757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07bbf793-935f-4504-86f7-c0ad255c5041 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:14.108194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-07bbf793-935f-4504-86f7-c0ad255c5041 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:14.169260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-07bbf793-935f-4504-86f7-c0ad255c5041 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:14.176997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-07bbf793-935f-4504-86f7-c0ad255c5041 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081197 Mar 08 04:44:14.177559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1230/2510] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:15.061004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f5c57571-0f27-45fd-baae-90ada1f5c349 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:15.061611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f5c57571-0f27-45fd-baae-90ada1f5c349 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:15.067907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c57571-0f27-45fd-baae-90ada1f5c349 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:15.068329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c57571-0f27-45fd-baae-90ada1f5c349 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:15.069113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c57571-0f27-45fd-baae-90ada1f5c349 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:15.069542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f5c57571-0f27-45fd-baae-90ada1f5c349 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:15.194358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4c6f1f99-ba64-4bfe-ac80-684be26b271e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:15.194950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4c6f1f99-ba64-4bfe-ac80-684be26b271e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:15.197488 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f5c57571-0f27-45fd-baae-90ada1f5c349 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:15.201234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c6f1f99-ba64-4bfe-ac80-684be26b271e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:15.201736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c6f1f99-ba64-4bfe-ac80-684be26b271e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:15.202511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c6f1f99-ba64-4bfe-ac80-684be26b271e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:15.202953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4c6f1f99-ba64-4bfe-ac80-684be26b271e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:15.205300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f5c57571-0f27-45fd-baae-90ada1f5c349 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.148223 Mar 08 04:44:15.205896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1281/2511] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:15 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:15.262721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4c6f1f99-ba64-4bfe-ac80-684be26b271e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:15.270533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4c6f1f99-ba64-4bfe-ac80-684be26b271e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080108 Mar 08 04:44:15.271090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1231/2512] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:15 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:16.222903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4844bc64-67dd-4da8-811b-59f52bf76e82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:16.223513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4844bc64-67dd-4da8-811b-59f52bf76e82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:16.229853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4844bc64-67dd-4da8-811b-59f52bf76e82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:16.230851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4844bc64-67dd-4da8-811b-59f52bf76e82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:16.231708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4844bc64-67dd-4da8-811b-59f52bf76e82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:16.232146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4844bc64-67dd-4da8-811b-59f52bf76e82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:16.287976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-61b1d2d7-7fc0-48ee-9256-9904c0871e55 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:16.288596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-61b1d2d7-7fc0-48ee-9256-9904c0871e55 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:16.295314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61b1d2d7-7fc0-48ee-9256-9904c0871e55 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:16.295763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61b1d2d7-7fc0-48ee-9256-9904c0871e55 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:16.296525 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61b1d2d7-7fc0-48ee-9256-9904c0871e55 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:16.296993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61b1d2d7-7fc0-48ee-9256-9904c0871e55 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:16.369088 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-61b1d2d7-7fc0-48ee-9256-9904c0871e55 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:16.376807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-61b1d2d7-7fc0-48ee-9256-9904c0871e55 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.092702 Mar 08 04:44:16.377381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1232/2513] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:16 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:16.390012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4844bc64-67dd-4da8-811b-59f52bf76e82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:16.398045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4844bc64-67dd-4da8-811b-59f52bf76e82 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.178815 Mar 08 04:44:16.398629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1282/2514] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:16 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:17.393999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bd22aa6f-1541-4dab-8c5e-907a44dc6e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:17.394614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bd22aa6f-1541-4dab-8c5e-907a44dc6e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:17.401112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd22aa6f-1541-4dab-8c5e-907a44dc6e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:17.401563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd22aa6f-1541-4dab-8c5e-907a44dc6e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:17.402350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd22aa6f-1541-4dab-8c5e-907a44dc6e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:17.402861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd22aa6f-1541-4dab-8c5e-907a44dc6e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:17.415435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-95fc7654-e730-49e5-9f34-9fff8cafd2cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:17.416049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-95fc7654-e730-49e5-9f34-9fff8cafd2cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:17.422215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95fc7654-e730-49e5-9f34-9fff8cafd2cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:17.422666 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95fc7654-e730-49e5-9f34-9fff8cafd2cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:17.423431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95fc7654-e730-49e5-9f34-9fff8cafd2cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:17.423869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-95fc7654-e730-49e5-9f34-9fff8cafd2cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:17.465505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bd22aa6f-1541-4dab-8c5e-907a44dc6e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:17.473270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bd22aa6f-1541-4dab-8c5e-907a44dc6e2d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083048 Mar 08 04:44:17.473860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1233/2515] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:17.561643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-95fc7654-e730-49e5-9f34-9fff8cafd2cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:17.569253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-95fc7654-e730-49e5-9f34-9fff8cafd2cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.157617 Mar 08 04:44:17.569842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1283/2516] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:17 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:18.490794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a6a66d51-be49-4225-879c-8a3b825b1e3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:18.491403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a6a66d51-be49-4225-879c-8a3b825b1e3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:18.497880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6a66d51-be49-4225-879c-8a3b825b1e3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:18.498333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6a66d51-be49-4225-879c-8a3b825b1e3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:18.499090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6a66d51-be49-4225-879c-8a3b825b1e3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:18.499526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a6a66d51-be49-4225-879c-8a3b825b1e3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:18.560762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a6a66d51-be49-4225-879c-8a3b825b1e3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:18.568525 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a6a66d51-be49-4225-879c-8a3b825b1e3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081601 Mar 08 04:44:18.569082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1234/2517] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:18 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:18.586399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-925cd5e0-61c3-4001-a736-2b66d159a34c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:18.587007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-925cd5e0-61c3-4001-a736-2b66d159a34c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:18.593566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-925cd5e0-61c3-4001-a736-2b66d159a34c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:18.594039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-925cd5e0-61c3-4001-a736-2b66d159a34c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:18.594792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-925cd5e0-61c3-4001-a736-2b66d159a34c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:18.595228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-925cd5e0-61c3-4001-a736-2b66d159a34c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:18.718019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:44:18.718238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:44:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:44:18.722420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-925cd5e0-61c3-4001-a736-2b66d159a34c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:18.730160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-925cd5e0-61c3-4001-a736-2b66d159a34c tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.147709 Mar 08 04:44:18.730711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1284/2518] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:18 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:19.585828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-aab8f3d9-d0f6-4117-81c5-bc3297544183 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:19.586367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-aab8f3d9-d0f6-4117-81c5-bc3297544183 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:19.593233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aab8f3d9-d0f6-4117-81c5-bc3297544183 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:19.593697 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aab8f3d9-d0f6-4117-81c5-bc3297544183 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:19.594463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aab8f3d9-d0f6-4117-81c5-bc3297544183 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:19.594903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aab8f3d9-d0f6-4117-81c5-bc3297544183 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:19.653580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-aab8f3d9-d0f6-4117-81c5-bc3297544183 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:19.661240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-aab8f3d9-d0f6-4117-81c5-bc3297544183 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079350 Mar 08 04:44:19.661814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1235/2519] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:19 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:19.747714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c20a99b3-fe89-469e-b633-f1d763ab9613 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:19.748322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c20a99b3-fe89-469e-b633-f1d763ab9613 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:19.754484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c20a99b3-fe89-469e-b633-f1d763ab9613 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:19.754925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c20a99b3-fe89-469e-b633-f1d763ab9613 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:19.755675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c20a99b3-fe89-469e-b633-f1d763ab9613 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:19.756107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c20a99b3-fe89-469e-b633-f1d763ab9613 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:19.888421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c20a99b3-fe89-469e-b633-f1d763ab9613 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:19.896064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c20a99b3-fe89-469e-b633-f1d763ab9613 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152422 Mar 08 04:44:19.896621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1285/2520] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:19 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:20.682757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cfcc544c-d18f-49c2-bbac-861f0b92530d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:20.684136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cfcc544c-d18f-49c2-bbac-861f0b92530d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:20.690397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfcc544c-d18f-49c2-bbac-861f0b92530d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:20.690787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfcc544c-d18f-49c2-bbac-861f0b92530d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:20.691539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfcc544c-d18f-49c2-bbac-861f0b92530d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:20.691974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cfcc544c-d18f-49c2-bbac-861f0b92530d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:20.750061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cfcc544c-d18f-49c2-bbac-861f0b92530d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:20.757683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cfcc544c-d18f-49c2-bbac-861f0b92530d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078748 Mar 08 04:44:20.758231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1236/2521] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:20.912670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-591fc8fe-da81-40f2-84ce-fe1c93d7b959 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:20.913273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-591fc8fe-da81-40f2-84ce-fe1c93d7b959 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:20.920124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-591fc8fe-da81-40f2-84ce-fe1c93d7b959 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:20.920564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-591fc8fe-da81-40f2-84ce-fe1c93d7b959 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:20.921317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-591fc8fe-da81-40f2-84ce-fe1c93d7b959 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:20.921778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-591fc8fe-da81-40f2-84ce-fe1c93d7b959 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:21.056268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-591fc8fe-da81-40f2-84ce-fe1c93d7b959 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:21.065364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-591fc8fe-da81-40f2-84ce-fe1c93d7b959 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.156487 Mar 08 04:44:21.066307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1286/2522] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:20 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:21.774939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d7c9c6c2-9033-47a9-bd3f-f2aa40997126 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:21.775544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d7c9c6c2-9033-47a9-bd3f-f2aa40997126 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:21.781794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7c9c6c2-9033-47a9-bd3f-f2aa40997126 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:21.782241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7c9c6c2-9033-47a9-bd3f-f2aa40997126 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:21.782993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7c9c6c2-9033-47a9-bd3f-f2aa40997126 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:21.783425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7c9c6c2-9033-47a9-bd3f-f2aa40997126 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:21.844585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d7c9c6c2-9033-47a9-bd3f-f2aa40997126 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:21.852957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d7c9c6c2-9033-47a9-bd3f-f2aa40997126 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082136 Mar 08 04:44:21.853833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1237/2523] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:21 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:22.082500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dea5b933-10ff-4139-9f6a-d3ee03b11b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:22.083119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dea5b933-10ff-4139-9f6a-d3ee03b11b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:22.089406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dea5b933-10ff-4139-9f6a-d3ee03b11b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:22.089887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dea5b933-10ff-4139-9f6a-d3ee03b11b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:22.090663 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dea5b933-10ff-4139-9f6a-d3ee03b11b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:22.091104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dea5b933-10ff-4139-9f6a-d3ee03b11b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:22.218819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dea5b933-10ff-4139-9f6a-d3ee03b11b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:22.226347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dea5b933-10ff-4139-9f6a-d3ee03b11b0e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.147741 Mar 08 04:44:22.226912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1287/2524] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:22 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:22.869877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b7566052-af65-438f-a479-a6275398c0cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:22.870511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b7566052-af65-438f-a479-a6275398c0cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:22.876757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7566052-af65-438f-a479-a6275398c0cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:22.877208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7566052-af65-438f-a479-a6275398c0cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:22.878052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7566052-af65-438f-a479-a6275398c0cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:22.878488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b7566052-af65-438f-a479-a6275398c0cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:22.936363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b7566052-af65-438f-a479-a6275398c0cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:22.943864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b7566052-af65-438f-a479-a6275398c0cd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078087 Mar 08 04:44:22.944416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1238/2525] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:23.243602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ccb5ce2d-166d-4b7b-bb9e-a8d70271d5d3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:23.244250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ccb5ce2d-166d-4b7b-bb9e-a8d70271d5d3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:23.251023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ccb5ce2d-166d-4b7b-bb9e-a8d70271d5d3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:23.251476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ccb5ce2d-166d-4b7b-bb9e-a8d70271d5d3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:23.252245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ccb5ce2d-166d-4b7b-bb9e-a8d70271d5d3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:23.252688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ccb5ce2d-166d-4b7b-bb9e-a8d70271d5d3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:23.384419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ccb5ce2d-166d-4b7b-bb9e-a8d70271d5d3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:23.392620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ccb5ce2d-166d-4b7b-bb9e-a8d70271d5d3 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152871 Mar 08 04:44:23.393183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1288/2526] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:23 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:23.960390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6ae0c4d9-1e7e-4742-9c8d-38dcbda858e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:23.960998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6ae0c4d9-1e7e-4742-9c8d-38dcbda858e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:23.967516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ae0c4d9-1e7e-4742-9c8d-38dcbda858e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:23.967965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ae0c4d9-1e7e-4742-9c8d-38dcbda858e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:23.968764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ae0c4d9-1e7e-4742-9c8d-38dcbda858e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:23.969200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6ae0c4d9-1e7e-4742-9c8d-38dcbda858e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:24.028198 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6ae0c4d9-1e7e-4742-9c8d-38dcbda858e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:24.035798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6ae0c4d9-1e7e-4742-9c8d-38dcbda858e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079285 Mar 08 04:44:24.036350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1239/2527] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:24.409779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f395f138-89fb-451d-8ba9-be2d100fc8ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:24.410454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f395f138-89fb-451d-8ba9-be2d100fc8ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:24.416718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f395f138-89fb-451d-8ba9-be2d100fc8ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:24.417723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f395f138-89fb-451d-8ba9-be2d100fc8ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:24.418546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f395f138-89fb-451d-8ba9-be2d100fc8ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:24.418985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f395f138-89fb-451d-8ba9-be2d100fc8ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:24.547711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f395f138-89fb-451d-8ba9-be2d100fc8ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:24.555427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f395f138-89fb-451d-8ba9-be2d100fc8ec tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149554 Mar 08 04:44:24.555995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1289/2528] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:24 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:25.052365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c11efdb0-cc0c-4cc4-8eff-fa455cd4e405 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:25.052891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c11efdb0-cc0c-4cc4-8eff-fa455cd4e405 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:25.059920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c11efdb0-cc0c-4cc4-8eff-fa455cd4e405 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:25.060391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c11efdb0-cc0c-4cc4-8eff-fa455cd4e405 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:25.061173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c11efdb0-cc0c-4cc4-8eff-fa455cd4e405 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:25.061606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c11efdb0-cc0c-4cc4-8eff-fa455cd4e405 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:25.123827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c11efdb0-cc0c-4cc4-8eff-fa455cd4e405 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:25.131615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c11efdb0-cc0c-4cc4-8eff-fa455cd4e405 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083176 Mar 08 04:44:25.132176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1240/2529] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:25.572206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-64cc182b-08a6-4cc5-861c-bc53362d84aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:25.572814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-64cc182b-08a6-4cc5-861c-bc53362d84aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:25.579755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64cc182b-08a6-4cc5-861c-bc53362d84aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:25.580200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64cc182b-08a6-4cc5-861c-bc53362d84aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:25.580952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64cc182b-08a6-4cc5-861c-bc53362d84aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:25.581385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64cc182b-08a6-4cc5-861c-bc53362d84aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:25.711219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-64cc182b-08a6-4cc5-861c-bc53362d84aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:25.719059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-64cc182b-08a6-4cc5-861c-bc53362d84aa tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150681 Mar 08 04:44:25.719617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1290/2530] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:25 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:26.148756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-13324f6f-7232-45ba-bb73-dfa0d74aea93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:26.149316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-13324f6f-7232-45ba-bb73-dfa0d74aea93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:26.155557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13324f6f-7232-45ba-bb73-dfa0d74aea93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:26.156001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13324f6f-7232-45ba-bb73-dfa0d74aea93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:26.156751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13324f6f-7232-45ba-bb73-dfa0d74aea93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:26.157182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13324f6f-7232-45ba-bb73-dfa0d74aea93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:26.217511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-13324f6f-7232-45ba-bb73-dfa0d74aea93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:26.225270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-13324f6f-7232-45ba-bb73-dfa0d74aea93 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080818 Mar 08 04:44:26.225844 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1241/2531] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:26 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:26.735740 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4dfb4001-18d1-4b94-9b17-74180b73f20d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:26.736344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4dfb4001-18d1-4b94-9b17-74180b73f20d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:26.742684 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4dfb4001-18d1-4b94-9b17-74180b73f20d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:26.743140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4dfb4001-18d1-4b94-9b17-74180b73f20d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:26.743904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4dfb4001-18d1-4b94-9b17-74180b73f20d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:26.744346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4dfb4001-18d1-4b94-9b17-74180b73f20d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:26.878964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4dfb4001-18d1-4b94-9b17-74180b73f20d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:26.886616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4dfb4001-18d1-4b94-9b17-74180b73f20d tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154810 Mar 08 04:44:26.887249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1291/2532] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:26 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:27.241384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ee4f1cbc-be3b-4916-bd07-099811bb5bed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:27.242018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ee4f1cbc-be3b-4916-bd07-099811bb5bed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:27.248742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee4f1cbc-be3b-4916-bd07-099811bb5bed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:27.249189 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee4f1cbc-be3b-4916-bd07-099811bb5bed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:27.249991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee4f1cbc-be3b-4916-bd07-099811bb5bed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:27.250423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee4f1cbc-be3b-4916-bd07-099811bb5bed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:27.308263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ee4f1cbc-be3b-4916-bd07-099811bb5bed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:27.315914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ee4f1cbc-be3b-4916-bd07-099811bb5bed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078554 Mar 08 04:44:27.316462 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1242/2533] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:27 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:27.904408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0a28a663-83b1-46e7-a4d9-26161a510ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:27.905011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0a28a663-83b1-46e7-a4d9-26161a510ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:27.911329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a28a663-83b1-46e7-a4d9-26161a510ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:27.911776 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a28a663-83b1-46e7-a4d9-26161a510ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:27.912532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a28a663-83b1-46e7-a4d9-26161a510ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:27.912969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0a28a663-83b1-46e7-a4d9-26161a510ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:28.044322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0a28a663-83b1-46e7-a4d9-26161a510ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:28.052000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0a28a663-83b1-46e7-a4d9-26161a510ecf tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152068 Mar 08 04:44:28.052556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1292/2534] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:27 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:28.333425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6f96c3f1-c89b-467f-9d60-f0a17b32264a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:28.334041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6f96c3f1-c89b-467f-9d60-f0a17b32264a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:28.340376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6f96c3f1-c89b-467f-9d60-f0a17b32264a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:28.340818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6f96c3f1-c89b-467f-9d60-f0a17b32264a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:28.341573 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6f96c3f1-c89b-467f-9d60-f0a17b32264a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:28.342041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6f96c3f1-c89b-467f-9d60-f0a17b32264a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:28.399838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6f96c3f1-c89b-467f-9d60-f0a17b32264a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:28.407389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6f96c3f1-c89b-467f-9d60-f0a17b32264a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077772 Mar 08 04:44:28.407935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1243/2535] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:28 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:29.068797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5b89f63e-36a2-45a1-9e90-f1e8945e0c27 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:29.069461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5b89f63e-36a2-45a1-9e90-f1e8945e0c27 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:29.075908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b89f63e-36a2-45a1-9e90-f1e8945e0c27 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:29.076358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b89f63e-36a2-45a1-9e90-f1e8945e0c27 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:29.077118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b89f63e-36a2-45a1-9e90-f1e8945e0c27 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:29.077554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b89f63e-36a2-45a1-9e90-f1e8945e0c27 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:29.211980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5b89f63e-36a2-45a1-9e90-f1e8945e0c27 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:29.220278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5b89f63e-36a2-45a1-9e90-f1e8945e0c27 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155305 Mar 08 04:44:29.220840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1293/2536] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:29 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:29.423839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9e71c798-7660-4ead-9f13-8b302ec1f129 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:29.424404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9e71c798-7660-4ead-9f13-8b302ec1f129 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:29.430668 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e71c798-7660-4ead-9f13-8b302ec1f129 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:29.431118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e71c798-7660-4ead-9f13-8b302ec1f129 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:29.431880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e71c798-7660-4ead-9f13-8b302ec1f129 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:29.432329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e71c798-7660-4ead-9f13-8b302ec1f129 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:29.492752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9e71c798-7660-4ead-9f13-8b302ec1f129 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:29.500974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9e71c798-7660-4ead-9f13-8b302ec1f129 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081076 Mar 08 04:44:29.501520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1244/2537] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:30.236398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-28edd4ef-cbf3-41cb-9d7f-f66e2cbf3f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:30.237006 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-28edd4ef-cbf3-41cb-9d7f-f66e2cbf3f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:30.243367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-28edd4ef-cbf3-41cb-9d7f-f66e2cbf3f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:30.243811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-28edd4ef-cbf3-41cb-9d7f-f66e2cbf3f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:30.244565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-28edd4ef-cbf3-41cb-9d7f-f66e2cbf3f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:30.244995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-28edd4ef-cbf3-41cb-9d7f-f66e2cbf3f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:30.375498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-28edd4ef-cbf3-41cb-9d7f-f66e2cbf3f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:30.383235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-28edd4ef-cbf3-41cb-9d7f-f66e2cbf3f4b tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150798 Mar 08 04:44:30.383810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1294/2538] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:30 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:30.518108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0670027d-149a-4ad0-98d4-73c1177db583 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:30.518667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0670027d-149a-4ad0-98d4-73c1177db583 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:30.525102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0670027d-149a-4ad0-98d4-73c1177db583 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:30.525553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0670027d-149a-4ad0-98d4-73c1177db583 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:30.526414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0670027d-149a-4ad0-98d4-73c1177db583 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:30.526847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0670027d-149a-4ad0-98d4-73c1177db583 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:30.584140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0670027d-149a-4ad0-98d4-73c1177db583 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:30.592330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0670027d-149a-4ad0-98d4-73c1177db583 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078173 Mar 08 04:44:30.592884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1245/2539] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:31.400869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d0410442-f893-4ee2-af38-81dc7f1dd118 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:31.401521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d0410442-f893-4ee2-af38-81dc7f1dd118 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:31.409120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d0410442-f893-4ee2-af38-81dc7f1dd118 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:31.409870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d0410442-f893-4ee2-af38-81dc7f1dd118 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:31.410657 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d0410442-f893-4ee2-af38-81dc7f1dd118 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:31.411096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d0410442-f893-4ee2-af38-81dc7f1dd118 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:31.550604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d0410442-f893-4ee2-af38-81dc7f1dd118 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:31.558306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d0410442-f893-4ee2-af38-81dc7f1dd118 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.161572 Mar 08 04:44:31.558872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1295/2540] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:31 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:31.609240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0d89e57d-0c41-4fe3-a1c4-0c9dd59a8b57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:31.609878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0d89e57d-0c41-4fe3-a1c4-0c9dd59a8b57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:31.616051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d89e57d-0c41-4fe3-a1c4-0c9dd59a8b57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:31.616499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d89e57d-0c41-4fe3-a1c4-0c9dd59a8b57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:31.617245 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d89e57d-0c41-4fe3-a1c4-0c9dd59a8b57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:31.617696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0d89e57d-0c41-4fe3-a1c4-0c9dd59a8b57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:31.678349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0d89e57d-0c41-4fe3-a1c4-0c9dd59a8b57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:31.686402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0d89e57d-0c41-4fe3-a1c4-0c9dd59a8b57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081657 Mar 08 04:44:31.686958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1246/2541] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:31 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:32.574831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6dca063a-dd1f-4350-8ac4-d05806e9ce32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:32.575446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6dca063a-dd1f-4350-8ac4-d05806e9ce32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:32.582168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dca063a-dd1f-4350-8ac4-d05806e9ce32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:32.582616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dca063a-dd1f-4350-8ac4-d05806e9ce32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:32.583377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dca063a-dd1f-4350-8ac4-d05806e9ce32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:32.583814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dca063a-dd1f-4350-8ac4-d05806e9ce32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:32.703539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8a10cc25-254d-42ba-9d0b-085fea49251a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:32.704155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8a10cc25-254d-42ba-9d0b-085fea49251a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:32.710575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a10cc25-254d-42ba-9d0b-085fea49251a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:32.711021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a10cc25-254d-42ba-9d0b-085fea49251a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:32.711788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a10cc25-254d-42ba-9d0b-085fea49251a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:32.712216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8a10cc25-254d-42ba-9d0b-085fea49251a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:32.715505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6dca063a-dd1f-4350-8ac4-d05806e9ce32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:32.724790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6dca063a-dd1f-4350-8ac4-d05806e9ce32 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153707 Mar 08 04:44:32.725368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1296/2542] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:32 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:32.771089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8a10cc25-254d-42ba-9d0b-085fea49251a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:32.779012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8a10cc25-254d-42ba-9d0b-085fea49251a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079942 Mar 08 04:44:32.780423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1247/2543] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:32 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:33.741799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-82d84798-879e-471a-8b1c-c1e93871e4b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:33.742342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-82d84798-879e-471a-8b1c-c1e93871e4b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:33.748682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82d84798-879e-471a-8b1c-c1e93871e4b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:33.749151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82d84798-879e-471a-8b1c-c1e93871e4b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:33.749931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82d84798-879e-471a-8b1c-c1e93871e4b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:33.750362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82d84798-879e-471a-8b1c-c1e93871e4b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:33.797194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9e4b20a5-c034-48ca-8b40-297bd4887ac5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:33.797989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9e4b20a5-c034-48ca-8b40-297bd4887ac5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:33.804057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e4b20a5-c034-48ca-8b40-297bd4887ac5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:33.804503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e4b20a5-c034-48ca-8b40-297bd4887ac5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:33.805281 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e4b20a5-c034-48ca-8b40-297bd4887ac5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:33.805735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9e4b20a5-c034-48ca-8b40-297bd4887ac5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:33.876694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9e4b20a5-c034-48ca-8b40-297bd4887ac5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:33.884359 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9e4b20a5-c034-48ca-8b40-297bd4887ac5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.091753 Mar 08 04:44:33.884924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1248/2544] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:33.905522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-82d84798-879e-471a-8b1c-c1e93871e4b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:33.913126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-82d84798-879e-471a-8b1c-c1e93871e4b0 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.175250 Mar 08 04:44:33.913700 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1297/2545] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:33 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:34.901138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e93f448e-e15f-4aac-855e-e35a1e4bbec5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:34.901776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e93f448e-e15f-4aac-855e-e35a1e4bbec5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:34.908740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e93f448e-e15f-4aac-855e-e35a1e4bbec5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:34.909190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e93f448e-e15f-4aac-855e-e35a1e4bbec5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:34.910125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e93f448e-e15f-4aac-855e-e35a1e4bbec5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:34.910559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e93f448e-e15f-4aac-855e-e35a1e4bbec5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:34.930207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-866b4acd-1393-4d90-a4e9-c7020ff666e7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:34.930809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-866b4acd-1393-4d90-a4e9-c7020ff666e7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:34.937065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866b4acd-1393-4d90-a4e9-c7020ff666e7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:34.937509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866b4acd-1393-4d90-a4e9-c7020ff666e7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:34.938294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866b4acd-1393-4d90-a4e9-c7020ff666e7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:34.938730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-866b4acd-1393-4d90-a4e9-c7020ff666e7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:34.969134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e93f448e-e15f-4aac-855e-e35a1e4bbec5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:34.976919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e93f448e-e15f-4aac-855e-e35a1e4bbec5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079966 Mar 08 04:44:34.977742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1249/2546] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:35.069203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-866b4acd-1393-4d90-a4e9-c7020ff666e7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:35.077607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-866b4acd-1393-4d90-a4e9-c7020ff666e7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.151210 Mar 08 04:44:35.078190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1298/2547] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:34 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:35.368871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:44:35.369085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:44:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:44:35.993814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c2673b33-152b-4bbb-8105-cf9c8cf0d800 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:35.994443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c2673b33-152b-4bbb-8105-cf9c8cf0d800 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:36.000596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2673b33-152b-4bbb-8105-cf9c8cf0d800 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:36.001040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2673b33-152b-4bbb-8105-cf9c8cf0d800 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:36.001824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2673b33-152b-4bbb-8105-cf9c8cf0d800 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:36.002254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c2673b33-152b-4bbb-8105-cf9c8cf0d800 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:36.066396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c2673b33-152b-4bbb-8105-cf9c8cf0d800 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:36.074224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c2673b33-152b-4bbb-8105-cf9c8cf0d800 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.084410 Mar 08 04:44:36.074976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1250/2548] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:35 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:36.096477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7a519ffb-fb6c-4548-8efe-bf0788a73f5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:36.097102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7a519ffb-fb6c-4548-8efe-bf0788a73f5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:36.103636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a519ffb-fb6c-4548-8efe-bf0788a73f5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:36.104146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a519ffb-fb6c-4548-8efe-bf0788a73f5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:36.104855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a519ffb-fb6c-4548-8efe-bf0788a73f5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:36.105289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a519ffb-fb6c-4548-8efe-bf0788a73f5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:36.239254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7a519ffb-fb6c-4548-8efe-bf0788a73f5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:36.246948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7a519ffb-fb6c-4548-8efe-bf0788a73f5a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155864 Mar 08 04:44:36.247600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1299/2549] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:36 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:37.091116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1cf55d07-b421-425b-b728-161f60481916 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:37.092398 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1cf55d07-b421-425b-b728-161f60481916 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:37.098666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1cf55d07-b421-425b-b728-161f60481916 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:37.099109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1cf55d07-b421-425b-b728-161f60481916 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:37.099886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1cf55d07-b421-425b-b728-161f60481916 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:37.100320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1cf55d07-b421-425b-b728-161f60481916 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:37.157926 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1cf55d07-b421-425b-b728-161f60481916 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:37.165514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1cf55d07-b421-425b-b728-161f60481916 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078234 Mar 08 04:44:37.166089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1251/2550] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:37 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:37.263808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3aa50446-7dfe-4ad3-ad44-a5d91e49648e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:37.264418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3aa50446-7dfe-4ad3-ad44-a5d91e49648e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:37.270655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3aa50446-7dfe-4ad3-ad44-a5d91e49648e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:37.271107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3aa50446-7dfe-4ad3-ad44-a5d91e49648e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:37.271866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3aa50446-7dfe-4ad3-ad44-a5d91e49648e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:37.272571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3aa50446-7dfe-4ad3-ad44-a5d91e49648e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:37.402557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3aa50446-7dfe-4ad3-ad44-a5d91e49648e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:37.410836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3aa50446-7dfe-4ad3-ad44-a5d91e49648e tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150904 Mar 08 04:44:37.411390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1300/2551] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:37 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:38.181935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b9f34ed1-5fce-48de-8f6c-fb06acac9641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:38.182544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b9f34ed1-5fce-48de-8f6c-fb06acac9641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:38.189429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9f34ed1-5fce-48de-8f6c-fb06acac9641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:38.189902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9f34ed1-5fce-48de-8f6c-fb06acac9641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:38.190660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9f34ed1-5fce-48de-8f6c-fb06acac9641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:38.191095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9f34ed1-5fce-48de-8f6c-fb06acac9641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:38.249433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b9f34ed1-5fce-48de-8f6c-fb06acac9641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:38.257883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b9f34ed1-5fce-48de-8f6c-fb06acac9641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079658 Mar 08 04:44:38.258534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1252/2552] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:38 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:38.428227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2fb55faf-2fbb-41c2-a398-37c6f082e77f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:38.429071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2fb55faf-2fbb-41c2-a398-37c6f082e77f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:38.435878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2fb55faf-2fbb-41c2-a398-37c6f082e77f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:38.436269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2fb55faf-2fbb-41c2-a398-37c6f082e77f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:38.437198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2fb55faf-2fbb-41c2-a398-37c6f082e77f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:38.437631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2fb55faf-2fbb-41c2-a398-37c6f082e77f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:38.569459 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2fb55faf-2fbb-41c2-a398-37c6f082e77f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:38.577096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2fb55faf-2fbb-41c2-a398-37c6f082e77f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152714 Mar 08 04:44:38.577671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1301/2553] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:38 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:39.276219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-33f2c020-fc60-48be-b088-2483cc24d53a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:39.276831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-33f2c020-fc60-48be-b088-2483cc24d53a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:39.283801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33f2c020-fc60-48be-b088-2483cc24d53a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:39.284253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33f2c020-fc60-48be-b088-2483cc24d53a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:39.285021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33f2c020-fc60-48be-b088-2483cc24d53a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:39.285466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33f2c020-fc60-48be-b088-2483cc24d53a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:39.356011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-33f2c020-fc60-48be-b088-2483cc24d53a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:39.363848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-33f2c020-fc60-48be-b088-2483cc24d53a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.091802 Mar 08 04:44:39.364404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1253/2554] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:39 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:39.593561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-236c4f27-204f-4426-9821-4624583990f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:39.594129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-236c4f27-204f-4426-9821-4624583990f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:39.600312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-236c4f27-204f-4426-9821-4624583990f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:39.600774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-236c4f27-204f-4426-9821-4624583990f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:39.601515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-236c4f27-204f-4426-9821-4624583990f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:39.601971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-236c4f27-204f-4426-9821-4624583990f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:39.733955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-236c4f27-204f-4426-9821-4624583990f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:39.741908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-236c4f27-204f-4426-9821-4624583990f2 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152287 Mar 08 04:44:39.742470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1302/2555] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:39 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:40.380490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a3244b3e-591c-43ca-b446-372cd3359f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:40.381093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a3244b3e-591c-43ca-b446-372cd3359f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:40.387343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3244b3e-591c-43ca-b446-372cd3359f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:40.387780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3244b3e-591c-43ca-b446-372cd3359f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:40.389242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3244b3e-591c-43ca-b446-372cd3359f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:40.389691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3244b3e-591c-43ca-b446-372cd3359f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:40.447046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a3244b3e-591c-43ca-b446-372cd3359f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:40.455475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a3244b3e-591c-43ca-b446-372cd3359f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078835 Mar 08 04:44:40.456033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1254/2556] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:40.759373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1a671c32-80eb-4e28-821b-a471f266c309 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:40.759990 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1a671c32-80eb-4e28-821b-a471f266c309 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:40.766408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a671c32-80eb-4e28-821b-a471f266c309 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:40.766865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a671c32-80eb-4e28-821b-a471f266c309 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:40.767636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a671c32-80eb-4e28-821b-a471f266c309 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:40.768076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1a671c32-80eb-4e28-821b-a471f266c309 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:40.899150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1a671c32-80eb-4e28-821b-a471f266c309 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:40.907763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1a671c32-80eb-4e28-821b-a471f266c309 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152276 Mar 08 04:44:40.908343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1303/2557] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:40 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:41.472788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-208be5f5-1a4c-4add-8ec6-6416ea4887cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:41.473397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-208be5f5-1a4c-4add-8ec6-6416ea4887cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:41.479716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-208be5f5-1a4c-4add-8ec6-6416ea4887cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:41.480161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-208be5f5-1a4c-4add-8ec6-6416ea4887cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:41.480918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-208be5f5-1a4c-4add-8ec6-6416ea4887cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:41.481357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-208be5f5-1a4c-4add-8ec6-6416ea4887cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:41.760371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-208be5f5-1a4c-4add-8ec6-6416ea4887cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:41.768154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-208be5f5-1a4c-4add-8ec6-6416ea4887cb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.299223 Mar 08 04:44:41.768725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1255/2558] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:41 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:41.925009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0d781f82-fbc6-4b0b-9afe-2765a3f0c477 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:41.925626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0d781f82-fbc6-4b0b-9afe-2765a3f0c477 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:41.931905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d781f82-fbc6-4b0b-9afe-2765a3f0c477 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:41.932357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d781f82-fbc6-4b0b-9afe-2765a3f0c477 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:41.933126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d781f82-fbc6-4b0b-9afe-2765a3f0c477 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:41.933594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d781f82-fbc6-4b0b-9afe-2765a3f0c477 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:42.059754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0d781f82-fbc6-4b0b-9afe-2765a3f0c477 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:42.067354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0d781f82-fbc6-4b0b-9afe-2765a3f0c477 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.146235 Mar 08 04:44:42.067919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1304/2559] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:41 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:42.785712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-582fb19e-62f0-44d1-8d62-b628287ef254 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:42.786322 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-582fb19e-62f0-44d1-8d62-b628287ef254 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:42.792586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-582fb19e-62f0-44d1-8d62-b628287ef254 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:42.793036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-582fb19e-62f0-44d1-8d62-b628287ef254 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:42.793825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-582fb19e-62f0-44d1-8d62-b628287ef254 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:42.794868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-582fb19e-62f0-44d1-8d62-b628287ef254 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:42.852852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-582fb19e-62f0-44d1-8d62-b628287ef254 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:42.861578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-582fb19e-62f0-44d1-8d62-b628287ef254 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079844 Mar 08 04:44:42.862156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1256/2560] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:42 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:43.084662 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-22c25f5b-3dea-4f24-9920-dfae3f1e5ef6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:43.085218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-22c25f5b-3dea-4f24-9920-dfae3f1e5ef6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:43.092164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-22c25f5b-3dea-4f24-9920-dfae3f1e5ef6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:43.092609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-22c25f5b-3dea-4f24-9920-dfae3f1e5ef6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:43.093368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-22c25f5b-3dea-4f24-9920-dfae3f1e5ef6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:43.093828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-22c25f5b-3dea-4f24-9920-dfae3f1e5ef6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:43.222620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-22c25f5b-3dea-4f24-9920-dfae3f1e5ef6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:43.230243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-22c25f5b-3dea-4f24-9920-dfae3f1e5ef6 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149455 Mar 08 04:44:43.230809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1305/2561] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:43 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:43.879033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-79cf7103-9481-4d31-9360-acc8ae475f50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:43.879643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-79cf7103-9481-4d31-9360-acc8ae475f50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:43.885924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-79cf7103-9481-4d31-9360-acc8ae475f50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:43.886377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-79cf7103-9481-4d31-9360-acc8ae475f50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:43.887133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-79cf7103-9481-4d31-9360-acc8ae475f50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:43.887569 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-79cf7103-9481-4d31-9360-acc8ae475f50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:43.945165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-79cf7103-9481-4d31-9360-acc8ae475f50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:43.955234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-79cf7103-9481-4d31-9360-acc8ae475f50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080053 Mar 08 04:44:43.955827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1257/2562] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:44.247771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9da4ed6f-ccb3-4fe3-88a9-aabdc72ee331 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:44.248414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9da4ed6f-ccb3-4fe3-88a9-aabdc72ee331 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:44.254650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9da4ed6f-ccb3-4fe3-88a9-aabdc72ee331 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:44.255093 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9da4ed6f-ccb3-4fe3-88a9-aabdc72ee331 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:44.255852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9da4ed6f-ccb3-4fe3-88a9-aabdc72ee331 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:44.256284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9da4ed6f-ccb3-4fe3-88a9-aabdc72ee331 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:44.386127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9da4ed6f-ccb3-4fe3-88a9-aabdc72ee331 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:44.394284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9da4ed6f-ccb3-4fe3-88a9-aabdc72ee331 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150896 Mar 08 04:44:44.394851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1306/2563] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:44 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:44.972864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-867608d0-684e-48e4-a4be-9b8fc1fd261c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:44.973511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-867608d0-684e-48e4-a4be-9b8fc1fd261c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:44.979947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-867608d0-684e-48e4-a4be-9b8fc1fd261c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:44.980432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-867608d0-684e-48e4-a4be-9b8fc1fd261c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:44.981229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-867608d0-684e-48e4-a4be-9b8fc1fd261c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:44.982492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-867608d0-684e-48e4-a4be-9b8fc1fd261c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:45.040633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-867608d0-684e-48e4-a4be-9b8fc1fd261c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:45.049280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-867608d0-684e-48e4-a4be-9b8fc1fd261c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080254 Mar 08 04:44:45.049879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1258/2564] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:45.411370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a00d8a1c-ac99-4d05-a470-77ae55d286ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:45.411986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a00d8a1c-ac99-4d05-a470-77ae55d286ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:45.418296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a00d8a1c-ac99-4d05-a470-77ae55d286ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:45.418752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a00d8a1c-ac99-4d05-a470-77ae55d286ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:45.420140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a00d8a1c-ac99-4d05-a470-77ae55d286ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:45.420598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a00d8a1c-ac99-4d05-a470-77ae55d286ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:45.552739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a00d8a1c-ac99-4d05-a470-77ae55d286ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:45.560595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a00d8a1c-ac99-4d05-a470-77ae55d286ef tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153006 Mar 08 04:44:45.561207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1307/2565] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:45 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:46.066021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f82174b3-d401-4ea4-9716-f11cd7e32fdc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:46.066658 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f82174b3-d401-4ea4-9716-f11cd7e32fdc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:46.072963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f82174b3-d401-4ea4-9716-f11cd7e32fdc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:46.073413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f82174b3-d401-4ea4-9716-f11cd7e32fdc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:46.074348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f82174b3-d401-4ea4-9716-f11cd7e32fdc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:46.074803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f82174b3-d401-4ea4-9716-f11cd7e32fdc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:46.134076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f82174b3-d401-4ea4-9716-f11cd7e32fdc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:46.142262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f82174b3-d401-4ea4-9716-f11cd7e32fdc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080089 Mar 08 04:44:46.142817 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1259/2566] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:46 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:46.578358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-82fd40ea-b033-495e-9208-03179780a7fb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:46.578971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-82fd40ea-b033-495e-9208-03179780a7fb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:46.585385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82fd40ea-b033-495e-9208-03179780a7fb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:46.585862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82fd40ea-b033-495e-9208-03179780a7fb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:46.586625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82fd40ea-b033-495e-9208-03179780a7fb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:46.587058 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82fd40ea-b033-495e-9208-03179780a7fb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:46.721342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-82fd40ea-b033-495e-9208-03179780a7fb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:46.729097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-82fd40ea-b033-495e-9208-03179780a7fb tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155406 Mar 08 04:44:46.729676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1308/2567] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:46 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:47.159478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-33138a02-2a62-4e38-9ebb-58b335951afa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:47.160035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-33138a02-2a62-4e38-9ebb-58b335951afa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:47.166262 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33138a02-2a62-4e38-9ebb-58b335951afa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:47.166748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33138a02-2a62-4e38-9ebb-58b335951afa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:47.167510 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33138a02-2a62-4e38-9ebb-58b335951afa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:47.167949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-33138a02-2a62-4e38-9ebb-58b335951afa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:47.225879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-33138a02-2a62-4e38-9ebb-58b335951afa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:47.233839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-33138a02-2a62-4e38-9ebb-58b335951afa tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078268 Mar 08 04:44:47.234397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1260/2568] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:47 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:47.746066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-98a1989a-9274-4c21-91c1-865a75fa58b7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:47.746639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-98a1989a-9274-4c21-91c1-865a75fa58b7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:47.753713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a1989a-9274-4c21-91c1-865a75fa58b7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:47.754168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a1989a-9274-4c21-91c1-865a75fa58b7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:47.754936 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a1989a-9274-4c21-91c1-865a75fa58b7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:47.755404 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a1989a-9274-4c21-91c1-865a75fa58b7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:47.887830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-98a1989a-9274-4c21-91c1-865a75fa58b7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:47.895507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-98a1989a-9274-4c21-91c1-865a75fa58b7 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153541 Mar 08 04:44:47.896077 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1309/2569] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:47 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:48.250602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ed1550d1-5367-4562-a88e-f7c556c06fd4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:48.251207 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ed1550d1-5367-4562-a88e-f7c556c06fd4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:48.257445 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed1550d1-5367-4562-a88e-f7c556c06fd4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:48.257919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed1550d1-5367-4562-a88e-f7c556c06fd4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:48.258676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed1550d1-5367-4562-a88e-f7c556c06fd4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:48.259107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed1550d1-5367-4562-a88e-f7c556c06fd4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:48.322357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ed1550d1-5367-4562-a88e-f7c556c06fd4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:48.330137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ed1550d1-5367-4562-a88e-f7c556c06fd4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083516 Mar 08 04:44:48.330686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1261/2570] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:48 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:48.913113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bf6a6a12-a34e-4e4c-8136-1b641d2cd0a1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:48.913752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bf6a6a12-a34e-4e4c-8136-1b641d2cd0a1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:48.920153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a12-a34e-4e4c-8136-1b641d2cd0a1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:48.920596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a12-a34e-4e4c-8136-1b641d2cd0a1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:48.921348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a12-a34e-4e4c-8136-1b641d2cd0a1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:48.921809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a12-a34e-4e4c-8136-1b641d2cd0a1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:49.049044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bf6a6a12-a34e-4e4c-8136-1b641d2cd0a1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:49.056660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bf6a6a12-a34e-4e4c-8136-1b641d2cd0a1 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.147373 Mar 08 04:44:49.057218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1310/2571] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:48 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:49.347213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d3da946c-cf9e-474b-84f4-16e9e268a83d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:49.347818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d3da946c-cf9e-474b-84f4-16e9e268a83d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:49.354121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3da946c-cf9e-474b-84f4-16e9e268a83d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:49.354568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3da946c-cf9e-474b-84f4-16e9e268a83d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:49.355318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3da946c-cf9e-474b-84f4-16e9e268a83d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:49.355746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3da946c-cf9e-474b-84f4-16e9e268a83d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:49.413447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d3da946c-cf9e-474b-84f4-16e9e268a83d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:49.421167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d3da946c-cf9e-474b-84f4-16e9e268a83d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077814 Mar 08 04:44:49.421739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1262/2572] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:49 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:50.073427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-19d55829-79a1-477c-a494-1a82f876064a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:50.074065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-19d55829-79a1-477c-a494-1a82f876064a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:50.081019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19d55829-79a1-477c-a494-1a82f876064a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:50.081470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19d55829-79a1-477c-a494-1a82f876064a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:50.082263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19d55829-79a1-477c-a494-1a82f876064a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:50.082722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19d55829-79a1-477c-a494-1a82f876064a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:50.232513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-19d55829-79a1-477c-a494-1a82f876064a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:50.240121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-19d55829-79a1-477c-a494-1a82f876064a tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.170528 Mar 08 04:44:50.240683 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1311/2573] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:50 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:50.438635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ce945a20-6806-4ee3-9122-24f0c51019fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:50.439178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ce945a20-6806-4ee3-9122-24f0c51019fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:50.445747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce945a20-6806-4ee3-9122-24f0c51019fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:50.446196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce945a20-6806-4ee3-9122-24f0c51019fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:50.446974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce945a20-6806-4ee3-9122-24f0c51019fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:50.447427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce945a20-6806-4ee3-9122-24f0c51019fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:50.510177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ce945a20-6806-4ee3-9122-24f0c51019fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:50.518431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ce945a20-6806-4ee3-9122-24f0c51019fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.084566 Mar 08 04:44:50.519021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1263/2574] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:50 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:51.257724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-be40aea3-3fb2-404f-bd7b-04213ff22b78 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:51.258334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-be40aea3-3fb2-404f-bd7b-04213ff22b78 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:51.265156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be40aea3-3fb2-404f-bd7b-04213ff22b78 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:51.265600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be40aea3-3fb2-404f-bd7b-04213ff22b78 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:51.266385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be40aea3-3fb2-404f-bd7b-04213ff22b78 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:51.266831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be40aea3-3fb2-404f-bd7b-04213ff22b78 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:51.395887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-be40aea3-3fb2-404f-bd7b-04213ff22b78 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:51.403725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-be40aea3-3fb2-404f-bd7b-04213ff22b78 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149927 Mar 08 04:44:51.404284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1312/2575] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:51 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:51.535246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6d8f01fc-951c-42a9-9590-2fa77d3bc9f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:51.535794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6d8f01fc-951c-42a9-9590-2fa77d3bc9f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:51.541956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d8f01fc-951c-42a9-9590-2fa77d3bc9f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:51.542403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d8f01fc-951c-42a9-9590-2fa77d3bc9f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:51.543151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d8f01fc-951c-42a9-9590-2fa77d3bc9f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:51.543579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6d8f01fc-951c-42a9-9590-2fa77d3bc9f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:51.604691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6d8f01fc-951c-42a9-9590-2fa77d3bc9f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:51.612943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6d8f01fc-951c-42a9-9590-2fa77d3bc9f2 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081578 Mar 08 04:44:51.613496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1264/2576] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:51 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:52.420666 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-454e9b5b-5198-44d2-a3fc-96f33ee9fc04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:52.421269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-454e9b5b-5198-44d2-a3fc-96f33ee9fc04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:52.428247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-454e9b5b-5198-44d2-a3fc-96f33ee9fc04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:52.428692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-454e9b5b-5198-44d2-a3fc-96f33ee9fc04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:52.429450 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-454e9b5b-5198-44d2-a3fc-96f33ee9fc04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:52.429926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-454e9b5b-5198-44d2-a3fc-96f33ee9fc04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:52.558504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-454e9b5b-5198-44d2-a3fc-96f33ee9fc04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:52.566470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-454e9b5b-5198-44d2-a3fc-96f33ee9fc04 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149782 Mar 08 04:44:52.567424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1313/2577] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:52 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:52.629298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bf806965-005f-4590-b893-318b49d26c39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:52.629927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bf806965-005f-4590-b893-318b49d26c39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:52.636081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf806965-005f-4590-b893-318b49d26c39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:52.636530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf806965-005f-4590-b893-318b49d26c39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:52.637288 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf806965-005f-4590-b893-318b49d26c39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:52.638272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf806965-005f-4590-b893-318b49d26c39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:52.696712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bf806965-005f-4590-b893-318b49d26c39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:52.704942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bf806965-005f-4590-b893-318b49d26c39 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079481 Mar 08 04:44:52.705501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1265/2578] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:52 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:53.582499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-72eaacce-f4f0-40f7-904d-5daa6410d6f9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:53.583134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-72eaacce-f4f0-40f7-904d-5daa6410d6f9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:53.589360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-72eaacce-f4f0-40f7-904d-5daa6410d6f9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:53.589842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-72eaacce-f4f0-40f7-904d-5daa6410d6f9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:53.591357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-72eaacce-f4f0-40f7-904d-5daa6410d6f9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:53.591759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-72eaacce-f4f0-40f7-904d-5daa6410d6f9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:53.721860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1d29a80b-e924-4328-8bf2-fb78eb215b0c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:53.722472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1d29a80b-e924-4328-8bf2-fb78eb215b0c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:53.724207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-72eaacce-f4f0-40f7-904d-5daa6410d6f9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:53.728695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d29a80b-e924-4328-8bf2-fb78eb215b0c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:53.729142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d29a80b-e924-4328-8bf2-fb78eb215b0c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:53.729940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d29a80b-e924-4328-8bf2-fb78eb215b0c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:53.730373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1d29a80b-e924-4328-8bf2-fb78eb215b0c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:53.731993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-72eaacce-f4f0-40f7-904d-5daa6410d6f9 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153336 Mar 08 04:44:53.732557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1314/2579] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:53 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:53.793430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1d29a80b-e924-4328-8bf2-fb78eb215b0c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:53.801310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1d29a80b-e924-4328-8bf2-fb78eb215b0c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083431 Mar 08 04:44:53.801889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1266/2580] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:53 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:54.748465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d5278e79-2979-47cd-b9a5-103d226ba82f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:54.749073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d5278e79-2979-47cd-b9a5-103d226ba82f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:54.755347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5278e79-2979-47cd-b9a5-103d226ba82f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:54.755795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5278e79-2979-47cd-b9a5-103d226ba82f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:54.756560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5278e79-2979-47cd-b9a5-103d226ba82f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:54.756998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d5278e79-2979-47cd-b9a5-103d226ba82f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:54.819820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0f24ee81-fb3d-4954-bed3-407c729dbb0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:54.821331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0f24ee81-fb3d-4954-bed3-407c729dbb0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:54.828092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f24ee81-fb3d-4954-bed3-407c729dbb0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:54.828627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f24ee81-fb3d-4954-bed3-407c729dbb0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:54.829635 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f24ee81-fb3d-4954-bed3-407c729dbb0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:54.830199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f24ee81-fb3d-4954-bed3-407c729dbb0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:54.897558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0f24ee81-fb3d-4954-bed3-407c729dbb0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:54.906047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0f24ee81-fb3d-4954-bed3-407c729dbb0f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.090801 Mar 08 04:44:54.906628 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1267/2581] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:54 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:54.921819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d5278e79-2979-47cd-b9a5-103d226ba82f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:54.929481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d5278e79-2979-47cd-b9a5-103d226ba82f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.185088 Mar 08 04:44:54.930068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1315/2582] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:54 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:55.923989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ba45cc8a-ce7e-464a-aa60-9f154267ac61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:55.924596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ba45cc8a-ce7e-464a-aa60-9f154267ac61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:55.930884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba45cc8a-ce7e-464a-aa60-9f154267ac61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:55.931330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba45cc8a-ce7e-464a-aa60-9f154267ac61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:55.932086 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba45cc8a-ce7e-464a-aa60-9f154267ac61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:55.932522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba45cc8a-ce7e-464a-aa60-9f154267ac61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:55.946313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f7676d18-c876-43a1-8faa-bc90b48586cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:55.946923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f7676d18-c876-43a1-8faa-bc90b48586cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:55.953263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7676d18-c876-43a1-8faa-bc90b48586cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:55.953731 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7676d18-c876-43a1-8faa-bc90b48586cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:55.954493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7676d18-c876-43a1-8faa-bc90b48586cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:55.954950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7676d18-c876-43a1-8faa-bc90b48586cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:55.997401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ba45cc8a-ce7e-464a-aa60-9f154267ac61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:56.005512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ba45cc8a-ce7e-464a-aa60-9f154267ac61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.085348 Mar 08 04:44:56.006114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1268/2583] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:55 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:56.095577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f7676d18-c876-43a1-8faa-bc90b48586cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:56.103362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f7676d18-c876-43a1-8faa-bc90b48586cc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.160863 Mar 08 04:44:56.103917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1316/2584] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:55 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:44:57.022741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d85aec6b-247f-489f-aea8-0c4979e6c89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:57.023335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d85aec6b-247f-489f-aea8-0c4979e6c89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:57.029646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d85aec6b-247f-489f-aea8-0c4979e6c89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:57.030125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d85aec6b-247f-489f-aea8-0c4979e6c89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:57.030886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d85aec6b-247f-489f-aea8-0c4979e6c89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:57.031325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d85aec6b-247f-489f-aea8-0c4979e6c89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:57.090224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d85aec6b-247f-489f-aea8-0c4979e6c89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:57.097912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d85aec6b-247f-489f-aea8-0c4979e6c89d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079250 Mar 08 04:44:57.098474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1269/2585] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:57 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:57.120236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2a7314dd-45b3-4235-8980-4978392c8bd8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:57.120774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2a7314dd-45b3-4235-8980-4978392c8bd8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:57.127531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a7314dd-45b3-4235-8980-4978392c8bd8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:57.127976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a7314dd-45b3-4235-8980-4978392c8bd8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:57.128728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a7314dd-45b3-4235-8980-4978392c8bd8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:57.129168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a7314dd-45b3-4235-8980-4978392c8bd8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:57.261584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2a7314dd-45b3-4235-8980-4978392c8bd8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:57.269325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2a7314dd-45b3-4235-8980-4978392c8bd8 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153001 Mar 08 04:44:57.269979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1317/2586] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:57 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:58.114890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ce1d90fb-b3f7-4c0a-9135-187100fdc00f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:58.115441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ce1d90fb-b3f7-4c0a-9135-187100fdc00f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:58.121585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce1d90fb-b3f7-4c0a-9135-187100fdc00f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:58.122061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce1d90fb-b3f7-4c0a-9135-187100fdc00f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:58.122879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce1d90fb-b3f7-4c0a-9135-187100fdc00f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:58.123311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce1d90fb-b3f7-4c0a-9135-187100fdc00f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:58.182539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ce1d90fb-b3f7-4c0a-9135-187100fdc00f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:58.190199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ce1d90fb-b3f7-4c0a-9135-187100fdc00f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079216 Mar 08 04:44:58.190746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1270/2587] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:58 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:58.286099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ffaa6ade-284b-4c82-ba41-c0f44c5717db tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:58.286710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ffaa6ade-284b-4c82-ba41-c0f44c5717db tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:58.292959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ffaa6ade-284b-4c82-ba41-c0f44c5717db tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:58.293407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ffaa6ade-284b-4c82-ba41-c0f44c5717db tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:58.294354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ffaa6ade-284b-4c82-ba41-c0f44c5717db tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:58.294791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ffaa6ade-284b-4c82-ba41-c0f44c5717db tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:58.422350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ffaa6ade-284b-4c82-ba41-c0f44c5717db tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:58.430016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ffaa6ade-284b-4c82-ba41-c0f44c5717db tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.147756 Mar 08 04:44:58.430573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1318/2588] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:58 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:59.207437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-20cfbef1-7cf9-4ca8-b7db-3d7917a2cbcd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:59.208041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-20cfbef1-7cf9-4ca8-b7db-3d7917a2cbcd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:59.216053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20cfbef1-7cf9-4ca8-b7db-3d7917a2cbcd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:59.216499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20cfbef1-7cf9-4ca8-b7db-3d7917a2cbcd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:59.217263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20cfbef1-7cf9-4ca8-b7db-3d7917a2cbcd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:59.217718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-20cfbef1-7cf9-4ca8-b7db-3d7917a2cbcd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:59.279700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-20cfbef1-7cf9-4ca8-b7db-3d7917a2cbcd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:59.287461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-20cfbef1-7cf9-4ca8-b7db-3d7917a2cbcd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.084081 Mar 08 04:44:59.288022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1271/2589] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:44:59.446691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-27baeed2-6251-4bef-9035-487c75e29830 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:44:59.447302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-27baeed2-6251-4bef-9035-487c75e29830 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:44:59.454865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27baeed2-6251-4bef-9035-487c75e29830 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:59.455172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27baeed2-6251-4bef-9035-487c75e29830 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:59.456359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27baeed2-6251-4bef-9035-487c75e29830 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:44:59.456808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27baeed2-6251-4bef-9035-487c75e29830 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:44:59.590094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-27baeed2-6251-4bef-9035-487c75e29830 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:44:59.598732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-27baeed2-6251-4bef-9035-487c75e29830 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.155892 Mar 08 04:44:59.599288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1319/2590] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:44:59 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:45:00.304823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7ed2c99b-85f0-428f-9e7e-552040b7fa2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:00.305461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7ed2c99b-85f0-428f-9e7e-552040b7fa2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:00.312498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ed2c99b-85f0-428f-9e7e-552040b7fa2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:00.312944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ed2c99b-85f0-428f-9e7e-552040b7fa2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:00.313728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ed2c99b-85f0-428f-9e7e-552040b7fa2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:00.314167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7ed2c99b-85f0-428f-9e7e-552040b7fa2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:00.374483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7ed2c99b-85f0-428f-9e7e-552040b7fa2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:00.382232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7ed2c99b-85f0-428f-9e7e-552040b7fa2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081322 Mar 08 04:45:00.382788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1272/2591] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:00.615777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d48d6f2e-15c7-4830-8e47-2b6e965e1f34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:00.616301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d48d6f2e-15c7-4830-8e47-2b6e965e1f34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:00.622627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d48d6f2e-15c7-4830-8e47-2b6e965e1f34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:00.623107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d48d6f2e-15c7-4830-8e47-2b6e965e1f34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:00.623874 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d48d6f2e-15c7-4830-8e47-2b6e965e1f34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:00.624315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d48d6f2e-15c7-4830-8e47-2b6e965e1f34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:00.754562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d48d6f2e-15c7-4830-8e47-2b6e965e1f34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:00.762284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d48d6f2e-15c7-4830-8e47-2b6e965e1f34 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150353 Mar 08 04:45:00.762837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1320/2592] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:00 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:01.399052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ab72ee68-59c9-4367-adcc-4b172140d53c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:01.399649 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ab72ee68-59c9-4367-adcc-4b172140d53c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:01.405887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab72ee68-59c9-4367-adcc-4b172140d53c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:01.406361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab72ee68-59c9-4367-adcc-4b172140d53c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:01.407119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab72ee68-59c9-4367-adcc-4b172140d53c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:01.407547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ab72ee68-59c9-4367-adcc-4b172140d53c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:01.464714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ab72ee68-59c9-4367-adcc-4b172140d53c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:01.472494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ab72ee68-59c9-4367-adcc-4b172140d53c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077562 Mar 08 04:45:01.473055 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1273/2593] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:01.779277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-35cd7db1-8b3c-4231-8f41-782cf532e62f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:01.779891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-35cd7db1-8b3c-4231-8f41-782cf532e62f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:01.786215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35cd7db1-8b3c-4231-8f41-782cf532e62f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:01.786661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35cd7db1-8b3c-4231-8f41-782cf532e62f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:01.787423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35cd7db1-8b3c-4231-8f41-782cf532e62f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:01.787860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-35cd7db1-8b3c-4231-8f41-782cf532e62f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:01.919759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-35cd7db1-8b3c-4231-8f41-782cf532e62f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:01.927461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-35cd7db1-8b3c-4231-8f41-782cf532e62f tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152128 Mar 08 04:45:01.928019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1321/2594] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:01 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:02.488264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c8894247-961b-47b4-bdc7-b3e60ed8a881 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:02.488908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c8894247-961b-47b4-bdc7-b3e60ed8a881 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:02.495124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8894247-961b-47b4-bdc7-b3e60ed8a881 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:02.495571 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8894247-961b-47b4-bdc7-b3e60ed8a881 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:02.496328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8894247-961b-47b4-bdc7-b3e60ed8a881 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:02.496918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8894247-961b-47b4-bdc7-b3e60ed8a881 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:02.555763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c8894247-961b-47b4-bdc7-b3e60ed8a881 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:02.564435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c8894247-961b-47b4-bdc7-b3e60ed8a881 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079970 Mar 08 04:45:02.565197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1274/2595] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:02.944574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6de87975-6f04-4944-b31d-9c7b33929632 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:02.945178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6de87975-6f04-4944-b31d-9c7b33929632 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:02.951463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6de87975-6f04-4944-b31d-9c7b33929632 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:02.951904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6de87975-6f04-4944-b31d-9c7b33929632 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:02.952659 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6de87975-6f04-4944-b31d-9c7b33929632 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:02.953088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6de87975-6f04-4944-b31d-9c7b33929632 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:03.085345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6de87975-6f04-4944-b31d-9c7b33929632 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:03.093420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6de87975-6f04-4944-b31d-9c7b33929632 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.152706 Mar 08 04:45:03.094015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1322/2596] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:02 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:03.581812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5f17801d-c6c0-4db9-b970-809cdb0bcb86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:03.582423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5f17801d-c6c0-4db9-b970-809cdb0bcb86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:03.588614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f17801d-c6c0-4db9-b970-809cdb0bcb86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:03.589071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f17801d-c6c0-4db9-b970-809cdb0bcb86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:03.589859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f17801d-c6c0-4db9-b970-809cdb0bcb86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:03.590807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f17801d-c6c0-4db9-b970-809cdb0bcb86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:03.649724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5f17801d-c6c0-4db9-b970-809cdb0bcb86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:03.657768 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5f17801d-c6c0-4db9-b970-809cdb0bcb86 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079817 Mar 08 04:45:03.658326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1275/2597] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:03 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:04.110972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5b04126e-2d98-4b85-9cd9-39a6e38b8885 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:04.111523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5b04126e-2d98-4b85-9cd9-39a6e38b8885 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:04.117732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b04126e-2d98-4b85-9cd9-39a6e38b8885 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:04.118176 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b04126e-2d98-4b85-9cd9-39a6e38b8885 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:04.118929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b04126e-2d98-4b85-9cd9-39a6e38b8885 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:04.119357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b04126e-2d98-4b85-9cd9-39a6e38b8885 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:04.252493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5b04126e-2d98-4b85-9cd9-39a6e38b8885 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:04.260189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5b04126e-2d98-4b85-9cd9-39a6e38b8885 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.153242 Mar 08 04:45:04.260750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1323/2598] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:04 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:04.674823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6711ff91-5700-4b57-8558-a80cf5277692 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:04.675460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6711ff91-5700-4b57-8558-a80cf5277692 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:04.681851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6711ff91-5700-4b57-8558-a80cf5277692 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:04.682299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6711ff91-5700-4b57-8558-a80cf5277692 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:04.683057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6711ff91-5700-4b57-8558-a80cf5277692 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:04.683487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6711ff91-5700-4b57-8558-a80cf5277692 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:04.740898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6711ff91-5700-4b57-8558-a80cf5277692 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:04.748588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6711ff91-5700-4b57-8558-a80cf5277692 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077619 Mar 08 04:45:04.749136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1276/2599] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:04 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:05.276742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ff37f955-76f9-486d-ab0e-0e01a6edecdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:05.277349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ff37f955-76f9-486d-ab0e-0e01a6edecdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:05.283934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff37f955-76f9-486d-ab0e-0e01a6edecdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:05.284378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff37f955-76f9-486d-ab0e-0e01a6edecdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:05.285134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff37f955-76f9-486d-ab0e-0e01a6edecdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:05.285566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ff37f955-76f9-486d-ab0e-0e01a6edecdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:05.414272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ff37f955-76f9-486d-ab0e-0e01a6edecdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:05.422632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ff37f955-76f9-486d-ab0e-0e01a6edecdc tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149749 Mar 08 04:45:05.423204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1324/2600] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:05 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:05.764234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-130c8a1d-d5b0-4547-a8ac-f53964a11ae5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:05.764838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-130c8a1d-d5b0-4547-a8ac-f53964a11ae5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:05.770826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-130c8a1d-d5b0-4547-a8ac-f53964a11ae5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:05.771272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-130c8a1d-d5b0-4547-a8ac-f53964a11ae5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:05.772309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-130c8a1d-d5b0-4547-a8ac-f53964a11ae5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:05.772735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-130c8a1d-d5b0-4547-a8ac-f53964a11ae5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:05.892376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-130c8a1d-d5b0-4547-a8ac-f53964a11ae5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:05.900726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-130c8a1d-d5b0-4547-a8ac-f53964a11ae5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.140330 Mar 08 04:45:05.901273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1277/2601] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:06.440019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-65854634-a957-408a-a91f-e58b83b9c461 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:06.440626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-65854634-a957-408a-a91f-e58b83b9c461 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:06.446894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65854634-a957-408a-a91f-e58b83b9c461 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:06.447344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65854634-a957-408a-a91f-e58b83b9c461 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:06.448107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65854634-a957-408a-a91f-e58b83b9c461 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:06.448545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-65854634-a957-408a-a91f-e58b83b9c461 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:06.588081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-65854634-a957-408a-a91f-e58b83b9c461 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:06.596310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-65854634-a957-408a-a91f-e58b83b9c461 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.160716 Mar 08 04:45:06.596871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1325/2602] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:06 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:06.917243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-91c9fd42-4c77-4209-a795-3d90122b0bad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:06.917877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-91c9fd42-4c77-4209-a795-3d90122b0bad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:06.924368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91c9fd42-4c77-4209-a795-3d90122b0bad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:06.924847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91c9fd42-4c77-4209-a795-3d90122b0bad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:06.925600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91c9fd42-4c77-4209-a795-3d90122b0bad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:06.926070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91c9fd42-4c77-4209-a795-3d90122b0bad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:06.984993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-91c9fd42-4c77-4209-a795-3d90122b0bad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:06.992643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-91c9fd42-4c77-4209-a795-3d90122b0bad tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079286 Mar 08 04:45:06.993211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1278/2603] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:07.612469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2c0ddaca-318b-489d-8cb4-a7e9f644f6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:07.612995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2c0ddaca-318b-489d-8cb4-a7e9f644f6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:07.619330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c0ddaca-318b-489d-8cb4-a7e9f644f6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:07.619774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c0ddaca-318b-489d-8cb4-a7e9f644f6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:07.620530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c0ddaca-318b-489d-8cb4-a7e9f644f6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:07.620967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c0ddaca-318b-489d-8cb4-a7e9f644f6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:07.751313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2c0ddaca-318b-489d-8cb4-a7e9f644f6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:07.758919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2c0ddaca-318b-489d-8cb4-a7e9f644f6a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.150358 Mar 08 04:45:07.759475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1326/2604] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:07 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:08.009914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c54ad7bd-d894-449a-8868-2464762a6200 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:08.010527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c54ad7bd-d894-449a-8868-2464762a6200 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:08.016970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c54ad7bd-d894-449a-8868-2464762a6200 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:08.017423 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c54ad7bd-d894-449a-8868-2464762a6200 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:08.018213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c54ad7bd-d894-449a-8868-2464762a6200 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:08.018655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c54ad7bd-d894-449a-8868-2464762a6200 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:08.082194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c54ad7bd-d894-449a-8868-2464762a6200 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:08.090552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c54ad7bd-d894-449a-8868-2464762a6200 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083975 Mar 08 04:45:08.091291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1279/2605] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:08 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:08.775939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8ccdbc86-8a69-401c-9d88-b130230395a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:08.776580 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8ccdbc86-8a69-401c-9d88-b130230395a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:08.783535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ccdbc86-8a69-401c-9d88-b130230395a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:08.783986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ccdbc86-8a69-401c-9d88-b130230395a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:08.784746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ccdbc86-8a69-401c-9d88-b130230395a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:08.785182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8ccdbc86-8a69-401c-9d88-b130230395a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:08.913389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8ccdbc86-8a69-401c-9d88-b130230395a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:08.921018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8ccdbc86-8a69-401c-9d88-b130230395a5 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.149248 Mar 08 04:45:08.921578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1327/2606] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:08 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:09.107141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d0fe4866-d1fe-4304-a6d8-f754d988b76a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:09.107688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d0fe4866-d1fe-4304-a6d8-f754d988b76a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:09.113997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d0fe4866-d1fe-4304-a6d8-f754d988b76a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:09.114448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d0fe4866-d1fe-4304-a6d8-f754d988b76a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:09.115206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d0fe4866-d1fe-4304-a6d8-f754d988b76a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:09.115646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d0fe4866-d1fe-4304-a6d8-f754d988b76a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:09.175268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d0fe4866-d1fe-4304-a6d8-f754d988b76a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:09.182965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d0fe4866-d1fe-4304-a6d8-f754d988b76a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079697 Mar 08 04:45:09.183514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1280/2607] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:09 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:09.937638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a90678a7-75fd-4900-ae77-7c4f2804b628 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:09.938263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a90678a7-75fd-4900-ae77-7c4f2804b628 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] [instance: 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:09.944523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a90678a7-75fd-4900-ae77-7c4f2804b628 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:09.944965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a90678a7-75fd-4900-ae77-7c4f2804b628 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:09.945742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a90678a7-75fd-4900-ae77-7c4f2804b628 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:09.946177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a90678a7-75fd-4900-ae77-7c4f2804b628 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:10.079688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a90678a7-75fd-4900-ae77-7c4f2804b628 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab40b003f9475982a8e0afe7226d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd987f379b42346f8bab2101aa92d9fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:10.087377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a90678a7-75fd-4900-ae77-7c4f2804b628 tempest-VolumesSnapshotTestJSON-1051677920 tempest-VolumesSnapshotTestJSON-1051677920-project] 10.222.0.30 "GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef" status: 200 len: 1559 microversion: 2.1 time: 0.154317 Mar 08 04:45:10.087932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1328/2608] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:09 2022] GET /compute/v2.1/servers/08d0c157-7b91-4fe9-aa50-c33e2e1f18ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:10.199475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0da4153b-52d8-41b3-9c16-62cbe5a57797 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:10.200152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0da4153b-52d8-41b3-9c16-62cbe5a57797 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:10.206733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0da4153b-52d8-41b3-9c16-62cbe5a57797 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:10.207186 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0da4153b-52d8-41b3-9c16-62cbe5a57797 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:10.207964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0da4153b-52d8-41b3-9c16-62cbe5a57797 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:10.208401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0da4153b-52d8-41b3-9c16-62cbe5a57797 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:10.267598 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0da4153b-52d8-41b3-9c16-62cbe5a57797 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:10.275485 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0da4153b-52d8-41b3-9c16-62cbe5a57797 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079919 Mar 08 04:45:10.276044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1281/2609] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:10 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:45:11.292612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3a50cd4f-923a-4d9b-a853-7caafad090a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:11.293365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3a50cd4f-923a-4d9b-a853-7caafad090a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:11.299464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a50cd4f-923a-4d9b-a853-7caafad090a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:11.299907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a50cd4f-923a-4d9b-a853-7caafad090a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:11.300667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a50cd4f-923a-4d9b-a853-7caafad090a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:11.301100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3a50cd4f-923a-4d9b-a853-7caafad090a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:11.359183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3a50cd4f-923a-4d9b-a853-7caafad090a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:11.366805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3a50cd4f-923a-4d9b-a853-7caafad090a1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078064 Mar 08 04:45:11.367369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1329/2610] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:12.384311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b8c47f39-3dd9-4a87-87d6-813bded1c319 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:12.384913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b8c47f39-3dd9-4a87-87d6-813bded1c319 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:12.391928 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8c47f39-3dd9-4a87-87d6-813bded1c319 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:12.392372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8c47f39-3dd9-4a87-87d6-813bded1c319 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:12.393128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8c47f39-3dd9-4a87-87d6-813bded1c319 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:12.393558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b8c47f39-3dd9-4a87-87d6-813bded1c319 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:12.452592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b8c47f39-3dd9-4a87-87d6-813bded1c319 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:12.460339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b8c47f39-3dd9-4a87-87d6-813bded1c319 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079808 Mar 08 04:45:12.460933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1282/2611] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:13.476951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4a601be0-d774-4416-ba6d-acf3b4172408 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:13.477567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4a601be0-d774-4416-ba6d-acf3b4172408 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:13.483957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a601be0-d774-4416-ba6d-acf3b4172408 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:13.484411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a601be0-d774-4416-ba6d-acf3b4172408 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:13.485178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a601be0-d774-4416-ba6d-acf3b4172408 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:13.485618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a601be0-d774-4416-ba6d-acf3b4172408 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:13.546440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4a601be0-d774-4416-ba6d-acf3b4172408 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:13.554139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4a601be0-d774-4416-ba6d-acf3b4172408 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081054 Mar 08 04:45:13.554709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1330/2612] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:13 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:14.571381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2effe5c8-2bac-4766-bec2-c2f705abdb50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:14.571967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2effe5c8-2bac-4766-bec2-c2f705abdb50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:14.578642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2effe5c8-2bac-4766-bec2-c2f705abdb50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:14.579100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2effe5c8-2bac-4766-bec2-c2f705abdb50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:14.579867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2effe5c8-2bac-4766-bec2-c2f705abdb50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:14.580339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2effe5c8-2bac-4766-bec2-c2f705abdb50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:14.641015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2effe5c8-2bac-4766-bec2-c2f705abdb50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:14.648991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2effe5c8-2bac-4766-bec2-c2f705abdb50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081481 Mar 08 04:45:14.649545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1283/2613] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:15.665535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fc7ce085-d923-439b-8a09-26d234c08087 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:15.666152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fc7ce085-d923-439b-8a09-26d234c08087 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:15.672496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc7ce085-d923-439b-8a09-26d234c08087 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:15.672937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc7ce085-d923-439b-8a09-26d234c08087 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:15.673745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc7ce085-d923-439b-8a09-26d234c08087 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:15.674180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc7ce085-d923-439b-8a09-26d234c08087 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:15.732894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fc7ce085-d923-439b-8a09-26d234c08087 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:15.740546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fc7ce085-d923-439b-8a09-26d234c08087 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078843 Mar 08 04:45:15.741108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1331/2614] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:15 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:16.757971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c415eef2-3510-4286-be82-91866e6bd90b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:16.758580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c415eef2-3510-4286-be82-91866e6bd90b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:16.765622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c415eef2-3510-4286-be82-91866e6bd90b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:16.766087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c415eef2-3510-4286-be82-91866e6bd90b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:16.766841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c415eef2-3510-4286-be82-91866e6bd90b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:16.767271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c415eef2-3510-4286-be82-91866e6bd90b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:16.827056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c415eef2-3510-4286-be82-91866e6bd90b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:16.834815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c415eef2-3510-4286-be82-91866e6bd90b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080785 Mar 08 04:45:16.835374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1284/2615] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:16 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:17.852316 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a212399e-75fd-424f-9a8f-fde05be6dac1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:17.852852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a212399e-75fd-424f-9a8f-fde05be6dac1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:17.859435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a212399e-75fd-424f-9a8f-fde05be6dac1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:17.859875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a212399e-75fd-424f-9a8f-fde05be6dac1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:17.860634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a212399e-75fd-424f-9a8f-fde05be6dac1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:17.861153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a212399e-75fd-424f-9a8f-fde05be6dac1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:17.919503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a212399e-75fd-424f-9a8f-fde05be6dac1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:17.927032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a212399e-75fd-424f-9a8f-fde05be6dac1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078799 Mar 08 04:45:17.927584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1332/2616] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:18.943498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c44937ce-ec41-45ae-9fa9-d42710aea5cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:18.944101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c44937ce-ec41-45ae-9fa9-d42710aea5cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:18.951254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c44937ce-ec41-45ae-9fa9-d42710aea5cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:18.951638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c44937ce-ec41-45ae-9fa9-d42710aea5cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:18.952399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c44937ce-ec41-45ae-9fa9-d42710aea5cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:18.952829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c44937ce-ec41-45ae-9fa9-d42710aea5cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:19.009780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c44937ce-ec41-45ae-9fa9-d42710aea5cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:19.017980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c44937ce-ec41-45ae-9fa9-d42710aea5cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078292 Mar 08 04:45:19.018560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1285/2617] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:18 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:20.035635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ccbd25ec-62ca-43f1-872d-075475535f10 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:20.036264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ccbd25ec-62ca-43f1-872d-075475535f10 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:20.042415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ccbd25ec-62ca-43f1-872d-075475535f10 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:20.043688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ccbd25ec-62ca-43f1-872d-075475535f10 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:20.044477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ccbd25ec-62ca-43f1-872d-075475535f10 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:20.044916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ccbd25ec-62ca-43f1-872d-075475535f10 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:20.107905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ccbd25ec-62ca-43f1-872d-075475535f10 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:20.117129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ccbd25ec-62ca-43f1-872d-075475535f10 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.085345 Mar 08 04:45:20.117716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1333/2618] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:21.134049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bb106ad5-d209-4a30-a7ad-aa41e5aa27a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:21.134631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bb106ad5-d209-4a30-a7ad-aa41e5aa27a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:21.141498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb106ad5-d209-4a30-a7ad-aa41e5aa27a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:21.141979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb106ad5-d209-4a30-a7ad-aa41e5aa27a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:21.142744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb106ad5-d209-4a30-a7ad-aa41e5aa27a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:21.143178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb106ad5-d209-4a30-a7ad-aa41e5aa27a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:21.203857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bb106ad5-d209-4a30-a7ad-aa41e5aa27a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:21.211525 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bb106ad5-d209-4a30-a7ad-aa41e5aa27a4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081469 Mar 08 04:45:21.212081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1286/2619] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:21 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:22.228273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2feda9a8-a3a8-4761-9e9b-0bcec51284fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:22.228905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2feda9a8-a3a8-4761-9e9b-0bcec51284fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:22.237829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2feda9a8-a3a8-4761-9e9b-0bcec51284fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:22.238282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2feda9a8-a3a8-4761-9e9b-0bcec51284fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:22.239078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2feda9a8-a3a8-4761-9e9b-0bcec51284fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:22.239504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2feda9a8-a3a8-4761-9e9b-0bcec51284fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:22.299825 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2feda9a8-a3a8-4761-9e9b-0bcec51284fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:22.307435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2feda9a8-a3a8-4761-9e9b-0bcec51284fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083205 Mar 08 04:45:22.307995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1334/2620] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:23.324850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-75be44c6-c321-46af-a388-8cbab9ca5d45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:23.325456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-75be44c6-c321-46af-a388-8cbab9ca5d45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:23.331881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75be44c6-c321-46af-a388-8cbab9ca5d45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:23.332331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75be44c6-c321-46af-a388-8cbab9ca5d45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:23.333104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75be44c6-c321-46af-a388-8cbab9ca5d45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:23.333538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-75be44c6-c321-46af-a388-8cbab9ca5d45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:23.393394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-75be44c6-c321-46af-a388-8cbab9ca5d45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:23.401441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-75be44c6-c321-46af-a388-8cbab9ca5d45 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080987 Mar 08 04:45:23.402047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1287/2621] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:24.418699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-82208322-c5b2-4f47-8c38-0c554c9cee6c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:24.419315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-82208322-c5b2-4f47-8c38-0c554c9cee6c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:24.425590 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82208322-c5b2-4f47-8c38-0c554c9cee6c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:24.426076 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82208322-c5b2-4f47-8c38-0c554c9cee6c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:24.426842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82208322-c5b2-4f47-8c38-0c554c9cee6c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:24.427282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-82208322-c5b2-4f47-8c38-0c554c9cee6c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:24.486751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-82208322-c5b2-4f47-8c38-0c554c9cee6c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:24.494372 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-82208322-c5b2-4f47-8c38-0c554c9cee6c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080095 Mar 08 04:45:24.494939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1335/2622] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:25.510814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d84ca380-10da-4ba4-9e5c-2f8ee3d50ca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:25.512604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d84ca380-10da-4ba4-9e5c-2f8ee3d50ca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:25.519246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d84ca380-10da-4ba4-9e5c-2f8ee3d50ca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:25.519704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d84ca380-10da-4ba4-9e5c-2f8ee3d50ca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:25.520466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d84ca380-10da-4ba4-9e5c-2f8ee3d50ca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:25.520904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d84ca380-10da-4ba4-9e5c-2f8ee3d50ca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:25.579733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d84ca380-10da-4ba4-9e5c-2f8ee3d50ca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:25.587483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d84ca380-10da-4ba4-9e5c-2f8ee3d50ca7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080261 Mar 08 04:45:25.588060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1288/2623] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:26.604511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e6ea27bb-2a63-4abc-9787-09a3f052e134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:26.607338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e6ea27bb-2a63-4abc-9787-09a3f052e134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:26.613551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6ea27bb-2a63-4abc-9787-09a3f052e134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:26.614007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6ea27bb-2a63-4abc-9787-09a3f052e134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:26.614768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6ea27bb-2a63-4abc-9787-09a3f052e134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:26.615200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6ea27bb-2a63-4abc-9787-09a3f052e134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:26.678254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e6ea27bb-2a63-4abc-9787-09a3f052e134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:26.686759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e6ea27bb-2a63-4abc-9787-09a3f052e134 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.086047 Mar 08 04:45:26.687318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1336/2624] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:26 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:27.703948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1311ec93-a146-4a70-8461-2e6a670d418a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:27.704551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1311ec93-a146-4a70-8461-2e6a670d418a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:27.710843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1311ec93-a146-4a70-8461-2e6a670d418a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:27.711289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1311ec93-a146-4a70-8461-2e6a670d418a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:27.712035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1311ec93-a146-4a70-8461-2e6a670d418a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:27.712464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1311ec93-a146-4a70-8461-2e6a670d418a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:27.771136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1311ec93-a146-4a70-8461-2e6a670d418a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:27.779244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1311ec93-a146-4a70-8461-2e6a670d418a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079111 Mar 08 04:45:27.779968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1289/2625] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:27 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:28.796054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6a6b2689-0eb5-40fc-b2f8-d7fbef6376b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:28.796666 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6a6b2689-0eb5-40fc-b2f8-d7fbef6376b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:28.803047 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a6b2689-0eb5-40fc-b2f8-d7fbef6376b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:28.803512 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a6b2689-0eb5-40fc-b2f8-d7fbef6376b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:28.804284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a6b2689-0eb5-40fc-b2f8-d7fbef6376b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:28.804726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a6b2689-0eb5-40fc-b2f8-d7fbef6376b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:28.863738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6a6b2689-0eb5-40fc-b2f8-d7fbef6376b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:28.871745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6a6b2689-0eb5-40fc-b2f8-d7fbef6376b5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079847 Mar 08 04:45:28.872313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1337/2626] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:28 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:29.889490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9ec1e519-5b95-4fd5-8f1d-c3ba0f618c9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:29.890130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9ec1e519-5b95-4fd5-8f1d-c3ba0f618c9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:29.896335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9ec1e519-5b95-4fd5-8f1d-c3ba0f618c9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:29.897046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9ec1e519-5b95-4fd5-8f1d-c3ba0f618c9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:29.897840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9ec1e519-5b95-4fd5-8f1d-c3ba0f618c9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:29.898280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9ec1e519-5b95-4fd5-8f1d-c3ba0f618c9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:29.956246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9ec1e519-5b95-4fd5-8f1d-c3ba0f618c9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:29.963912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9ec1e519-5b95-4fd5-8f1d-c3ba0f618c9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079433 Mar 08 04:45:29.965272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1290/2627] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:30.980299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8bd9dedc-b77a-46a3-a266-e3754d87a15e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:30.980897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8bd9dedc-b77a-46a3-a266-e3754d87a15e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:30.987151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8bd9dedc-b77a-46a3-a266-e3754d87a15e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:30.987598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8bd9dedc-b77a-46a3-a266-e3754d87a15e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:30.988358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8bd9dedc-b77a-46a3-a266-e3754d87a15e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:30.988795 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8bd9dedc-b77a-46a3-a266-e3754d87a15e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:31.047102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8bd9dedc-b77a-46a3-a266-e3754d87a15e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:31.054629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8bd9dedc-b77a-46a3-a266-e3754d87a15e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078202 Mar 08 04:45:31.055186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1338/2628] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:32.071517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f63e4058-58f5-4bca-8656-843f79850b05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:32.072125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f63e4058-58f5-4bca-8656-843f79850b05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:32.078353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f63e4058-58f5-4bca-8656-843f79850b05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:32.078802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f63e4058-58f5-4bca-8656-843f79850b05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:32.079565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f63e4058-58f5-4bca-8656-843f79850b05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:32.080002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f63e4058-58f5-4bca-8656-843f79850b05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:32.139020 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f63e4058-58f5-4bca-8656-843f79850b05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:32.147012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f63e4058-58f5-4bca-8656-843f79850b05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079186 Mar 08 04:45:32.147579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1291/2629] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:32 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:33.164812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e759b6fd-37fb-4362-9ad6-5b07bbb38823 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:33.165430 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e759b6fd-37fb-4362-9ad6-5b07bbb38823 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:33.172322 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e759b6fd-37fb-4362-9ad6-5b07bbb38823 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:33.172767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e759b6fd-37fb-4362-9ad6-5b07bbb38823 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:33.173536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e759b6fd-37fb-4362-9ad6-5b07bbb38823 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:33.173999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e759b6fd-37fb-4362-9ad6-5b07bbb38823 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:33.236244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e759b6fd-37fb-4362-9ad6-5b07bbb38823 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:33.243952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e759b6fd-37fb-4362-9ad6-5b07bbb38823 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082993 Mar 08 04:45:33.244517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1339/2630] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:34.261774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0c3c5cf8-4cbf-429e-b75b-931b60503dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:34.262381 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0c3c5cf8-4cbf-429e-b75b-931b60503dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:34.268774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c3c5cf8-4cbf-429e-b75b-931b60503dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:34.269218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c3c5cf8-4cbf-429e-b75b-931b60503dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:34.270004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c3c5cf8-4cbf-429e-b75b-931b60503dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:34.270442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0c3c5cf8-4cbf-429e-b75b-931b60503dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:34.331668 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0c3c5cf8-4cbf-429e-b75b-931b60503dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:34.339280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0c3c5cf8-4cbf-429e-b75b-931b60503dc8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081910 Mar 08 04:45:34.339836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1292/2631] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:35.355815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f78106da-efc6-4324-947f-3cf9d4c2ccba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:35.357023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f78106da-efc6-4324-947f-3cf9d4c2ccba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:35.363318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f78106da-efc6-4324-947f-3cf9d4c2ccba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:35.363768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f78106da-efc6-4324-947f-3cf9d4c2ccba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:35.364526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f78106da-efc6-4324-947f-3cf9d4c2ccba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:35.364966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f78106da-efc6-4324-947f-3cf9d4c2ccba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:35.423445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f78106da-efc6-4324-947f-3cf9d4c2ccba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:35.431054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f78106da-efc6-4324-947f-3cf9d4c2ccba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079101 Mar 08 04:45:35.431620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1340/2632] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:35 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:36.447752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dc5cc403-9ddb-446a-9e83-8a9b4a5958a6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:36.448333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dc5cc403-9ddb-446a-9e83-8a9b4a5958a6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:36.454425 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc5cc403-9ddb-446a-9e83-8a9b4a5958a6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:36.454865 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc5cc403-9ddb-446a-9e83-8a9b4a5958a6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:36.455616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc5cc403-9ddb-446a-9e83-8a9b4a5958a6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:36.456050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc5cc403-9ddb-446a-9e83-8a9b4a5958a6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:36.513401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dc5cc403-9ddb-446a-9e83-8a9b4a5958a6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:36.521050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dc5cc403-9ddb-446a-9e83-8a9b4a5958a6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077170 Mar 08 04:45:36.521879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1293/2633] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:36 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:37.537571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f1610348-58aa-4489-829b-93f43cc68a1f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:37.538220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f1610348-58aa-4489-829b-93f43cc68a1f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:37.544844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1610348-58aa-4489-829b-93f43cc68a1f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:37.545295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1610348-58aa-4489-829b-93f43cc68a1f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:37.546094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1610348-58aa-4489-829b-93f43cc68a1f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:37.546532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1610348-58aa-4489-829b-93f43cc68a1f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:37.606991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f1610348-58aa-4489-829b-93f43cc68a1f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:37.614804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f1610348-58aa-4489-829b-93f43cc68a1f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081026 Mar 08 04:45:37.615807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1341/2634] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:37 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:38.632317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a2a5c726-b5d6-49d0-89d1-2858a6b93dc7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:38.632913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a2a5c726-b5d6-49d0-89d1-2858a6b93dc7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:38.639443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2a5c726-b5d6-49d0-89d1-2858a6b93dc7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:38.639887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2a5c726-b5d6-49d0-89d1-2858a6b93dc7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:38.640642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2a5c726-b5d6-49d0-89d1-2858a6b93dc7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:38.641074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2a5c726-b5d6-49d0-89d1-2858a6b93dc7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:38.699426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a2a5c726-b5d6-49d0-89d1-2858a6b93dc7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:38.707166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a2a5c726-b5d6-49d0-89d1-2858a6b93dc7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078777 Mar 08 04:45:38.707720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1294/2635] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:38 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:39.723751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3fd453b1-dd3e-4e0f-b095-e60b2f092e99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:39.724436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3fd453b1-dd3e-4e0f-b095-e60b2f092e99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:39.730685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3fd453b1-dd3e-4e0f-b095-e60b2f092e99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:39.731769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3fd453b1-dd3e-4e0f-b095-e60b2f092e99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:39.732627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3fd453b1-dd3e-4e0f-b095-e60b2f092e99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:39.733063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3fd453b1-dd3e-4e0f-b095-e60b2f092e99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:39.795289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3fd453b1-dd3e-4e0f-b095-e60b2f092e99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:39.806097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3fd453b1-dd3e-4e0f-b095-e60b2f092e99 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.086174 Mar 08 04:45:39.806672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1342/2636] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:39 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:40.822958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5a02ff14-c733-4184-8d69-90b37a0e342f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:40.823551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5a02ff14-c733-4184-8d69-90b37a0e342f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:40.829895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a02ff14-c733-4184-8d69-90b37a0e342f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:40.830352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a02ff14-c733-4184-8d69-90b37a0e342f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:40.831121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a02ff14-c733-4184-8d69-90b37a0e342f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:40.831561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a02ff14-c733-4184-8d69-90b37a0e342f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:40.890284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5a02ff14-c733-4184-8d69-90b37a0e342f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:40.898239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5a02ff14-c733-4184-8d69-90b37a0e342f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079157 Mar 08 04:45:40.898786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1295/2637] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:41.914518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c7e349cf-eb59-4225-a6b1-91f1dc135633 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:41.915124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c7e349cf-eb59-4225-a6b1-91f1dc135633 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:41.921325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c7e349cf-eb59-4225-a6b1-91f1dc135633 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:41.921793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c7e349cf-eb59-4225-a6b1-91f1dc135633 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:41.922547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c7e349cf-eb59-4225-a6b1-91f1dc135633 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:41.922980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c7e349cf-eb59-4225-a6b1-91f1dc135633 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:41.982141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c7e349cf-eb59-4225-a6b1-91f1dc135633 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:41.990908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c7e349cf-eb59-4225-a6b1-91f1dc135633 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080282 Mar 08 04:45:41.991470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1343/2638] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:41 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:43.007807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ffddbfe2-aeab-4b0f-a2f2-d906a0d748fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:43.008407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ffddbfe2-aeab-4b0f-a2f2-d906a0d748fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:43.015380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ffddbfe2-aeab-4b0f-a2f2-d906a0d748fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:43.015824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ffddbfe2-aeab-4b0f-a2f2-d906a0d748fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:43.016572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ffddbfe2-aeab-4b0f-a2f2-d906a0d748fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:43.017002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ffddbfe2-aeab-4b0f-a2f2-d906a0d748fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:43.075266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ffddbfe2-aeab-4b0f-a2f2-d906a0d748fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:43.082897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ffddbfe2-aeab-4b0f-a2f2-d906a0d748fd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078986 Mar 08 04:45:43.083452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1296/2639] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:44.100360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ee26ce11-5356-4919-a5b6-6f3b6d0ab63d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:44.100967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ee26ce11-5356-4919-a5b6-6f3b6d0ab63d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:44.107968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee26ce11-5356-4919-a5b6-6f3b6d0ab63d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:44.108394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee26ce11-5356-4919-a5b6-6f3b6d0ab63d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:44.109169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee26ce11-5356-4919-a5b6-6f3b6d0ab63d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:44.109616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ee26ce11-5356-4919-a5b6-6f3b6d0ab63d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:44.167569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ee26ce11-5356-4919-a5b6-6f3b6d0ab63d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:44.175893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ee26ce11-5356-4919-a5b6-6f3b6d0ab63d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079412 Mar 08 04:45:44.176452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1344/2640] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:45.192372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6187bd5d-3a04-4e24-9c3a-f6812505cb82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:45.193002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6187bd5d-3a04-4e24-9c3a-f6812505cb82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:45.199244 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6187bd5d-3a04-4e24-9c3a-f6812505cb82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:45.200309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6187bd5d-3a04-4e24-9c3a-f6812505cb82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:45.201214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6187bd5d-3a04-4e24-9c3a-f6812505cb82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:45.201642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6187bd5d-3a04-4e24-9c3a-f6812505cb82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:45.259045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6187bd5d-3a04-4e24-9c3a-f6812505cb82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:45.267127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6187bd5d-3a04-4e24-9c3a-f6812505cb82 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078688 Mar 08 04:45:45.267677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1297/2641] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:45 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:45:46.284419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-46facb31-a464-4c32-aa7f-f919339c8a36 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:46.285030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-46facb31-a464-4c32-aa7f-f919339c8a36 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:46.291337 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46facb31-a464-4c32-aa7f-f919339c8a36 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:46.291783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46facb31-a464-4c32-aa7f-f919339c8a36 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:46.292549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46facb31-a464-4c32-aa7f-f919339c8a36 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:46.292990 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-46facb31-a464-4c32-aa7f-f919339c8a36 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:46.355650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-46facb31-a464-4c32-aa7f-f919339c8a36 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:46.363351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-46facb31-a464-4c32-aa7f-f919339c8a36 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082815 Mar 08 04:45:46.363909 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1345/2642] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:46 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:47.380462 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ec2596e8-b111-410c-8b32-dc0eb6201349 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:47.381066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ec2596e8-b111-410c-8b32-dc0eb6201349 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:47.387553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec2596e8-b111-410c-8b32-dc0eb6201349 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:47.387996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec2596e8-b111-410c-8b32-dc0eb6201349 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:47.388749 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec2596e8-b111-410c-8b32-dc0eb6201349 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:47.389179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec2596e8-b111-410c-8b32-dc0eb6201349 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:47.447354 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ec2596e8-b111-410c-8b32-dc0eb6201349 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:47.455130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ec2596e8-b111-410c-8b32-dc0eb6201349 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078478 Mar 08 04:45:47.455691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1298/2643] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:47 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:48.471900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-64d5f3e4-a713-49ac-9f58-58c153de8cba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:48.472512 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-64d5f3e4-a713-49ac-9f58-58c153de8cba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:48.478528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64d5f3e4-a713-49ac-9f58-58c153de8cba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:48.478983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64d5f3e4-a713-49ac-9f58-58c153de8cba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:48.479749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64d5f3e4-a713-49ac-9f58-58c153de8cba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:48.480193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-64d5f3e4-a713-49ac-9f58-58c153de8cba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:48.538630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-64d5f3e4-a713-49ac-9f58-58c153de8cba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:48.546502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-64d5f3e4-a713-49ac-9f58-58c153de8cba tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078470 Mar 08 04:45:48.547060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1346/2644] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:48 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:49.563818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6625287f-a8dd-4fed-960a-34bc16b3ceca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:49.564428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6625287f-a8dd-4fed-960a-34bc16b3ceca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:49.570727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6625287f-a8dd-4fed-960a-34bc16b3ceca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:49.571169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6625287f-a8dd-4fed-960a-34bc16b3ceca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:49.571921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6625287f-a8dd-4fed-960a-34bc16b3ceca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:49.572362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6625287f-a8dd-4fed-960a-34bc16b3ceca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:49.632457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6625287f-a8dd-4fed-960a-34bc16b3ceca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:49.640534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6625287f-a8dd-4fed-960a-34bc16b3ceca tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080649 Mar 08 04:45:49.641093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1299/2645] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:49 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:50.657160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e2a08c83-b185-4e6d-8edf-77650b04f3b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:50.657782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e2a08c83-b185-4e6d-8edf-77650b04f3b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:50.664009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2a08c83-b185-4e6d-8edf-77650b04f3b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:50.664458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2a08c83-b185-4e6d-8edf-77650b04f3b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:50.665224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2a08c83-b185-4e6d-8edf-77650b04f3b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:50.665677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e2a08c83-b185-4e6d-8edf-77650b04f3b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:50.725111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e2a08c83-b185-4e6d-8edf-77650b04f3b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:50.732844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e2a08c83-b185-4e6d-8edf-77650b04f3b3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079672 Mar 08 04:45:50.733408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1347/2646] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:50 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:51.750132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-af9e890f-0825-4b9e-b60d-4e497aa46320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:51.750693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-af9e890f-0825-4b9e-b60d-4e497aa46320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:51.756839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-af9e890f-0825-4b9e-b60d-4e497aa46320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:51.757287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-af9e890f-0825-4b9e-b60d-4e497aa46320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:51.758081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-af9e890f-0825-4b9e-b60d-4e497aa46320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:51.758519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-af9e890f-0825-4b9e-b60d-4e497aa46320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:51.818805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-af9e890f-0825-4b9e-b60d-4e497aa46320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:51.826807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-af9e890f-0825-4b9e-b60d-4e497aa46320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081183 Mar 08 04:45:51.827358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1300/2647] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:51 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:52.843546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ad6124cf-63dd-4e98-8efe-c90de3759320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:52.844180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ad6124cf-63dd-4e98-8efe-c90de3759320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:52.850443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad6124cf-63dd-4e98-8efe-c90de3759320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:52.850890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad6124cf-63dd-4e98-8efe-c90de3759320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:52.851642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad6124cf-63dd-4e98-8efe-c90de3759320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:52.852104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad6124cf-63dd-4e98-8efe-c90de3759320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:52.916128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ad6124cf-63dd-4e98-8efe-c90de3759320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:52.924343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ad6124cf-63dd-4e98-8efe-c90de3759320 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.084800 Mar 08 04:45:52.924910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1348/2648] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:52 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:53.941398 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2efba5a4-174d-4004-8e6c-dc8a530adfe3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:53.942023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2efba5a4-174d-4004-8e6c-dc8a530adfe3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:53.948234 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2efba5a4-174d-4004-8e6c-dc8a530adfe3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:53.948674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2efba5a4-174d-4004-8e6c-dc8a530adfe3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:53.950362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2efba5a4-174d-4004-8e6c-dc8a530adfe3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:53.950801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2efba5a4-174d-4004-8e6c-dc8a530adfe3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:54.009084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2efba5a4-174d-4004-8e6c-dc8a530adfe3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:54.017676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2efba5a4-174d-4004-8e6c-dc8a530adfe3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080515 Mar 08 04:45:54.018243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1301/2649] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:53 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:55.035940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-44494526-a0b2-43b2-8b7d-4ec7b58d470d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:55.036498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-44494526-a0b2-43b2-8b7d-4ec7b58d470d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:55.042647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44494526-a0b2-43b2-8b7d-4ec7b58d470d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:55.043319 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44494526-a0b2-43b2-8b7d-4ec7b58d470d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:55.044078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44494526-a0b2-43b2-8b7d-4ec7b58d470d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:55.044512 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-44494526-a0b2-43b2-8b7d-4ec7b58d470d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:55.101940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-44494526-a0b2-43b2-8b7d-4ec7b58d470d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:55.109611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-44494526-a0b2-43b2-8b7d-4ec7b58d470d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077643 Mar 08 04:45:55.110203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1349/2650] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:55 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:56.126265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b3030e5e-af8f-4d93-88be-ef0217ea0f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:56.126807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b3030e5e-af8f-4d93-88be-ef0217ea0f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:56.133004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3030e5e-af8f-4d93-88be-ef0217ea0f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:56.133446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3030e5e-af8f-4d93-88be-ef0217ea0f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:56.134220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3030e5e-af8f-4d93-88be-ef0217ea0f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:56.134654 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b3030e5e-af8f-4d93-88be-ef0217ea0f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:56.193564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b3030e5e-af8f-4d93-88be-ef0217ea0f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:56.201351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b3030e5e-af8f-4d93-88be-ef0217ea0f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078981 Mar 08 04:45:56.201937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1302/2651] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:56 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:57.217865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dce23ffb-972f-43f6-87b0-8c9ed73d4420 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:57.218473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dce23ffb-972f-43f6-87b0-8c9ed73d4420 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:57.224738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dce23ffb-972f-43f6-87b0-8c9ed73d4420 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:57.225186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dce23ffb-972f-43f6-87b0-8c9ed73d4420 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:57.225978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dce23ffb-972f-43f6-87b0-8c9ed73d4420 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:57.226416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dce23ffb-972f-43f6-87b0-8c9ed73d4420 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:57.286888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dce23ffb-972f-43f6-87b0-8c9ed73d4420 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:57.295962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dce23ffb-972f-43f6-87b0-8c9ed73d4420 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081905 Mar 08 04:45:57.296541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1350/2652] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:57 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:58.313403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4cca8712-4c53-4a83-b026-952c2197bc4b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:58.314029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4cca8712-4c53-4a83-b026-952c2197bc4b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:58.320501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cca8712-4c53-4a83-b026-952c2197bc4b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:58.320981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cca8712-4c53-4a83-b026-952c2197bc4b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:58.321798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cca8712-4c53-4a83-b026-952c2197bc4b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:58.322239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cca8712-4c53-4a83-b026-952c2197bc4b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:58.381112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4cca8712-4c53-4a83-b026-952c2197bc4b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:58.388897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4cca8712-4c53-4a83-b026-952c2197bc4b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079438 Mar 08 04:45:58.389452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1303/2653] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:58 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:45:59.405742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0186787c-831d-4685-bd4e-412da5d71ca6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:45:59.406352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0186787c-831d-4685-bd4e-412da5d71ca6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:45:59.412546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0186787c-831d-4685-bd4e-412da5d71ca6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:59.413000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0186787c-831d-4685-bd4e-412da5d71ca6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:59.413779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0186787c-831d-4685-bd4e-412da5d71ca6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:45:59.414210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0186787c-831d-4685-bd4e-412da5d71ca6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:45:59.476141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0186787c-831d-4685-bd4e-412da5d71ca6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:45:59.484804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0186787c-831d-4685-bd4e-412da5d71ca6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083419 Mar 08 04:45:59.485386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1351/2654] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:45:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:00.502227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9f7e3c52-8545-48ea-bccd-f7c7036e98f7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:00.502824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9f7e3c52-8545-48ea-bccd-f7c7036e98f7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:00.508996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f7e3c52-8545-48ea-bccd-f7c7036e98f7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:00.509442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f7e3c52-8545-48ea-bccd-f7c7036e98f7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:00.510295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f7e3c52-8545-48ea-bccd-f7c7036e98f7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:00.510728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9f7e3c52-8545-48ea-bccd-f7c7036e98f7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:00.571163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9f7e3c52-8545-48ea-bccd-f7c7036e98f7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:00.579043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9f7e3c52-8545-48ea-bccd-f7c7036e98f7 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080621 Mar 08 04:46:00.579610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1304/2655] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:01.595669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-31b9217b-409b-40e7-acf1-ace1c92f4a85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:01.596270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-31b9217b-409b-40e7-acf1-ace1c92f4a85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:01.602541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31b9217b-409b-40e7-acf1-ace1c92f4a85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:01.602987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31b9217b-409b-40e7-acf1-ace1c92f4a85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:01.603741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31b9217b-409b-40e7-acf1-ace1c92f4a85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:01.604172 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31b9217b-409b-40e7-acf1-ace1c92f4a85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:01.662647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-31b9217b-409b-40e7-acf1-ace1c92f4a85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:01.670747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-31b9217b-409b-40e7-acf1-ace1c92f4a85 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079022 Mar 08 04:46:01.671297 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1352/2656] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:02.688334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-920f60df-623f-4521-9088-1d322acfae42 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:02.688974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-920f60df-623f-4521-9088-1d322acfae42 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:02.695328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-920f60df-623f-4521-9088-1d322acfae42 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:02.695780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-920f60df-623f-4521-9088-1d322acfae42 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:02.696541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-920f60df-623f-4521-9088-1d322acfae42 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:02.696979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-920f60df-623f-4521-9088-1d322acfae42 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:02.757213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-920f60df-623f-4521-9088-1d322acfae42 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:02.764906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-920f60df-623f-4521-9088-1d322acfae42 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080531 Mar 08 04:46:02.765466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1305/2657] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:03.782596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-24c8da30-d1fb-4c54-935f-7e850a40ec4d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:03.783136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-24c8da30-d1fb-4c54-935f-7e850a40ec4d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:03.789336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24c8da30-d1fb-4c54-935f-7e850a40ec4d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:03.789818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24c8da30-d1fb-4c54-935f-7e850a40ec4d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:03.790577 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24c8da30-d1fb-4c54-935f-7e850a40ec4d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:03.791018 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-24c8da30-d1fb-4c54-935f-7e850a40ec4d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:03.849863 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-24c8da30-d1fb-4c54-935f-7e850a40ec4d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:03.858307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-24c8da30-d1fb-4c54-935f-7e850a40ec4d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079630 Mar 08 04:46:03.858872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1353/2658] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:03 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:04.876417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a1560507-02ba-4028-899e-2226d5dd07c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:04.877023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a1560507-02ba-4028-899e-2226d5dd07c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:04.883250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a1560507-02ba-4028-899e-2226d5dd07c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:04.883698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a1560507-02ba-4028-899e-2226d5dd07c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:04.884459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a1560507-02ba-4028-899e-2226d5dd07c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:04.884892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a1560507-02ba-4028-899e-2226d5dd07c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:04.943996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a1560507-02ba-4028-899e-2226d5dd07c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:04.951674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a1560507-02ba-4028-899e-2226d5dd07c1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079303 Mar 08 04:46:04.952232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1306/2659] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:04 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:05.968409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6d3b90ad-8dec-48d0-937c-655ee29d1917 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:05.969029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6d3b90ad-8dec-48d0-937c-655ee29d1917 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:05.975315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d3b90ad-8dec-48d0-937c-655ee29d1917 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:05.975765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d3b90ad-8dec-48d0-937c-655ee29d1917 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:05.976565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d3b90ad-8dec-48d0-937c-655ee29d1917 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:05.977007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d3b90ad-8dec-48d0-937c-655ee29d1917 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:06.039301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6d3b90ad-8dec-48d0-937c-655ee29d1917 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:06.046975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6d3b90ad-8dec-48d0-937c-655ee29d1917 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082647 Mar 08 04:46:06.047567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1354/2660] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:07.063864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-644e3653-c4cc-4ea7-83e6-7a000bdb4a6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:07.064473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-644e3653-c4cc-4ea7-83e6-7a000bdb4a6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:07.070438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-644e3653-c4cc-4ea7-83e6-7a000bdb4a6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:07.070882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-644e3653-c4cc-4ea7-83e6-7a000bdb4a6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:07.071640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-644e3653-c4cc-4ea7-83e6-7a000bdb4a6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:07.072075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-644e3653-c4cc-4ea7-83e6-7a000bdb4a6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:07.129818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-644e3653-c4cc-4ea7-83e6-7a000bdb4a6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:07.137424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-644e3653-c4cc-4ea7-83e6-7a000bdb4a6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077566 Mar 08 04:46:07.138101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1307/2661] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:07 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:08.154922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c03aa67b-e1d2-40c8-a223-0a950bbfe738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:08.155486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c03aa67b-e1d2-40c8-a223-0a950bbfe738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:08.161972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c03aa67b-e1d2-40c8-a223-0a950bbfe738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:08.162435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c03aa67b-e1d2-40c8-a223-0a950bbfe738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:08.163236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c03aa67b-e1d2-40c8-a223-0a950bbfe738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:08.163672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c03aa67b-e1d2-40c8-a223-0a950bbfe738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:08.223805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c03aa67b-e1d2-40c8-a223-0a950bbfe738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:08.231756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c03aa67b-e1d2-40c8-a223-0a950bbfe738 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081522 Mar 08 04:46:08.232327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1355/2662] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:08 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:09.249166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-18d635a0-46f6-4d77-9a6b-75c84c626641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:09.249805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-18d635a0-46f6-4d77-9a6b-75c84c626641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:09.256064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18d635a0-46f6-4d77-9a6b-75c84c626641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:09.256510 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18d635a0-46f6-4d77-9a6b-75c84c626641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:09.257271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18d635a0-46f6-4d77-9a6b-75c84c626641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:09.257736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18d635a0-46f6-4d77-9a6b-75c84c626641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:09.316629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-18d635a0-46f6-4d77-9a6b-75c84c626641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:09.324439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-18d635a0-46f6-4d77-9a6b-75c84c626641 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079985 Mar 08 04:46:09.324994 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1308/2663] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:09 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:10.341637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2e5ef2eb-104a-4db3-95d0-04dc1dc3eb57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:10.342252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2e5ef2eb-104a-4db3-95d0-04dc1dc3eb57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:10.348686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e5ef2eb-104a-4db3-95d0-04dc1dc3eb57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:10.349161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e5ef2eb-104a-4db3-95d0-04dc1dc3eb57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:10.349954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e5ef2eb-104a-4db3-95d0-04dc1dc3eb57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:10.350393 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2e5ef2eb-104a-4db3-95d0-04dc1dc3eb57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:10.409841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2e5ef2eb-104a-4db3-95d0-04dc1dc3eb57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:10.417492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2e5ef2eb-104a-4db3-95d0-04dc1dc3eb57 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080283 Mar 08 04:46:10.418161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1356/2664] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:10 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:11.433421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e8947f33-d19c-45b7-ac0f-2e34bb01d0d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:11.434062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e8947f33-d19c-45b7-ac0f-2e34bb01d0d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:11.440289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8947f33-d19c-45b7-ac0f-2e34bb01d0d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:11.440736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8947f33-d19c-45b7-ac0f-2e34bb01d0d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:11.441519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8947f33-d19c-45b7-ac0f-2e34bb01d0d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:11.441980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8947f33-d19c-45b7-ac0f-2e34bb01d0d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:11.499897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e8947f33-d19c-45b7-ac0f-2e34bb01d0d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:11.507454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e8947f33-d19c-45b7-ac0f-2e34bb01d0d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077901 Mar 08 04:46:11.508010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1309/2665] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:12.524992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-303563d4-157d-423b-9c61-b53cf067dc24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:12.525596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-303563d4-157d-423b-9c61-b53cf067dc24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:12.532067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-303563d4-157d-423b-9c61-b53cf067dc24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:12.532509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-303563d4-157d-423b-9c61-b53cf067dc24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:12.533264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-303563d4-157d-423b-9c61-b53cf067dc24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:12.533716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-303563d4-157d-423b-9c61-b53cf067dc24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:12.596132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-303563d4-157d-423b-9c61-b53cf067dc24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:12.603878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-303563d4-157d-423b-9c61-b53cf067dc24 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083011 Mar 08 04:46:12.604446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1357/2666] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:13.621153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-db9f2f79-257d-4696-9e38-87a0bfd44892 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:13.621784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-db9f2f79-257d-4696-9e38-87a0bfd44892 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:13.628032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db9f2f79-257d-4696-9e38-87a0bfd44892 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:13.628487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db9f2f79-257d-4696-9e38-87a0bfd44892 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:13.629252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db9f2f79-257d-4696-9e38-87a0bfd44892 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:13.629715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db9f2f79-257d-4696-9e38-87a0bfd44892 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:13.688362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-db9f2f79-257d-4696-9e38-87a0bfd44892 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:13.696058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-db9f2f79-257d-4696-9e38-87a0bfd44892 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079488 Mar 08 04:46:13.696618 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1310/2667] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:13 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:14.712759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cf97c772-f7ab-46d4-b3b1-c3da1968c83b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:14.713373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cf97c772-f7ab-46d4-b3b1-c3da1968c83b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:14.719862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf97c772-f7ab-46d4-b3b1-c3da1968c83b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:14.720306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf97c772-f7ab-46d4-b3b1-c3da1968c83b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:14.721073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf97c772-f7ab-46d4-b3b1-c3da1968c83b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:14.721508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cf97c772-f7ab-46d4-b3b1-c3da1968c83b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:14.780483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cf97c772-f7ab-46d4-b3b1-c3da1968c83b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:14.788132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cf97c772-f7ab-46d4-b3b1-c3da1968c83b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079235 Mar 08 04:46:14.788914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1358/2668] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:46:15.805432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d2a3c2cc-a0e4-4589-84b9-af83fc1cc5e3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:15.806084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d2a3c2cc-a0e4-4589-84b9-af83fc1cc5e3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:15.813010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2a3c2cc-a0e4-4589-84b9-af83fc1cc5e3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:15.813452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2a3c2cc-a0e4-4589-84b9-af83fc1cc5e3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:15.814250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2a3c2cc-a0e4-4589-84b9-af83fc1cc5e3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:15.814681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2a3c2cc-a0e4-4589-84b9-af83fc1cc5e3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:15.875693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d2a3c2cc-a0e4-4589-84b9-af83fc1cc5e3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:15.883464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d2a3c2cc-a0e4-4589-84b9-af83fc1cc5e3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081868 Mar 08 04:46:15.884018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1311/2669] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:15 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:16.900571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4a54cd71-5b7c-484a-987b-81b87c59686b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:16.901218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4a54cd71-5b7c-484a-987b-81b87c59686b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:16.907725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a54cd71-5b7c-484a-987b-81b87c59686b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:16.908177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a54cd71-5b7c-484a-987b-81b87c59686b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:16.908942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a54cd71-5b7c-484a-987b-81b87c59686b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:16.909382 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4a54cd71-5b7c-484a-987b-81b87c59686b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:16.967268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4a54cd71-5b7c-484a-987b-81b87c59686b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:16.974918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4a54cd71-5b7c-484a-987b-81b87c59686b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078492 Mar 08 04:46:16.975489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1359/2670] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:16 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:17.992286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6b9859aa-82b3-456d-b6ea-c7f7efda1825 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:17.992929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6b9859aa-82b3-456d-b6ea-c7f7efda1825 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:17.999737 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b9859aa-82b3-456d-b6ea-c7f7efda1825 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:18.000190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b9859aa-82b3-456d-b6ea-c7f7efda1825 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:18.000956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b9859aa-82b3-456d-b6ea-c7f7efda1825 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:18.001395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6b9859aa-82b3-456d-b6ea-c7f7efda1825 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:18.061279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6b9859aa-82b3-456d-b6ea-c7f7efda1825 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:18.068924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6b9859aa-82b3-456d-b6ea-c7f7efda1825 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080546 Mar 08 04:46:18.069480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1312/2671] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:19.086443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-48a688f0-5226-4d06-996e-71ab1e6bf640 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:19.087044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-48a688f0-5226-4d06-996e-71ab1e6bf640 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:19.095178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48a688f0-5226-4d06-996e-71ab1e6bf640 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:19.095625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48a688f0-5226-4d06-996e-71ab1e6bf640 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:19.096390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48a688f0-5226-4d06-996e-71ab1e6bf640 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:19.096820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48a688f0-5226-4d06-996e-71ab1e6bf640 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:19.159059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-48a688f0-5226-4d06-996e-71ab1e6bf640 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:19.167239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-48a688f0-5226-4d06-996e-71ab1e6bf640 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.084793 Mar 08 04:46:19.167815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1360/2672] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:19 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:20.184313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8c306258-a20b-45e8-8617-c11c0e8ff882 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:20.184915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8c306258-a20b-45e8-8617-c11c0e8ff882 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:20.191192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c306258-a20b-45e8-8617-c11c0e8ff882 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:20.191642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c306258-a20b-45e8-8617-c11c0e8ff882 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:20.192397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c306258-a20b-45e8-8617-c11c0e8ff882 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:20.192837 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8c306258-a20b-45e8-8617-c11c0e8ff882 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:20.250508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8c306258-a20b-45e8-8617-c11c0e8ff882 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:20.258455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8c306258-a20b-45e8-8617-c11c0e8ff882 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078487 Mar 08 04:46:20.259017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1313/2673] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:21.275473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9596b981-5c72-4476-ade1-7686e160904c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:21.276215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9596b981-5c72-4476-ade1-7686e160904c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:21.282414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9596b981-5c72-4476-ade1-7686e160904c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:21.282859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9596b981-5c72-4476-ade1-7686e160904c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:21.283613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9596b981-5c72-4476-ade1-7686e160904c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:21.284046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9596b981-5c72-4476-ade1-7686e160904c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:21.342502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9596b981-5c72-4476-ade1-7686e160904c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:21.350051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9596b981-5c72-4476-ade1-7686e160904c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078672 Mar 08 04:46:21.350607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1361/2674] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:21 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:22.367860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-238549d3-0e21-4931-8385-23e2ce29c447 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:22.368473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-238549d3-0e21-4931-8385-23e2ce29c447 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:22.375548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-238549d3-0e21-4931-8385-23e2ce29c447 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:22.375996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-238549d3-0e21-4931-8385-23e2ce29c447 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:22.376756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-238549d3-0e21-4931-8385-23e2ce29c447 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:22.377193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-238549d3-0e21-4931-8385-23e2ce29c447 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:22.442860 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-238549d3-0e21-4931-8385-23e2ce29c447 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:22.451454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-238549d3-0e21-4931-8385-23e2ce29c447 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.087432 Mar 08 04:46:22.452011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1314/2675] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:23.469213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ea1c2fed-c6ed-4e04-a1f1-9b0a6e048a87 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:23.469787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ea1c2fed-c6ed-4e04-a1f1-9b0a6e048a87 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:23.476007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea1c2fed-c6ed-4e04-a1f1-9b0a6e048a87 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:23.476456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea1c2fed-c6ed-4e04-a1f1-9b0a6e048a87 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:23.477218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea1c2fed-c6ed-4e04-a1f1-9b0a6e048a87 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:23.477672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ea1c2fed-c6ed-4e04-a1f1-9b0a6e048a87 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:23.538363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ea1c2fed-c6ed-4e04-a1f1-9b0a6e048a87 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:23.546203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ea1c2fed-c6ed-4e04-a1f1-9b0a6e048a87 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080958 Mar 08 04:46:23.546773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1362/2676] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:24.565097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dd60cbf8-5396-4ffc-808b-1de5062784fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:24.565713 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dd60cbf8-5396-4ffc-808b-1de5062784fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:24.572058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd60cbf8-5396-4ffc-808b-1de5062784fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:24.572507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd60cbf8-5396-4ffc-808b-1de5062784fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:24.573929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd60cbf8-5396-4ffc-808b-1de5062784fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:24.574363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd60cbf8-5396-4ffc-808b-1de5062784fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:24.632528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dd60cbf8-5396-4ffc-808b-1de5062784fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:24.640292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dd60cbf8-5396-4ffc-808b-1de5062784fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079035 Mar 08 04:46:24.640856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1315/2677] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:25.657063 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4bb08c73-cdf6-4055-8542-7b2734544b27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:25.657685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4bb08c73-cdf6-4055-8542-7b2734544b27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:25.664171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4bb08c73-cdf6-4055-8542-7b2734544b27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:25.664645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4bb08c73-cdf6-4055-8542-7b2734544b27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:25.665402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4bb08c73-cdf6-4055-8542-7b2734544b27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:25.665866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4bb08c73-cdf6-4055-8542-7b2734544b27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:25.727714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4bb08c73-cdf6-4055-8542-7b2734544b27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:25.736034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4bb08c73-cdf6-4055-8542-7b2734544b27 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082751 Mar 08 04:46:25.736541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1363/2678] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:26.753059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-811f0200-b1e7-41f9-9d0e-27aa2d47ab5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:26.753683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-811f0200-b1e7-41f9-9d0e-27aa2d47ab5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:26.759824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811f0200-b1e7-41f9-9d0e-27aa2d47ab5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:26.760348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811f0200-b1e7-41f9-9d0e-27aa2d47ab5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:26.761156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811f0200-b1e7-41f9-9d0e-27aa2d47ab5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:26.761589 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811f0200-b1e7-41f9-9d0e-27aa2d47ab5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:26.819527 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-811f0200-b1e7-41f9-9d0e-27aa2d47ab5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:26.827575 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-811f0200-b1e7-41f9-9d0e-27aa2d47ab5a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078331 Mar 08 04:46:26.828140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1316/2679] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:26 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:27.844789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7266d8de-b175-4138-bf8f-bfb9992179b8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:27.845318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7266d8de-b175-4138-bf8f-bfb9992179b8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:27.851810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7266d8de-b175-4138-bf8f-bfb9992179b8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:27.852261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7266d8de-b175-4138-bf8f-bfb9992179b8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:27.853053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7266d8de-b175-4138-bf8f-bfb9992179b8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:27.853516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7266d8de-b175-4138-bf8f-bfb9992179b8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:27.912588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7266d8de-b175-4138-bf8f-bfb9992179b8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:27.920367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7266d8de-b175-4138-bf8f-bfb9992179b8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079509 Mar 08 04:46:27.920926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1364/2680] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:27 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:28.937568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ce526e4b-efc9-408a-97dc-9e3760de4aa5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:28.938204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ce526e4b-efc9-408a-97dc-9e3760de4aa5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:28.944394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce526e4b-efc9-408a-97dc-9e3760de4aa5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:28.944843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce526e4b-efc9-408a-97dc-9e3760de4aa5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:28.945604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce526e4b-efc9-408a-97dc-9e3760de4aa5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:28.946060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce526e4b-efc9-408a-97dc-9e3760de4aa5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:29.004171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ce526e4b-efc9-408a-97dc-9e3760de4aa5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:29.011828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ce526e4b-efc9-408a-97dc-9e3760de4aa5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078143 Mar 08 04:46:29.012391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1317/2681] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:28 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:30.028990 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-957626e5-9552-46b7-9c6d-fcfa0fbeb37a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:30.029631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-957626e5-9552-46b7-9c6d-fcfa0fbeb37a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:30.035905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-957626e5-9552-46b7-9c6d-fcfa0fbeb37a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:30.036360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-957626e5-9552-46b7-9c6d-fcfa0fbeb37a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:30.037123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-957626e5-9552-46b7-9c6d-fcfa0fbeb37a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:30.037594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-957626e5-9552-46b7-9c6d-fcfa0fbeb37a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:30.096051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-957626e5-9552-46b7-9c6d-fcfa0fbeb37a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:30.104222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-957626e5-9552-46b7-9c6d-fcfa0fbeb37a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079107 Mar 08 04:46:30.104728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1365/2682] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:31.120726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7c1ee7c8-bcc3-45fb-b653-8ecc666ab20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:31.121253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7c1ee7c8-bcc3-45fb-b653-8ecc666ab20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:31.127433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c1ee7c8-bcc3-45fb-b653-8ecc666ab20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:31.127878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c1ee7c8-bcc3-45fb-b653-8ecc666ab20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:31.128631 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c1ee7c8-bcc3-45fb-b653-8ecc666ab20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:31.129064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7c1ee7c8-bcc3-45fb-b653-8ecc666ab20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:31.189137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7c1ee7c8-bcc3-45fb-b653-8ecc666ab20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:31.197081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7c1ee7c8-bcc3-45fb-b653-8ecc666ab20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080357 Mar 08 04:46:31.197731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1318/2683] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:31 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:46:32.214622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-00588bf4-5520-44e3-bdf1-24838edcd93f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:32.215228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-00588bf4-5520-44e3-bdf1-24838edcd93f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:32.221466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00588bf4-5520-44e3-bdf1-24838edcd93f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:32.221952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00588bf4-5520-44e3-bdf1-24838edcd93f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:32.222716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00588bf4-5520-44e3-bdf1-24838edcd93f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:32.223154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00588bf4-5520-44e3-bdf1-24838edcd93f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:32.288774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-00588bf4-5520-44e3-bdf1-24838edcd93f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:32.296788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-00588bf4-5520-44e3-bdf1-24838edcd93f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.086710 Mar 08 04:46:32.297368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1366/2684] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:32 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:33.313935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2928ce87-7a86-4d9e-bc5c-a5843122bd2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:33.314548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2928ce87-7a86-4d9e-bc5c-a5843122bd2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:33.320885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2928ce87-7a86-4d9e-bc5c-a5843122bd2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:33.321333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2928ce87-7a86-4d9e-bc5c-a5843122bd2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:33.322126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2928ce87-7a86-4d9e-bc5c-a5843122bd2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:33.322590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2928ce87-7a86-4d9e-bc5c-a5843122bd2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:33.382324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2928ce87-7a86-4d9e-bc5c-a5843122bd2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:33.389986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2928ce87-7a86-4d9e-bc5c-a5843122bd2e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079974 Mar 08 04:46:33.390537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1319/2685] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:34.407375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-83629aac-ce47-46c7-a2c4-3c9aade4c87c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:34.407980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-83629aac-ce47-46c7-a2c4-3c9aade4c87c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:34.414209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-83629aac-ce47-46c7-a2c4-3c9aade4c87c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:34.414651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-83629aac-ce47-46c7-a2c4-3c9aade4c87c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:34.415407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-83629aac-ce47-46c7-a2c4-3c9aade4c87c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:34.415838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-83629aac-ce47-46c7-a2c4-3c9aade4c87c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:34.475538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-83629aac-ce47-46c7-a2c4-3c9aade4c87c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:34.483445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-83629aac-ce47-46c7-a2c4-3c9aade4c87c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079973 Mar 08 04:46:34.483999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1367/2686] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:35.500835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-201574cb-9e86-4d24-a8ab-623e8cda9b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:35.501473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-201574cb-9e86-4d24-a8ab-623e8cda9b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:35.507331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-201574cb-9e86-4d24-a8ab-623e8cda9b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:35.507782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-201574cb-9e86-4d24-a8ab-623e8cda9b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:35.508545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-201574cb-9e86-4d24-a8ab-623e8cda9b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:35.508985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-201574cb-9e86-4d24-a8ab-623e8cda9b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:35.568083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-201574cb-9e86-4d24-a8ab-623e8cda9b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:35.575936 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-201574cb-9e86-4d24-a8ab-623e8cda9b8c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079110 Mar 08 04:46:35.576501 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1320/2687] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:35 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:36.593177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7f57f848-0833-4d6f-a3e7-aa56a3718cb9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:36.594038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7f57f848-0833-4d6f-a3e7-aa56a3718cb9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:36.600674 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f57f848-0833-4d6f-a3e7-aa56a3718cb9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:36.601120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f57f848-0833-4d6f-a3e7-aa56a3718cb9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:36.601904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f57f848-0833-4d6f-a3e7-aa56a3718cb9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:36.602344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f57f848-0833-4d6f-a3e7-aa56a3718cb9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:36.668112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7f57f848-0833-4d6f-a3e7-aa56a3718cb9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:36.675901 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7f57f848-0833-4d6f-a3e7-aa56a3718cb9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.086785 Mar 08 04:46:36.676457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1368/2688] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:36 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:37.693294 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3f151f16-844c-4460-9d44-5e3bde692cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:37.693926 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3f151f16-844c-4460-9d44-5e3bde692cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:37.700692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f151f16-844c-4460-9d44-5e3bde692cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:37.701145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f151f16-844c-4460-9d44-5e3bde692cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:37.701935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f151f16-844c-4460-9d44-5e3bde692cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:37.702374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f151f16-844c-4460-9d44-5e3bde692cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:37.759441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3f151f16-844c-4460-9d44-5e3bde692cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:37.767553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3f151f16-844c-4460-9d44-5e3bde692cf3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078088 Mar 08 04:46:37.768113 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1321/2689] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:37 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:38.785389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a362cb75-9a71-403e-8e5d-d48a2151b305 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:38.786014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a362cb75-9a71-403e-8e5d-d48a2151b305 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:38.792313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a362cb75-9a71-403e-8e5d-d48a2151b305 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:38.792756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a362cb75-9a71-403e-8e5d-d48a2151b305 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:38.793505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a362cb75-9a71-403e-8e5d-d48a2151b305 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:38.793968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a362cb75-9a71-403e-8e5d-d48a2151b305 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:38.856151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a362cb75-9a71-403e-8e5d-d48a2151b305 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:38.863963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a362cb75-9a71-403e-8e5d-d48a2151b305 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082517 Mar 08 04:46:38.864526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1369/2690] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:38 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:39.880566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ee34cf5f-d2e4-426e-bdc2-a68adfd36c05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:39.881176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ee34cf5f-d2e4-426e-bdc2-a68adfd36c05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:39.887824 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee34cf5f-d2e4-426e-bdc2-a68adfd36c05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:39.888271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee34cf5f-d2e4-426e-bdc2-a68adfd36c05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:39.889028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee34cf5f-d2e4-426e-bdc2-a68adfd36c05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:39.889463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ee34cf5f-d2e4-426e-bdc2-a68adfd36c05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:39.947556 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ee34cf5f-d2e4-426e-bdc2-a68adfd36c05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:39.955126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ee34cf5f-d2e4-426e-bdc2-a68adfd36c05 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078418 Mar 08 04:46:39.955688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1322/2691] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:39 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:40.972221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-20b440e8-f65b-4c97-b031-6fc749879c80 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:40.972822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-20b440e8-f65b-4c97-b031-6fc749879c80 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:40.979147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20b440e8-f65b-4c97-b031-6fc749879c80 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:40.979623 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20b440e8-f65b-4c97-b031-6fc749879c80 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:40.980375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20b440e8-f65b-4c97-b031-6fc749879c80 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:40.980810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-20b440e8-f65b-4c97-b031-6fc749879c80 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:41.039413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-20b440e8-f65b-4c97-b031-6fc749879c80 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:41.047175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-20b440e8-f65b-4c97-b031-6fc749879c80 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078841 Mar 08 04:46:41.047731 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1370/2692] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:42.063804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-006213e2-1ce3-4ced-823a-951d1a86f5d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:42.064409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-006213e2-1ce3-4ced-823a-951d1a86f5d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:42.070720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-006213e2-1ce3-4ced-823a-951d1a86f5d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:42.071169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-006213e2-1ce3-4ced-823a-951d1a86f5d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:42.072514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-006213e2-1ce3-4ced-823a-951d1a86f5d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:42.072969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-006213e2-1ce3-4ced-823a-951d1a86f5d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:42.131190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-006213e2-1ce3-4ced-823a-951d1a86f5d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:42.139590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-006213e2-1ce3-4ced-823a-951d1a86f5d6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079597 Mar 08 04:46:42.140148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1323/2693] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:42 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:43.157228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-da2da7b5-71a6-49fe-b44e-52f99d939d16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:43.157796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-da2da7b5-71a6-49fe-b44e-52f99d939d16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:43.164008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da2da7b5-71a6-49fe-b44e-52f99d939d16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:43.164453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da2da7b5-71a6-49fe-b44e-52f99d939d16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:43.165206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da2da7b5-71a6-49fe-b44e-52f99d939d16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:43.165734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da2da7b5-71a6-49fe-b44e-52f99d939d16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:43.223615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-da2da7b5-71a6-49fe-b44e-52f99d939d16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:43.231305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-da2da7b5-71a6-49fe-b44e-52f99d939d16 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078087 Mar 08 04:46:43.231873 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1371/2694] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:44.247889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3778e3f2-0e05-41c9-b66f-d34b966d2ee9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:44.248498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3778e3f2-0e05-41c9-b66f-d34b966d2ee9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:44.254905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3778e3f2-0e05-41c9-b66f-d34b966d2ee9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:44.255352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3778e3f2-0e05-41c9-b66f-d34b966d2ee9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:44.256103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3778e3f2-0e05-41c9-b66f-d34b966d2ee9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:44.256536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3778e3f2-0e05-41c9-b66f-d34b966d2ee9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:44.313998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3778e3f2-0e05-41c9-b66f-d34b966d2ee9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:44.321517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3778e3f2-0e05-41c9-b66f-d34b966d2ee9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077722 Mar 08 04:46:44.322098 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1324/2695] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:45.338850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-41b653e1-0541-430a-ae52-b41929895c61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:45.339454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-41b653e1-0541-430a-ae52-b41929895c61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:45.345759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41b653e1-0541-430a-ae52-b41929895c61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:45.346204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41b653e1-0541-430a-ae52-b41929895c61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:45.346961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41b653e1-0541-430a-ae52-b41929895c61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:45.347392 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-41b653e1-0541-430a-ae52-b41929895c61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:45.408482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-41b653e1-0541-430a-ae52-b41929895c61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:45.416275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-41b653e1-0541-430a-ae52-b41929895c61 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081772 Mar 08 04:46:45.416828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1372/2696] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:45 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:46.433018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-eea6ef43-4eb0-4e59-bc49-db84c5a8d05a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:46.433623 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eea6ef43-4eb0-4e59-bc49-db84c5a8d05a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:46.439859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eea6ef43-4eb0-4e59-bc49-db84c5a8d05a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:46.440304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eea6ef43-4eb0-4e59-bc49-db84c5a8d05a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:46.441060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eea6ef43-4eb0-4e59-bc49-db84c5a8d05a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:46.441496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eea6ef43-4eb0-4e59-bc49-db84c5a8d05a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:46.501675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-eea6ef43-4eb0-4e59-bc49-db84c5a8d05a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:46.510353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eea6ef43-4eb0-4e59-bc49-db84c5a8d05a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081094 Mar 08 04:46:46.511142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1325/2697] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:46 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:47.527567 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0b6b8b8f-37cd-43b4-af73-175d300b424e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:47.528167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0b6b8b8f-37cd-43b4-af73-175d300b424e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:47.534377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b6b8b8f-37cd-43b4-af73-175d300b424e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:47.534822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b6b8b8f-37cd-43b4-af73-175d300b424e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:47.535575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b6b8b8f-37cd-43b4-af73-175d300b424e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:47.536007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b6b8b8f-37cd-43b4-af73-175d300b424e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:47.593773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0b6b8b8f-37cd-43b4-af73-175d300b424e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:47.601396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0b6b8b8f-37cd-43b4-af73-175d300b424e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077819 Mar 08 04:46:47.601981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1373/2698] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:47 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:48.619894 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-09d3ee00-6bca-4381-8aed-f44d431d8da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:48.620446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-09d3ee00-6bca-4381-8aed-f44d431d8da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:48.626615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-09d3ee00-6bca-4381-8aed-f44d431d8da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:48.627061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-09d3ee00-6bca-4381-8aed-f44d431d8da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:48.627809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-09d3ee00-6bca-4381-8aed-f44d431d8da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:48.628239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-09d3ee00-6bca-4381-8aed-f44d431d8da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:48.687903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-09d3ee00-6bca-4381-8aed-f44d431d8da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:48.695517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-09d3ee00-6bca-4381-8aed-f44d431d8da8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079774 Mar 08 04:46:48.696072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1326/2699] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:48 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:49.713002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1e02155b-0454-4eb4-8efc-283c0a940a5b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:49.713649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1e02155b-0454-4eb4-8efc-283c0a940a5b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:49.719546 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1e02155b-0454-4eb4-8efc-283c0a940a5b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:49.719992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1e02155b-0454-4eb4-8efc-283c0a940a5b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:49.720754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1e02155b-0454-4eb4-8efc-283c0a940a5b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:49.721191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1e02155b-0454-4eb4-8efc-283c0a940a5b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:49.779594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1e02155b-0454-4eb4-8efc-283c0a940a5b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:49.787168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1e02155b-0454-4eb4-8efc-283c0a940a5b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078800 Mar 08 04:46:49.787726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1374/2700] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:49 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:50.803960 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1168a352-b9f1-4a87-a3f0-1dbf5aa6ab3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:50.804588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1168a352-b9f1-4a87-a3f0-1dbf5aa6ab3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:50.810804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1168a352-b9f1-4a87-a3f0-1dbf5aa6ab3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:50.811253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1168a352-b9f1-4a87-a3f0-1dbf5aa6ab3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:50.812013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1168a352-b9f1-4a87-a3f0-1dbf5aa6ab3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:50.812446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1168a352-b9f1-4a87-a3f0-1dbf5aa6ab3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:50.871641 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1168a352-b9f1-4a87-a3f0-1dbf5aa6ab3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:50.879534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1168a352-b9f1-4a87-a3f0-1dbf5aa6ab3e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079403 Mar 08 04:46:50.880086 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1327/2701] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:50 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:51.896513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7f93d95c-161c-4ee9-a48b-c5d738b646e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:51.897151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7f93d95c-161c-4ee9-a48b-c5d738b646e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:51.904770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f93d95c-161c-4ee9-a48b-c5d738b646e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:51.905357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f93d95c-161c-4ee9-a48b-c5d738b646e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:51.906281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f93d95c-161c-4ee9-a48b-c5d738b646e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:51.906927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f93d95c-161c-4ee9-a48b-c5d738b646e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:51.975760 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7f93d95c-161c-4ee9-a48b-c5d738b646e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:51.983814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7f93d95c-161c-4ee9-a48b-c5d738b646e5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.091418 Mar 08 04:46:51.984379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1375/2702] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:51 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:52.999956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c4223d76-4193-47cc-ba3a-61b246a6f48a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:53.000563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c4223d76-4193-47cc-ba3a-61b246a6f48a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:53.006863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c4223d76-4193-47cc-ba3a-61b246a6f48a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:53.007311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c4223d76-4193-47cc-ba3a-61b246a6f48a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:53.008069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c4223d76-4193-47cc-ba3a-61b246a6f48a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:53.008505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c4223d76-4193-47cc-ba3a-61b246a6f48a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:53.068021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c4223d76-4193-47cc-ba3a-61b246a6f48a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:53.075630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c4223d76-4193-47cc-ba3a-61b246a6f48a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079505 Mar 08 04:46:53.076181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1328/2703] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:52 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:54.092094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f1ee7e0d-0a27-40eb-8c62-d9fa5f08a67f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:54.092735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f1ee7e0d-0a27-40eb-8c62-d9fa5f08a67f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:54.099010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1ee7e0d-0a27-40eb-8c62-d9fa5f08a67f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:54.099454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1ee7e0d-0a27-40eb-8c62-d9fa5f08a67f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:54.100210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1ee7e0d-0a27-40eb-8c62-d9fa5f08a67f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:54.100645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1ee7e0d-0a27-40eb-8c62-d9fa5f08a67f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:54.158642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f1ee7e0d-0a27-40eb-8c62-d9fa5f08a67f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:54.166808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f1ee7e0d-0a27-40eb-8c62-d9fa5f08a67f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078504 Mar 08 04:46:54.167369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1376/2704] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:54 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:55.183603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-87d696fc-7419-4b5c-9884-c20b3bd8d82c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:55.184210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-87d696fc-7419-4b5c-9884-c20b3bd8d82c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:55.190476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87d696fc-7419-4b5c-9884-c20b3bd8d82c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:55.190942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87d696fc-7419-4b5c-9884-c20b3bd8d82c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:55.191692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87d696fc-7419-4b5c-9884-c20b3bd8d82c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:55.192124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87d696fc-7419-4b5c-9884-c20b3bd8d82c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:55.250250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-87d696fc-7419-4b5c-9884-c20b3bd8d82c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:55.257796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-87d696fc-7419-4b5c-9884-c20b3bd8d82c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078309 Mar 08 04:46:55.258347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1329/2705] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:55 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:56.276161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d42c3e10-8046-444c-aeb6-aaaec142ee97 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:56.276855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d42c3e10-8046-444c-aeb6-aaaec142ee97 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:56.283102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d42c3e10-8046-444c-aeb6-aaaec142ee97 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:56.283549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d42c3e10-8046-444c-aeb6-aaaec142ee97 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:56.284343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d42c3e10-8046-444c-aeb6-aaaec142ee97 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:56.284777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d42c3e10-8046-444c-aeb6-aaaec142ee97 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:56.343999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d42c3e10-8046-444c-aeb6-aaaec142ee97 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:56.351581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d42c3e10-8046-444c-aeb6-aaaec142ee97 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080034 Mar 08 04:46:56.352139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1377/2706] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:56 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:57.369645 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-22d9f5b7-6cb6-4828-8c57-897d4292eca5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:57.370285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-22d9f5b7-6cb6-4828-8c57-897d4292eca5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:57.377468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22d9f5b7-6cb6-4828-8c57-897d4292eca5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:57.377934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22d9f5b7-6cb6-4828-8c57-897d4292eca5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:57.378699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22d9f5b7-6cb6-4828-8c57-897d4292eca5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:57.379137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22d9f5b7-6cb6-4828-8c57-897d4292eca5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:57.445895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-22d9f5b7-6cb6-4828-8c57-897d4292eca5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:57.455717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-22d9f5b7-6cb6-4828-8c57-897d4292eca5 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.090174 Mar 08 04:46:57.456362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1330/2707] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:57 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:58.472736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f1abfa4d-60e5-4705-bc8e-79a68d578e81 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:58.473471 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f1abfa4d-60e5-4705-bc8e-79a68d578e81 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:58.480335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1abfa4d-60e5-4705-bc8e-79a68d578e81 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:58.480783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1abfa4d-60e5-4705-bc8e-79a68d578e81 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:58.481547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1abfa4d-60e5-4705-bc8e-79a68d578e81 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:58.482009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f1abfa4d-60e5-4705-bc8e-79a68d578e81 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:58.543230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f1abfa4d-60e5-4705-bc8e-79a68d578e81 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:58.550939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f1abfa4d-60e5-4705-bc8e-79a68d578e81 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082090 Mar 08 04:46:58.551494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1378/2708] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:58 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:46:59.568316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f4e09394-ca8d-4558-8ab6-53c60c587542 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:46:59.568916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f4e09394-ca8d-4558-8ab6-53c60c587542 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:46:59.575847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4e09394-ca8d-4558-8ab6-53c60c587542 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:59.576291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4e09394-ca8d-4558-8ab6-53c60c587542 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:59.577042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4e09394-ca8d-4558-8ab6-53c60c587542 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:46:59.577472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f4e09394-ca8d-4558-8ab6-53c60c587542 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:46:59.636438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f4e09394-ca8d-4558-8ab6-53c60c587542 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:46:59.644047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f4e09394-ca8d-4558-8ab6-53c60c587542 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079612 Mar 08 04:46:59.644601 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1331/2709] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:46:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:00.346312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:47:00.346581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:47:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:47:00.661004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e4f03efa-b83e-478e-a748-ec6d820c66be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:00.661614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e4f03efa-b83e-478e-a748-ec6d820c66be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:00.667973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e4f03efa-b83e-478e-a748-ec6d820c66be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:00.668418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e4f03efa-b83e-478e-a748-ec6d820c66be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:00.669170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e4f03efa-b83e-478e-a748-ec6d820c66be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:00.669601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e4f03efa-b83e-478e-a748-ec6d820c66be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:00.727379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e4f03efa-b83e-478e-a748-ec6d820c66be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:00.735060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e4f03efa-b83e-478e-a748-ec6d820c66be tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077909 Mar 08 04:47:00.735616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1379/2710] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:01.752246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4dea5d70-455d-4e40-af96-b0753830332d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:01.752881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4dea5d70-455d-4e40-af96-b0753830332d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:01.759351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4dea5d70-455d-4e40-af96-b0753830332d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:01.759796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4dea5d70-455d-4e40-af96-b0753830332d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:01.760552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4dea5d70-455d-4e40-af96-b0753830332d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:01.760986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4dea5d70-455d-4e40-af96-b0753830332d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:01.821162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4dea5d70-455d-4e40-af96-b0753830332d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:01.829101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4dea5d70-455d-4e40-af96-b0753830332d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080694 Mar 08 04:47:01.829685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1332/2711] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:01 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:02.846001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5ca7bafa-7f44-47f9-b4ff-10308f049b65 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:02.846607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5ca7bafa-7f44-47f9-b4ff-10308f049b65 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:02.853442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ca7bafa-7f44-47f9-b4ff-10308f049b65 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:02.854070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ca7bafa-7f44-47f9-b4ff-10308f049b65 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:02.854823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ca7bafa-7f44-47f9-b4ff-10308f049b65 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:02.855256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ca7bafa-7f44-47f9-b4ff-10308f049b65 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:02.913353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5ca7bafa-7f44-47f9-b4ff-10308f049b65 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:02.921024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5ca7bafa-7f44-47f9-b4ff-10308f049b65 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078909 Mar 08 04:47:02.921576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1380/2712] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:02 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:03.937767 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3ff7a20d-4a95-46f6-93d2-a6520bddf44c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:03.938378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3ff7a20d-4a95-46f6-93d2-a6520bddf44c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:03.944625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ff7a20d-4a95-46f6-93d2-a6520bddf44c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:03.945079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ff7a20d-4a95-46f6-93d2-a6520bddf44c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:03.945875 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ff7a20d-4a95-46f6-93d2-a6520bddf44c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:03.946841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ff7a20d-4a95-46f6-93d2-a6520bddf44c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:04.003706 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3ff7a20d-4a95-46f6-93d2-a6520bddf44c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:04.011914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3ff7a20d-4a95-46f6-93d2-a6520bddf44c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078030 Mar 08 04:47:04.012467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1333/2713] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:03 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:05.029055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b01733ac-8d71-4209-8261-3c1bda9e74cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:05.029732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b01733ac-8d71-4209-8261-3c1bda9e74cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:05.035927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b01733ac-8d71-4209-8261-3c1bda9e74cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:05.036380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b01733ac-8d71-4209-8261-3c1bda9e74cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:05.037147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b01733ac-8d71-4209-8261-3c1bda9e74cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:05.037585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b01733ac-8d71-4209-8261-3c1bda9e74cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:05.098789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b01733ac-8d71-4209-8261-3c1bda9e74cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:05.106709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b01733ac-8d71-4209-8261-3c1bda9e74cc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081471 Mar 08 04:47:05.107216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1381/2714] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:05 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:06.123811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cb1f69f5-2d4b-405a-9c3b-c74eb25769bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:06.124347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cb1f69f5-2d4b-405a-9c3b-c74eb25769bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:06.130346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb1f69f5-2d4b-405a-9c3b-c74eb25769bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:06.130793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb1f69f5-2d4b-405a-9c3b-c74eb25769bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:06.131555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb1f69f5-2d4b-405a-9c3b-c74eb25769bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:06.131989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cb1f69f5-2d4b-405a-9c3b-c74eb25769bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:06.190159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cb1f69f5-2d4b-405a-9c3b-c74eb25769bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:06.197795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cb1f69f5-2d4b-405a-9c3b-c74eb25769bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077956 Mar 08 04:47:06.198348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1334/2715] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:06 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:47:07.215207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b0843362-f874-4ba5-8763-5e7401788374 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:07.215823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b0843362-f874-4ba5-8763-5e7401788374 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:07.222139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0843362-f874-4ba5-8763-5e7401788374 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:07.222587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0843362-f874-4ba5-8763-5e7401788374 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:07.223354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0843362-f874-4ba5-8763-5e7401788374 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:07.223792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b0843362-f874-4ba5-8763-5e7401788374 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:07.283466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b0843362-f874-4ba5-8763-5e7401788374 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:07.291330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b0843362-f874-4ba5-8763-5e7401788374 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080754 Mar 08 04:47:07.293948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1382/2716] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:07 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:08.310641 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7cf4bf34-6777-4a88-985e-da93c50a8b95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:08.311250 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7cf4bf34-6777-4a88-985e-da93c50a8b95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:08.317484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7cf4bf34-6777-4a88-985e-da93c50a8b95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:08.317963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7cf4bf34-6777-4a88-985e-da93c50a8b95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:08.318720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7cf4bf34-6777-4a88-985e-da93c50a8b95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:08.319157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7cf4bf34-6777-4a88-985e-da93c50a8b95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:08.380689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7cf4bf34-6777-4a88-985e-da93c50a8b95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:08.388296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7cf4bf34-6777-4a88-985e-da93c50a8b95 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081543 Mar 08 04:47:08.388851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1335/2717] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:08 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:09.405903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-02826002-f609-4fed-9009-757e0fb02c3a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:09.406502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-02826002-f609-4fed-9009-757e0fb02c3a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:09.412640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02826002-f609-4fed-9009-757e0fb02c3a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:09.413089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02826002-f609-4fed-9009-757e0fb02c3a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:09.413868 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02826002-f609-4fed-9009-757e0fb02c3a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:09.414311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02826002-f609-4fed-9009-757e0fb02c3a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:09.474301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-02826002-f609-4fed-9009-757e0fb02c3a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:09.482062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-02826002-f609-4fed-9009-757e0fb02c3a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080017 Mar 08 04:47:09.482624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1383/2718] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:09 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:10.499570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-846329a7-5f4b-43d7-9965-02e5fddbe93e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:10.500170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-846329a7-5f4b-43d7-9965-02e5fddbe93e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:10.506455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-846329a7-5f4b-43d7-9965-02e5fddbe93e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:10.506932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-846329a7-5f4b-43d7-9965-02e5fddbe93e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:10.507687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-846329a7-5f4b-43d7-9965-02e5fddbe93e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:10.508121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-846329a7-5f4b-43d7-9965-02e5fddbe93e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:10.568067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-846329a7-5f4b-43d7-9965-02e5fddbe93e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:10.576750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-846329a7-5f4b-43d7-9965-02e5fddbe93e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081127 Mar 08 04:47:10.577324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1336/2719] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:10 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:11.593190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c9450d13-52e5-4125-af69-c9dad665ca0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:11.593829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c9450d13-52e5-4125-af69-c9dad665ca0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:11.600043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9450d13-52e5-4125-af69-c9dad665ca0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:11.600516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9450d13-52e5-4125-af69-c9dad665ca0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:11.601271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9450d13-52e5-4125-af69-c9dad665ca0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:11.601725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9450d13-52e5-4125-af69-c9dad665ca0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:11.663318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c9450d13-52e5-4125-af69-c9dad665ca0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:11.671486 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c9450d13-52e5-4125-af69-c9dad665ca0a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082138 Mar 08 04:47:11.672045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1384/2720] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:11 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:12.688722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-349adf0a-1ac5-4a8e-a5ee-6934303fbf2a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:12.689313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-349adf0a-1ac5-4a8e-a5ee-6934303fbf2a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:12.695617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-349adf0a-1ac5-4a8e-a5ee-6934303fbf2a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:12.696056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-349adf0a-1ac5-4a8e-a5ee-6934303fbf2a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:12.696815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-349adf0a-1ac5-4a8e-a5ee-6934303fbf2a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:12.697248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-349adf0a-1ac5-4a8e-a5ee-6934303fbf2a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:12.755270 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-349adf0a-1ac5-4a8e-a5ee-6934303fbf2a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:12.763002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-349adf0a-1ac5-4a8e-a5ee-6934303fbf2a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078117 Mar 08 04:47:12.763564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1337/2721] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:12 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:47:13.780924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0ce215b2-ad36-4f9e-ac0c-fee86420d57c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:13.781496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0ce215b2-ad36-4f9e-ac0c-fee86420d57c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:13.787756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ce215b2-ad36-4f9e-ac0c-fee86420d57c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:13.788206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ce215b2-ad36-4f9e-ac0c-fee86420d57c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:13.788973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ce215b2-ad36-4f9e-ac0c-fee86420d57c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:13.790095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0ce215b2-ad36-4f9e-ac0c-fee86420d57c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:13.847872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0ce215b2-ad36-4f9e-ac0c-fee86420d57c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:13.856880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0ce215b2-ad36-4f9e-ac0c-fee86420d57c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079872 Mar 08 04:47:13.857448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1385/2722] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:13 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:14.873350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-11c288c0-1e88-42ea-ac14-91a370e7a8da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:14.873991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-11c288c0-1e88-42ea-ac14-91a370e7a8da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:14.880256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11c288c0-1e88-42ea-ac14-91a370e7a8da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:14.880708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11c288c0-1e88-42ea-ac14-91a370e7a8da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:14.881478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11c288c0-1e88-42ea-ac14-91a370e7a8da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:14.881949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-11c288c0-1e88-42ea-ac14-91a370e7a8da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:14.940657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-11c288c0-1e88-42ea-ac14-91a370e7a8da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:14.949118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-11c288c0-1e88-42ea-ac14-91a370e7a8da tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079648 Mar 08 04:47:14.949691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1338/2723] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:14 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:15.965958 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bab670ba-16c5-4865-af86-a4ffdcde70eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:15.967225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bab670ba-16c5-4865-af86-a4ffdcde70eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:15.973515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bab670ba-16c5-4865-af86-a4ffdcde70eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:15.973992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bab670ba-16c5-4865-af86-a4ffdcde70eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:15.974754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bab670ba-16c5-4865-af86-a4ffdcde70eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:15.975185 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bab670ba-16c5-4865-af86-a4ffdcde70eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:16.033514 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bab670ba-16c5-4865-af86-a4ffdcde70eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:16.041069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bab670ba-16c5-4865-af86-a4ffdcde70eb tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079129 Mar 08 04:47:16.041644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1386/2724] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:15 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:17.058144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-de8dd25b-b0f7-43ba-b118-d3e709b92bc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:17.058763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-de8dd25b-b0f7-43ba-b118-d3e709b92bc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:17.064899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de8dd25b-b0f7-43ba-b118-d3e709b92bc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:17.065344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de8dd25b-b0f7-43ba-b118-d3e709b92bc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:17.066120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de8dd25b-b0f7-43ba-b118-d3e709b92bc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:17.066554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de8dd25b-b0f7-43ba-b118-d3e709b92bc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:17.126258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-de8dd25b-b0f7-43ba-b118-d3e709b92bc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:17.133838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-de8dd25b-b0f7-43ba-b118-d3e709b92bc9 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080040 Mar 08 04:47:17.134391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1339/2725] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:17 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:18.152292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1fc07de0-9863-4cc9-b66f-3e8d4acc3d3c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:18.152854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1fc07de0-9863-4cc9-b66f-3e8d4acc3d3c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:18.158768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1fc07de0-9863-4cc9-b66f-3e8d4acc3d3c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:18.159210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1fc07de0-9863-4cc9-b66f-3e8d4acc3d3c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:18.159971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1fc07de0-9863-4cc9-b66f-3e8d4acc3d3c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:18.160402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1fc07de0-9863-4cc9-b66f-3e8d4acc3d3c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:18.221051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1fc07de0-9863-4cc9-b66f-3e8d4acc3d3c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:18.228791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1fc07de0-9863-4cc9-b66f-3e8d4acc3d3c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081333 Mar 08 04:47:18.229387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1387/2726] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:18 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:19.245317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f91de315-f0fe-4476-9d15-ed10cde25373 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:19.245948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f91de315-f0fe-4476-9d15-ed10cde25373 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:19.252208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f91de315-f0fe-4476-9d15-ed10cde25373 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:19.252661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f91de315-f0fe-4476-9d15-ed10cde25373 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:19.253421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f91de315-f0fe-4476-9d15-ed10cde25373 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:19.253900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f91de315-f0fe-4476-9d15-ed10cde25373 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:19.312361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f91de315-f0fe-4476-9d15-ed10cde25373 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:19.320108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f91de315-f0fe-4476-9d15-ed10cde25373 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078851 Mar 08 04:47:19.320675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1340/2727] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:19 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:19.977304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:47:19.977785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:47:20.336740 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cd0e22c7-89b5-4aec-8027-6dea10397c48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:20.337351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cd0e22c7-89b5-4aec-8027-6dea10397c48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:20.343681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd0e22c7-89b5-4aec-8027-6dea10397c48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:20.344135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd0e22c7-89b5-4aec-8027-6dea10397c48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:20.344897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd0e22c7-89b5-4aec-8027-6dea10397c48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:20.345333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd0e22c7-89b5-4aec-8027-6dea10397c48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:20.404002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cd0e22c7-89b5-4aec-8027-6dea10397c48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:20.411663 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cd0e22c7-89b5-4aec-8027-6dea10397c48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078824 Mar 08 04:47:20.412221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1388/2728] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:20 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:21.428829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4a9e5dd5-055a-4109-bfc8-fd4b7045d709 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:21.429466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4a9e5dd5-055a-4109-bfc8-fd4b7045d709 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:21.436511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a9e5dd5-055a-4109-bfc8-fd4b7045d709 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:21.436964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a9e5dd5-055a-4109-bfc8-fd4b7045d709 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:21.437758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a9e5dd5-055a-4109-bfc8-fd4b7045d709 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:21.438222 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a9e5dd5-055a-4109-bfc8-fd4b7045d709 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:21.496152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4a9e5dd5-055a-4109-bfc8-fd4b7045d709 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:21.503801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4a9e5dd5-055a-4109-bfc8-fd4b7045d709 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078867 Mar 08 04:47:21.504356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1341/2729] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:21 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:22.520854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7d84c80a-f570-433a-9e9a-5fdffe90c354 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:22.521513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7d84c80a-f570-433a-9e9a-5fdffe90c354 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:22.528353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d84c80a-f570-433a-9e9a-5fdffe90c354 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:22.528806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d84c80a-f570-433a-9e9a-5fdffe90c354 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:22.529568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d84c80a-f570-433a-9e9a-5fdffe90c354 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:22.530039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d84c80a-f570-433a-9e9a-5fdffe90c354 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:22.592378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7d84c80a-f570-433a-9e9a-5fdffe90c354 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:22.600436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7d84c80a-f570-433a-9e9a-5fdffe90c354 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083762 Mar 08 04:47:22.600991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1389/2730] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:22 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:23.617141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f76b382e-0ef6-4380-8a83-04010a099880 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:23.617805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f76b382e-0ef6-4380-8a83-04010a099880 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:23.624720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f76b382e-0ef6-4380-8a83-04010a099880 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:23.625166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f76b382e-0ef6-4380-8a83-04010a099880 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:23.625955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f76b382e-0ef6-4380-8a83-04010a099880 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:23.626391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f76b382e-0ef6-4380-8a83-04010a099880 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:23.684321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f76b382e-0ef6-4380-8a83-04010a099880 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:23.691967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f76b382e-0ef6-4380-8a83-04010a099880 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078687 Mar 08 04:47:23.692530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1342/2731] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:23 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:24.708306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a317de0e-af4c-4566-92aa-38be8d30656f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:24.708912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a317de0e-af4c-4566-92aa-38be8d30656f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:24.715877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a317de0e-af4c-4566-92aa-38be8d30656f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:24.716321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a317de0e-af4c-4566-92aa-38be8d30656f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:24.717077 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a317de0e-af4c-4566-92aa-38be8d30656f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:24.717509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a317de0e-af4c-4566-92aa-38be8d30656f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:24.779549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a317de0e-af4c-4566-92aa-38be8d30656f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:24.787258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a317de0e-af4c-4566-92aa-38be8d30656f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082774 Mar 08 04:47:24.787816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1390/2732] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:24 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:25.170044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:47:25.170288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:47:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:47:25.804352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-94c9e640-1fa9-425d-8493-1b61a8f7b7bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:25.804930 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-94c9e640-1fa9-425d-8493-1b61a8f7b7bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:25.811456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94c9e640-1fa9-425d-8493-1b61a8f7b7bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:25.811908 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94c9e640-1fa9-425d-8493-1b61a8f7b7bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:25.812665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94c9e640-1fa9-425d-8493-1b61a8f7b7bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:25.813099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94c9e640-1fa9-425d-8493-1b61a8f7b7bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:25.872876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-94c9e640-1fa9-425d-8493-1b61a8f7b7bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:25.880611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-94c9e640-1fa9-425d-8493-1b61a8f7b7bd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080212 Mar 08 04:47:25.881169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1343/2733] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:25 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:26.897414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-aac2f984-d3c3-4f17-8d04-7422b1f96d48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:26.898049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-aac2f984-d3c3-4f17-8d04-7422b1f96d48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:26.904340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aac2f984-d3c3-4f17-8d04-7422b1f96d48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:26.904788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aac2f984-d3c3-4f17-8d04-7422b1f96d48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:26.905547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aac2f984-d3c3-4f17-8d04-7422b1f96d48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:26.906007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aac2f984-d3c3-4f17-8d04-7422b1f96d48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:26.964199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-aac2f984-d3c3-4f17-8d04-7422b1f96d48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:26.971858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-aac2f984-d3c3-4f17-8d04-7422b1f96d48 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078527 Mar 08 04:47:26.972410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1391/2734] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:26 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:47:27.988385 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-45520be5-31a7-4403-bf9c-efeaf90b3f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:27.988989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-45520be5-31a7-4403-bf9c-efeaf90b3f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:27.995317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45520be5-31a7-4403-bf9c-efeaf90b3f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:27.995761 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45520be5-31a7-4403-bf9c-efeaf90b3f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:27.996513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45520be5-31a7-4403-bf9c-efeaf90b3f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:27.996942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-45520be5-31a7-4403-bf9c-efeaf90b3f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:28.054482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-45520be5-31a7-4403-bf9c-efeaf90b3f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:28.062221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-45520be5-31a7-4403-bf9c-efeaf90b3f4f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.077676 Mar 08 04:47:28.062783 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1344/2735] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:27 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:29.079523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1154983f-06c7-402d-9cbd-9e606a2d0a5e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:29.080133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1154983f-06c7-402d-9cbd-9e606a2d0a5e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:29.086353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1154983f-06c7-402d-9cbd-9e606a2d0a5e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:29.086797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1154983f-06c7-402d-9cbd-9e606a2d0a5e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:29.087553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1154983f-06c7-402d-9cbd-9e606a2d0a5e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:29.088074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1154983f-06c7-402d-9cbd-9e606a2d0a5e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:29.146854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1154983f-06c7-402d-9cbd-9e606a2d0a5e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:29.154530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1154983f-06c7-402d-9cbd-9e606a2d0a5e tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078883 Mar 08 04:47:29.155090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1392/2736] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:29 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:30.171615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2c7523f1-9098-49ac-9de1-de388cf0e9cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:30.172226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2c7523f1-9098-49ac-9de1-de388cf0e9cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:30.178481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2c7523f1-9098-49ac-9de1-de388cf0e9cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:30.178932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2c7523f1-9098-49ac-9de1-de388cf0e9cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:30.179691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2c7523f1-9098-49ac-9de1-de388cf0e9cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:30.180127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2c7523f1-9098-49ac-9de1-de388cf0e9cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:30.239891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2c7523f1-9098-49ac-9de1-de388cf0e9cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:30.252148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2c7523f1-9098-49ac-9de1-de388cf0e9cf tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.084074 Mar 08 04:47:30.253158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1345/2737] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:30 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:31.269524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f068bec3-7e3b-47b6-a472-552e8fd3de9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:31.270163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f068bec3-7e3b-47b6-a472-552e8fd3de9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:31.277560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f068bec3-7e3b-47b6-a472-552e8fd3de9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:31.278039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f068bec3-7e3b-47b6-a472-552e8fd3de9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:31.278803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f068bec3-7e3b-47b6-a472-552e8fd3de9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:31.279239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f068bec3-7e3b-47b6-a472-552e8fd3de9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:31.340861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f068bec3-7e3b-47b6-a472-552e8fd3de9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:31.348553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f068bec3-7e3b-47b6-a472-552e8fd3de9b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082902 Mar 08 04:47:31.349115 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1393/2738] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:31 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:32.366033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1c5678fa-2827-47db-ab75-f14eecbed902 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:32.366641 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1c5678fa-2827-47db-ab75-f14eecbed902 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:32.373754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c5678fa-2827-47db-ab75-f14eecbed902 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:32.374205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c5678fa-2827-47db-ab75-f14eecbed902 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:32.374964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c5678fa-2827-47db-ab75-f14eecbed902 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:32.375399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c5678fa-2827-47db-ab75-f14eecbed902 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:32.434231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1c5678fa-2827-47db-ab75-f14eecbed902 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:32.441918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1c5678fa-2827-47db-ab75-f14eecbed902 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079716 Mar 08 04:47:32.442472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1346/2739] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:32 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:33.458793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4eeb4d0c-dba1-4625-a6f0-ae6c3d9e71b6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:33.459359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4eeb4d0c-dba1-4625-a6f0-ae6c3d9e71b6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:33.465892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4eeb4d0c-dba1-4625-a6f0-ae6c3d9e71b6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:33.466362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4eeb4d0c-dba1-4625-a6f0-ae6c3d9e71b6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:33.467112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4eeb4d0c-dba1-4625-a6f0-ae6c3d9e71b6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:33.467541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4eeb4d0c-dba1-4625-a6f0-ae6c3d9e71b6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:33.525691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4eeb4d0c-dba1-4625-a6f0-ae6c3d9e71b6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:33.533882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4eeb4d0c-dba1-4625-a6f0-ae6c3d9e71b6 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078616 Mar 08 04:47:33.534190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1394/2740] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:33 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:34.549962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-654f83d6-6ea9-4ecf-807f-650ad0788554 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:34.550574 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-654f83d6-6ea9-4ecf-807f-650ad0788554 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:34.557036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-654f83d6-6ea9-4ecf-807f-650ad0788554 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:34.557553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-654f83d6-6ea9-4ecf-807f-650ad0788554 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:34.558337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-654f83d6-6ea9-4ecf-807f-650ad0788554 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:34.558775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-654f83d6-6ea9-4ecf-807f-650ad0788554 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:34.617877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-654f83d6-6ea9-4ecf-807f-650ad0788554 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:34.626344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-654f83d6-6ea9-4ecf-807f-650ad0788554 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080344 Mar 08 04:47:34.626900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1347/2741] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:34 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:35.643419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-577e7f6d-16c9-4d88-8ece-faa5f1407f69 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:35.644034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-577e7f6d-16c9-4d88-8ece-faa5f1407f69 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:35.651218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-577e7f6d-16c9-4d88-8ece-faa5f1407f69 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:35.651696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-577e7f6d-16c9-4d88-8ece-faa5f1407f69 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:35.652464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-577e7f6d-16c9-4d88-8ece-faa5f1407f69 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:35.652907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-577e7f6d-16c9-4d88-8ece-faa5f1407f69 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:35.712695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-577e7f6d-16c9-4d88-8ece-faa5f1407f69 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:35.720457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-577e7f6d-16c9-4d88-8ece-faa5f1407f69 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080972 Mar 08 04:47:35.721020 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1395/2742] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:35 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:36.738024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7855d9c0-7331-441b-b5f8-364c27f6d0fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:36.738739 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7855d9c0-7331-441b-b5f8-364c27f6d0fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:36.745487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7855d9c0-7331-441b-b5f8-364c27f6d0fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:36.745962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7855d9c0-7331-441b-b5f8-364c27f6d0fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:36.746725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7855d9c0-7331-441b-b5f8-364c27f6d0fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:36.747162 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7855d9c0-7331-441b-b5f8-364c27f6d0fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:36.807788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7855d9c0-7331-441b-b5f8-364c27f6d0fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:36.817773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7855d9c0-7331-441b-b5f8-364c27f6d0fc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081587 Mar 08 04:47:36.825100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1348/2743] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:36 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:37.832091 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8c94402f-ae37-43ba-a25c-e2e0fc25b4ac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:37.832618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8c94402f-ae37-43ba-a25c-e2e0fc25b4ac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:37.839099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c94402f-ae37-43ba-a25c-e2e0fc25b4ac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:37.839666 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c94402f-ae37-43ba-a25c-e2e0fc25b4ac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:37.840437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c94402f-ae37-43ba-a25c-e2e0fc25b4ac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:37.840879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c94402f-ae37-43ba-a25c-e2e0fc25b4ac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:37.902400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8c94402f-ae37-43ba-a25c-e2e0fc25b4ac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:37.910092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8c94402f-ae37-43ba-a25c-e2e0fc25b4ac tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081948 Mar 08 04:47:37.910647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1396/2744] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:37 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:38.726179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:47:38.726770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:47:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:47:38.927235 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-48834391-8651-4df7-a748-ba53f072789c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:38.927842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-48834391-8651-4df7-a748-ba53f072789c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:38.934875 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48834391-8651-4df7-a748-ba53f072789c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:38.935320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48834391-8651-4df7-a748-ba53f072789c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:38.936144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48834391-8651-4df7-a748-ba53f072789c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:38.936578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48834391-8651-4df7-a748-ba53f072789c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:38.995462 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-48834391-8651-4df7-a748-ba53f072789c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:39.003049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-48834391-8651-4df7-a748-ba53f072789c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079716 Mar 08 04:47:39.003601 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1349/2745] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:38 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:40.020597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fc3e2fa7-f7b9-4bec-9cf7-81e181ebb321 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:40.021211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fc3e2fa7-f7b9-4bec-9cf7-81e181ebb321 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:40.027502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc3e2fa7-f7b9-4bec-9cf7-81e181ebb321 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:40.027953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc3e2fa7-f7b9-4bec-9cf7-81e181ebb321 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:40.028871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc3e2fa7-f7b9-4bec-9cf7-81e181ebb321 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:40.029314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fc3e2fa7-f7b9-4bec-9cf7-81e181ebb321 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:40.088864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fc3e2fa7-f7b9-4bec-9cf7-81e181ebb321 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:40.096551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fc3e2fa7-f7b9-4bec-9cf7-81e181ebb321 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080082 Mar 08 04:47:40.097109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1397/2746] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:40 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:41.116950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-64cf7974-12f9-4aa0-a210-7b9b448b869a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:41.117494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-64cf7974-12f9-4aa0-a210-7b9b448b869a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:41.123857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64cf7974-12f9-4aa0-a210-7b9b448b869a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:41.124302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64cf7974-12f9-4aa0-a210-7b9b448b869a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:41.125057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64cf7974-12f9-4aa0-a210-7b9b448b869a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:41.125491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-64cf7974-12f9-4aa0-a210-7b9b448b869a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:41.183752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-64cf7974-12f9-4aa0-a210-7b9b448b869a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:41.191258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-64cf7974-12f9-4aa0-a210-7b9b448b869a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079504 Mar 08 04:47:41.191813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1350/2747] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:41 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:42.207915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-731b0898-3e0b-4bc4-87e1-5c61263068ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:42.208526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-731b0898-3e0b-4bc4-87e1-5c61263068ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:42.214885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-731b0898-3e0b-4bc4-87e1-5c61263068ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:42.215336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-731b0898-3e0b-4bc4-87e1-5c61263068ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:42.216101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-731b0898-3e0b-4bc4-87e1-5c61263068ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:42.216536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-731b0898-3e0b-4bc4-87e1-5c61263068ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:42.274658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-731b0898-3e0b-4bc4-87e1-5c61263068ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:42.282220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-731b0898-3e0b-4bc4-87e1-5c61263068ce tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078210 Mar 08 04:47:42.282784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1398/2748] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:42 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:43.299776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f094b0e3-4638-44ff-a7f3-8711a5484e51 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:43.300363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f094b0e3-4638-44ff-a7f3-8711a5484e51 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:43.307179 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f094b0e3-4638-44ff-a7f3-8711a5484e51 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:43.307618 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f094b0e3-4638-44ff-a7f3-8711a5484e51 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:43.308397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f094b0e3-4638-44ff-a7f3-8711a5484e51 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:43.308827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f094b0e3-4638-44ff-a7f3-8711a5484e51 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:43.366036 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f094b0e3-4638-44ff-a7f3-8711a5484e51 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:43.374657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f094b0e3-4638-44ff-a7f3-8711a5484e51 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078694 Mar 08 04:47:43.375209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1351/2749] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:43 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:44.391345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0376f505-e20d-43f6-80a1-f6b32be809d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:44.391953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0376f505-e20d-43f6-80a1-f6b32be809d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:44.398494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0376f505-e20d-43f6-80a1-f6b32be809d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:44.398939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0376f505-e20d-43f6-80a1-f6b32be809d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:44.400396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0376f505-e20d-43f6-80a1-f6b32be809d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:44.400762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0376f505-e20d-43f6-80a1-f6b32be809d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:44.461321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0376f505-e20d-43f6-80a1-f6b32be809d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:44.469806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0376f505-e20d-43f6-80a1-f6b32be809d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082301 Mar 08 04:47:44.470363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1399/2750] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:44 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:45.486640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-88e57625-6706-472d-9071-4121d5b4707d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:45.487243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-88e57625-6706-472d-9071-4121d5b4707d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:45.493467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88e57625-6706-472d-9071-4121d5b4707d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:45.494093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88e57625-6706-472d-9071-4121d5b4707d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:45.494856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88e57625-6706-472d-9071-4121d5b4707d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:45.495295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88e57625-6706-472d-9071-4121d5b4707d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:45.555343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-88e57625-6706-472d-9071-4121d5b4707d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:45.563115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-88e57625-6706-472d-9071-4121d5b4707d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080341 Mar 08 04:47:45.563664 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1352/2751] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:45 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:46.579889 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cc184a21-3679-48f0-8ac5-796cac095948 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:46.580489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cc184a21-3679-48f0-8ac5-796cac095948 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:46.586751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc184a21-3679-48f0-8ac5-796cac095948 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:46.587597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc184a21-3679-48f0-8ac5-796cac095948 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:46.588521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc184a21-3679-48f0-8ac5-796cac095948 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:46.588955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cc184a21-3679-48f0-8ac5-796cac095948 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:46.648388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cc184a21-3679-48f0-8ac5-796cac095948 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:46.656720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cc184a21-3679-48f0-8ac5-796cac095948 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.080728 Mar 08 04:47:46.657267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1400/2752] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:46 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:47.673490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-63fe2ee0-69e2-47b2-bd9f-3cc4682650a3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:47.674131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-63fe2ee0-69e2-47b2-bd9f-3cc4682650a3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:47.680398 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-63fe2ee0-69e2-47b2-bd9f-3cc4682650a3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:47.681486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-63fe2ee0-69e2-47b2-bd9f-3cc4682650a3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:47.682278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-63fe2ee0-69e2-47b2-bd9f-3cc4682650a3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:47.682717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-63fe2ee0-69e2-47b2-bd9f-3cc4682650a3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:47.740570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-63fe2ee0-69e2-47b2-bd9f-3cc4682650a3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:47.748896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-63fe2ee0-69e2-47b2-bd9f-3cc4682650a3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079211 Mar 08 04:47:47.749467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1353/2753] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:47 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:48.766356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f3d5a1fb-040a-4f85-8dd4-c47f67070e01 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:48.766965 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f3d5a1fb-040a-4f85-8dd4-c47f67070e01 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:48.773228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f3d5a1fb-040a-4f85-8dd4-c47f67070e01 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:48.773694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f3d5a1fb-040a-4f85-8dd4-c47f67070e01 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:48.774463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f3d5a1fb-040a-4f85-8dd4-c47f67070e01 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:48.775024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f3d5a1fb-040a-4f85-8dd4-c47f67070e01 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:48.835478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f3d5a1fb-040a-4f85-8dd4-c47f67070e01 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:48.843902 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f3d5a1fb-040a-4f85-8dd4-c47f67070e01 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.081395 Mar 08 04:47:48.844465 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1401/2754] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:48 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:49.860278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-db312a55-3105-479b-b71f-d3d40f329d7f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:49.860889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-db312a55-3105-479b-b71f-d3d40f329d7f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:49.867169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db312a55-3105-479b-b71f-d3d40f329d7f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:49.867621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db312a55-3105-479b-b71f-d3d40f329d7f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:49.869075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db312a55-3105-479b-b71f-d3d40f329d7f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:49.869520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-db312a55-3105-479b-b71f-d3d40f329d7f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:49.927550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-db312a55-3105-479b-b71f-d3d40f329d7f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:49.935920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-db312a55-3105-479b-b71f-d3d40f329d7f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079506 Mar 08 04:47:49.936480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1354/2755] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:49 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:50.953155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a1f83503-d55b-4b9a-b447-70acaa4ba20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:50.953812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a1f83503-d55b-4b9a-b447-70acaa4ba20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:50.960142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1f83503-d55b-4b9a-b447-70acaa4ba20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:50.960595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1f83503-d55b-4b9a-b447-70acaa4ba20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:50.961356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1f83503-d55b-4b9a-b447-70acaa4ba20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:50.961833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a1f83503-d55b-4b9a-b447-70acaa4ba20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:51.027055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a1f83503-d55b-4b9a-b447-70acaa4ba20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:51.034789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a1f83503-d55b-4b9a-b447-70acaa4ba20a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.085473 Mar 08 04:47:51.035350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1402/2756] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:50 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:52.051771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4a5f5849-1b23-4d5d-8305-2be77770a5db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:52.052375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4a5f5849-1b23-4d5d-8305-2be77770a5db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:52.058647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a5f5849-1b23-4d5d-8305-2be77770a5db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:52.059094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a5f5849-1b23-4d5d-8305-2be77770a5db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:52.059869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a5f5849-1b23-4d5d-8305-2be77770a5db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:52.060284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a5f5849-1b23-4d5d-8305-2be77770a5db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:52.118778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4a5f5849-1b23-4d5d-8305-2be77770a5db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:52.126323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4a5f5849-1b23-4d5d-8305-2be77770a5db tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078404 Mar 08 04:47:52.126870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1355/2757] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:52 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:53.148263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-23d5aa39-d747-4130-926a-4822401c8310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:53.148809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-23d5aa39-d747-4130-926a-4822401c8310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:53.156618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23d5aa39-d747-4130-926a-4822401c8310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:53.157072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23d5aa39-d747-4130-926a-4822401c8310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:53.157879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23d5aa39-d747-4130-926a-4822401c8310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:53.158324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23d5aa39-d747-4130-926a-4822401c8310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:53.222879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-23d5aa39-d747-4130-926a-4822401c8310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:53.231107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-23d5aa39-d747-4130-926a-4822401c8310 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.091364 Mar 08 04:47:53.231664 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1403/2758] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:53 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:54.248346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d7af2e18-5a74-44ac-b82d-2d4f5bc0e70a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:54.248958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d7af2e18-5a74-44ac-b82d-2d4f5bc0e70a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:54.255189 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7af2e18-5a74-44ac-b82d-2d4f5bc0e70a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:54.255655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7af2e18-5a74-44ac-b82d-2d4f5bc0e70a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:54.256390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7af2e18-5a74-44ac-b82d-2d4f5bc0e70a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:54.256828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d7af2e18-5a74-44ac-b82d-2d4f5bc0e70a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:54.315080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d7af2e18-5a74-44ac-b82d-2d4f5bc0e70a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:54.322794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d7af2e18-5a74-44ac-b82d-2d4f5bc0e70a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078268 Mar 08 04:47:54.323346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1356/2759] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:54 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:55.340027 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-02f871df-bb34-4116-afa0-4b6201cc1f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:55.340667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-02f871df-bb34-4116-afa0-4b6201cc1f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:55.346907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02f871df-bb34-4116-afa0-4b6201cc1f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:55.347358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02f871df-bb34-4116-afa0-4b6201cc1f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:55.348114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02f871df-bb34-4116-afa0-4b6201cc1f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:55.348553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-02f871df-bb34-4116-afa0-4b6201cc1f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:55.377677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:47:55.378184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 04:47:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:47:55.406942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-02f871df-bb34-4116-afa0-4b6201cc1f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:55.414613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-02f871df-bb34-4116-afa0-4b6201cc1f2f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.078495 Mar 08 04:47:55.415174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1404/2760] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:55 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:56.431291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7316aeb6-c174-4b5f-b847-bbd4239e0679 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:56.431876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7316aeb6-c174-4b5f-b847-bbd4239e0679 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:56.438118 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7316aeb6-c174-4b5f-b847-bbd4239e0679 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:56.438564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7316aeb6-c174-4b5f-b847-bbd4239e0679 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:56.439316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7316aeb6-c174-4b5f-b847-bbd4239e0679 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:56.439746 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7316aeb6-c174-4b5f-b847-bbd4239e0679 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:56.507811 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7316aeb6-c174-4b5f-b847-bbd4239e0679 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:56.515450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7316aeb6-c174-4b5f-b847-bbd4239e0679 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.088027 Mar 08 04:47:56.515995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1357/2761] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:56 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:57.532213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5c017384-4b90-44c7-af8d-d99a6e7a1cfd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:57.532822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5c017384-4b90-44c7-af8d-d99a6e7a1cfd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:57.539205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c017384-4b90-44c7-af8d-d99a6e7a1cfd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:57.539661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c017384-4b90-44c7-af8d-d99a6e7a1cfd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:57.540575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c017384-4b90-44c7-af8d-d99a6e7a1cfd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:57.541015 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c017384-4b90-44c7-af8d-d99a6e7a1cfd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:57.603110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5c017384-4b90-44c7-af8d-d99a6e7a1cfd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:57.610970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5c017384-4b90-44c7-af8d-d99a6e7a1cfd tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082658 Mar 08 04:47:57.611525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1405/2762] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:57 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:58.628255 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c72e5d7d-87d3-42e0-bd6a-74b35f23fafe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:58.628867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c72e5d7d-87d3-42e0-bd6a-74b35f23fafe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:58.635867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c72e5d7d-87d3-42e0-bd6a-74b35f23fafe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:58.636346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c72e5d7d-87d3-42e0-bd6a-74b35f23fafe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:58.637107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c72e5d7d-87d3-42e0-bd6a-74b35f23fafe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:58.637542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c72e5d7d-87d3-42e0-bd6a-74b35f23fafe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:58.695126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c72e5d7d-87d3-42e0-bd6a-74b35f23fafe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:58.703558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c72e5d7d-87d3-42e0-bd6a-74b35f23fafe tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.079127 Mar 08 04:47:58.704115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1358/2763] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:58 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:47:59.721009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7c93caee-5b14-4368-8021-03273e965270 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:47:59.721640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7c93caee-5b14-4368-8021-03273e965270 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:47:59.728752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c93caee-5b14-4368-8021-03273e965270 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:59.729204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c93caee-5b14-4368-8021-03273e965270 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:59.730019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c93caee-5b14-4368-8021-03273e965270 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:47:59.730458 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7c93caee-5b14-4368-8021-03273e965270 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:47:59.792348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7c93caee-5b14-4368-8021-03273e965270 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:47:59.801028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7c93caee-5b14-4368-8021-03273e965270 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.083915 Mar 08 04:47:59.801596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1406/2764] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:47:59 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:00.819402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-721114ad-9e3a-4a45-a114-07a1255e6586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:00.820028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-721114ad-9e3a-4a45-a114-07a1255e6586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:00.827133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-721114ad-9e3a-4a45-a114-07a1255e6586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:00.827584 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-721114ad-9e3a-4a45-a114-07a1255e6586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:00.828347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-721114ad-9e3a-4a45-a114-07a1255e6586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:00.828786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-721114ad-9e3a-4a45-a114-07a1255e6586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:00.889949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-721114ad-9e3a-4a45-a114-07a1255e6586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:00.897895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-721114ad-9e3a-4a45-a114-07a1255e6586 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 200 len: 1368 microversion: 2.1 time: 0.082996 Mar 08 04:48:00.898458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1359/2765] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:00 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:00.915060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ced72b79-f87a-44f2-8cea-c6b929fa0d92 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '.version_select at 0x7fe83253dca0>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:00.934638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ced72b79-f87a-44f2-8cea-c6b929fa0d92 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806070730" status: 202 len: 0 microversion: 2.1 time: 0.023393 Mar 08 04:48:00.935174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1407/2766] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Mar 8 04:48:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806070730 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:48:01.709213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ccc2eb32-516d-4fb4-96ec-1be51f6e249a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'create', calling method: .version_select at 0x7fe8370ac700>, body: {"keypair": {"name": "tempest-keypair-1711824141"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:48:01.723259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-ccc2eb32-516d-4fb4-96ec-1be51f6e249a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:48:01.727487 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-ccc2eb32-516d-4fb4-96ec-1be51f6e249a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for user d3686d5d0c5e43a29d52b8b39bbae64d and project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:48:01.835154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-ccc2eb32-516d-4fb4-96ec-1be51f6e249a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:48:01.838742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-ccc2eb32-516d-4fb4-96ec-1be51f6e249a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for user d3686d5d0c5e43a29d52b8b39bbae64d and project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:48:01.851168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ccc2eb32-516d-4fb4-96ec-1be51f6e249a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.145977 Mar 08 04:48:01.851735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1360/2767] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 04:48:01 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:03.271271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1279415346", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa7eb933-ce1c-4920-9f24-6c3ac1756130"}], "security_groups": [{"name": "tempest-securitygroup--1784805617"}], "key_name": "tempest-keypair-1711824141", "user_data": "}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:48:03.369219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] validate_networks() for [('fa7eb933-ce1c-4920-9f24-6c3ac1756130', None, None, None, None, None)] {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:48:03.757361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:48:03.757805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:48:03.758309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:48:03.758712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:48:03.759120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:48:03.768086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:03.768527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:03.769317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:03.770035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:03.785734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:48:03.789518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Getting quotas for user d3686d5d0c5e43a29d52b8b39bbae64d and project 78f34ab0c91a4b3e9ccf9a201daab904. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:48:03.800593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:48:03.802986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:48:03.851735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-79dbcaba-a8b3-45d8-955f-4bee801cbe8d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.585624 Mar 08 04:48:03.852539 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1408/2768] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:48:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:48:03.863208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9153160b-c339-4185-ba03-61c641e0da98 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:03.863813 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9153160b-c339-4185-ba03-61c641e0da98 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:03.919677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9153160b-c339-4185-ba03-61c641e0da98 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:03.926298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9153160b-c339-4185-ba03-61c641e0da98 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1238 microversion: 2.1 time: 0.067363 Mar 08 04:48:03.926848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1361/2769] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:03 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:04.944149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ce3ed467-458c-49e7-9ce1-4c9288267d2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:04.944800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ce3ed467-458c-49e7-9ce1-4c9288267d2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:04.951977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce3ed467-458c-49e7-9ce1-4c9288267d2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:04.952427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce3ed467-458c-49e7-9ce1-4c9288267d2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:04.953200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce3ed467-458c-49e7-9ce1-4c9288267d2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:04.953671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce3ed467-458c-49e7-9ce1-4c9288267d2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:05.014356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ce3ed467-458c-49e7-9ce1-4c9288267d2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:05.021970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ce3ed467-458c-49e7-9ce1-4c9288267d2b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1296 microversion: 2.1 time: 0.082186 Mar 08 04:48:05.022846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1409/2770] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:04 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:06.039612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2eb01802-25c4-4b2e-8772-b3367c4cc45f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:06.040227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2eb01802-25c4-4b2e-8772-b3367c4cc45f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:06.046114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2eb01802-25c4-4b2e-8772-b3367c4cc45f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:06.046744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2eb01802-25c4-4b2e-8772-b3367c4cc45f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:06.047523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2eb01802-25c4-4b2e-8772-b3367c4cc45f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:06.047965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2eb01802-25c4-4b2e-8772-b3367c4cc45f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:06.150460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-29a87a54-5fb3-498c-8e3c-2703d6fbf002 req-3561679a-6777-4ed1-b1df-c24b07d2b5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb2c3ec-cdda-41fd-ae30-d3d636d41896", "tag": "13ceff6e-d742-42c3-8580-fb70f3cd48ee"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:48:06.163210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-29a87a54-5fb3-498c-8e3c-2703d6fbf002 req-3561679a-6777-4ed1-b1df-c24b07d2b5fe service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:06.163921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-29a87a54-5fb3-498c-8e3c-2703d6fbf002 req-3561679a-6777-4ed1-b1df-c24b07d2b5fe service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:06.180108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-29a87a54-5fb3-498c-8e3c-2703d6fbf002 req-3561679a-6777-4ed1-b1df-c24b07d2b5fe service nova] Creating event network-changed:13ceff6e-d742-42c3-8580-fb70f3cd48ee for instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 on hv-cinder-73306 Mar 08 04:48:06.187371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-29a87a54-5fb3-498c-8e3c-2703d6fbf002 req-3561679a-6777-4ed1-b1df-c24b07d2b5fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117021 Mar 08 04:48:06.188666 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1410/2771] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:48:06.211132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2eb01802-25c4-4b2e-8772-b3367c4cc45f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:06.220403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2eb01802-25c4-4b2e-8772-b3367c4cc45f tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1364 microversion: 2.1 time: 0.184741 Mar 08 04:48:06.221576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1362/2772] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:06 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:07.239023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-90e1339e-d034-493a-95ae-53d7ff7623f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:07.239721 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-90e1339e-d034-493a-95ae-53d7ff7623f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:07.246533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-90e1339e-d034-493a-95ae-53d7ff7623f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:07.246968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-90e1339e-d034-493a-95ae-53d7ff7623f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:07.247719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-90e1339e-d034-493a-95ae-53d7ff7623f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:07.248152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-90e1339e-d034-493a-95ae-53d7ff7623f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:07.381362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-90e1339e-d034-493a-95ae-53d7ff7623f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:07.389257 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-90e1339e-d034-493a-95ae-53d7ff7623f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1364 microversion: 2.1 time: 0.154866 Mar 08 04:48:07.389834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1411/2773] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:07 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:08.406011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-de0f883f-2af4-494f-b80e-efa9dce1c2e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:08.406614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-de0f883f-2af4-494f-b80e-efa9dce1c2e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:08.412818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de0f883f-2af4-494f-b80e-efa9dce1c2e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:08.413259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de0f883f-2af4-494f-b80e-efa9dce1c2e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:08.414049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de0f883f-2af4-494f-b80e-efa9dce1c2e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:08.414478 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-de0f883f-2af4-494f-b80e-efa9dce1c2e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:08.547123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-de0f883f-2af4-494f-b80e-efa9dce1c2e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:08.554251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-de0f883f-2af4-494f-b80e-efa9dce1c2e8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1364 microversion: 2.1 time: 0.152086 Mar 08 04:48:08.554808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1363/2774] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:08 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:09.571301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b331f056-2b2c-4d19-8396-3dbcd70c209a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:09.571914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b331f056-2b2c-4d19-8396-3dbcd70c209a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:09.578527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b331f056-2b2c-4d19-8396-3dbcd70c209a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:09.578977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b331f056-2b2c-4d19-8396-3dbcd70c209a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:09.579797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b331f056-2b2c-4d19-8396-3dbcd70c209a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:09.580234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b331f056-2b2c-4d19-8396-3dbcd70c209a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:09.707236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b331f056-2b2c-4d19-8396-3dbcd70c209a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:09.714879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b331f056-2b2c-4d19-8396-3dbcd70c209a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1364 microversion: 2.1 time: 0.147435 Mar 08 04:48:09.715439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1412/2775] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:09 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:10.730935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8ea48d74-439b-4596-90b7-2f1177d4b4f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:10.731531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8ea48d74-439b-4596-90b7-2f1177d4b4f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:10.737777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ea48d74-439b-4596-90b7-2f1177d4b4f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:10.738228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ea48d74-439b-4596-90b7-2f1177d4b4f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:10.738981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ea48d74-439b-4596-90b7-2f1177d4b4f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:10.739414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8ea48d74-439b-4596-90b7-2f1177d4b4f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:10.872003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8ea48d74-439b-4596-90b7-2f1177d4b4f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:10.879168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8ea48d74-439b-4596-90b7-2f1177d4b4f8 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1364 microversion: 2.1 time: 0.152114 Mar 08 04:48:10.879724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1364/2776] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:10 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:11.165033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-f1df0041-db54-4c71-b636-71155aa5c1a7 req-435c0ef3-5a6b-4655-952e-1ec078057d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb2c3ec-cdda-41fd-ae30-d3d636d41896", "name": "network-vif-plugged", "status": "completed", "tag": "13ceff6e-d742-42c3-8580-fb70f3cd48ee"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:48:11.173882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-f1df0041-db54-4c71-b636-71155aa5c1a7 req-435c0ef3-5a6b-4655-952e-1ec078057d71 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:11.174333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-f1df0041-db54-4c71-b636-71155aa5c1a7 req-435c0ef3-5a6b-4655-952e-1ec078057d71 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:11.185719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-f1df0041-db54-4c71-b636-71155aa5c1a7 req-435c0ef3-5a6b-4655-952e-1ec078057d71 service nova] Creating event network-vif-plugged:13ceff6e-d742-42c3-8580-fb70f3cd48ee for instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 on hv-cinder-73306 Mar 08 04:48:11.190568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-f1df0041-db54-4c71-b636-71155aa5c1a7 req-435c0ef3-5a6b-4655-952e-1ec078057d71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083639 Mar 08 04:48:11.191142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1413/2777] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:48:11.897221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d1f6317e-58d1-48c4-aa52-e3584b291b59 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:11.897859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d1f6317e-58d1-48c4-aa52-e3584b291b59 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:11.904334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1f6317e-58d1-48c4-aa52-e3584b291b59 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:11.904780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1f6317e-58d1-48c4-aa52-e3584b291b59 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:11.905539 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1f6317e-58d1-48c4-aa52-e3584b291b59 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:11.906006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1f6317e-58d1-48c4-aa52-e3584b291b59 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:12.033938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d1f6317e-58d1-48c4-aa52-e3584b291b59 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:12.041639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d1f6317e-58d1-48c4-aa52-e3584b291b59 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1364 microversion: 2.1 time: 0.148479 Mar 08 04:48:12.042233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1365/2778] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:11 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:13.059224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3f39cd20-08ee-4a67-ace8-90860ce79e50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:13.059922 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3f39cd20-08ee-4a67-ace8-90860ce79e50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:13.065993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f39cd20-08ee-4a67-ace8-90860ce79e50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:13.066441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f39cd20-08ee-4a67-ace8-90860ce79e50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:13.067198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f39cd20-08ee-4a67-ace8-90860ce79e50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:13.067636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f39cd20-08ee-4a67-ace8-90860ce79e50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:13.200338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3f39cd20-08ee-4a67-ace8-90860ce79e50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:48:13.207552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3f39cd20-08ee-4a67-ace8-90860ce79e50 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1549 microversion: 2.1 time: 0.153054 Mar 08 04:48:13.208112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1414/2779] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:48:13 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:48:13.223934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-92c16f3a-d4e8-40cc-9d10-45a4475383e4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:13.224419 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-92c16f3a-d4e8-40cc-9d10-45a4475383e4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:13.230731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92c16f3a-d4e8-40cc-9d10-45a4475383e4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:13.231183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92c16f3a-d4e8-40cc-9d10-45a4475383e4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:13.231942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92c16f3a-d4e8-40cc-9d10-45a4475383e4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:13.232376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-92c16f3a-d4e8-40cc-9d10-45a4475383e4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:13.312131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-92c16f3a-d4e8-40cc-9d10-45a4475383e4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091948 Mar 08 04:48:13.312725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1366/2780] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 04:48:13 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:48:14.288270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-ce9619cb-8af6-4774-b6a8-783a89fa9170 req-313f59c7-3b17-44cc-8884-b4ebac7be13f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb2c3ec-cdda-41fd-ae30-d3d636d41896", "tag": "13ceff6e-d742-42c3-8580-fb70f3cd48ee"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:48:14.296111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-ce9619cb-8af6-4774-b6a8-783a89fa9170 req-313f59c7-3b17-44cc-8884-b4ebac7be13f service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:14.296554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-ce9619cb-8af6-4774-b6a8-783a89fa9170 req-313f59c7-3b17-44cc-8884-b4ebac7be13f service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:14.307245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-ce9619cb-8af6-4774-b6a8-783a89fa9170 req-313f59c7-3b17-44cc-8884-b4ebac7be13f service nova] Creating event network-changed:13ceff6e-d742-42c3-8580-fb70f3cd48ee for instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 on hv-cinder-73306 Mar 08 04:48:14.312461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-ce9619cb-8af6-4774-b6a8-783a89fa9170 req-313f59c7-3b17-44cc-8884-b4ebac7be13f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075871 Mar 08 04:48:14.313060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1415/2781] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:48:43.805553 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-24d495e8-bdec-4eea-a2e1-dda41242e80c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:48:43.806775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-24d495e8-bdec-4eea-a2e1-dda41242e80c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:48:43.812652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-24d495e8-bdec-4eea-a2e1-dda41242e80c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:43.813099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-24d495e8-bdec-4eea-a2e1-dda41242e80c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:43.813896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-24d495e8-bdec-4eea-a2e1-dda41242e80c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:48:43.814339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-24d495e8-bdec-4eea-a2e1-dda41242e80c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:48:43.836629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-24d495e8-bdec-4eea-a2e1-dda41242e80c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/ips" status: 200 len: 145 microversion: 2.1 time: 0.035523 Mar 08 04:48:43.837120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1367/2782] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:48:43 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:49:09.898367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a590d5de-4090-4546-bf00-7489d9f5e0df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:09.898960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a590d5de-4090-4546-bf00-7489d9f5e0df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:09.905384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a590d5de-4090-4546-bf00-7489d9f5e0df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:09.905867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a590d5de-4090-4546-bf00-7489d9f5e0df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:09.906639 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a590d5de-4090-4546-bf00-7489d9f5e0df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:09.907083 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a590d5de-4090-4546-bf00-7489d9f5e0df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:09.932245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a590d5de-4090-4546-bf00-7489d9f5e0df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Going to try to terminate instance {{(pid=116774) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:49:09.932443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4da60ed8-42cd-477d-b05b-51889d39b815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:09.932920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4da60ed8-42cd-477d-b05b-51889d39b815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:09.939227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4da60ed8-42cd-477d-b05b-51889d39b815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:09.939674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4da60ed8-42cd-477d-b05b-51889d39b815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:09.940436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4da60ed8-42cd-477d-b05b-51889d39b815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:09.940868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4da60ed8-42cd-477d-b05b-51889d39b815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:09.964656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4da60ed8-42cd-477d-b05b-51889d39b815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:49:10.026150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a590d5de-4090-4546-bf00-7489d9f5e0df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "DELETE /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 204 len: 0 microversion: 2.1 time: 0.132398 Mar 08 04:49:10.027472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1416/2783] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:49:09 2022] DELETE /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:49:10.036360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a65c5ed3-e96a-439c-9a45-1b7bcfd2eedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:10.037129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a65c5ed3-e96a-439c-9a45-1b7bcfd2eedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:10.043792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a65c5ed3-e96a-439c-9a45-1b7bcfd2eedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:10.044254 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a65c5ed3-e96a-439c-9a45-1b7bcfd2eedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:10.045038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a65c5ed3-e96a-439c-9a45-1b7bcfd2eedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:10.045483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a65c5ed3-e96a-439c-9a45-1b7bcfd2eedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:10.063855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4da60ed8-42cd-477d-b05b-51889d39b815 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 204 len: 0 microversion: 2.1 time: 0.134888 Mar 08 04:49:10.064620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1368/2784] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:49:09 2022] DELETE /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 04:49:10.077161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-603d4a6d-d586-4f28-8fda-b54c7a01e9a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:10.078154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-603d4a6d-d586-4f28-8fda-b54c7a01e9a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:10.084131 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-603d4a6d-d586-4f28-8fda-b54c7a01e9a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:10.084581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-603d4a6d-d586-4f28-8fda-b54c7a01e9a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:10.085352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-603d4a6d-d586-4f28-8fda-b54c7a01e9a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:10.085815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-603d4a6d-d586-4f28-8fda-b54c7a01e9a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:10.492061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a65c5ed3-e96a-439c-9a45-1b7bcfd2eedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:10.496171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-603d4a6d-d586-4f28-8fda-b54c7a01e9a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:10.499509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a65c5ed3-e96a-439c-9a45-1b7bcfd2eedf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1506 microversion: 2.1 time: 0.467394 Mar 08 04:49:10.500302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1417/2785] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:10 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:10.503742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-603d4a6d-d586-4f28-8fda-b54c7a01e9a2 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1682 microversion: 2.1 time: 0.434650 Mar 08 04:49:10.504361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1369/2786] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:10 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1682 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:49:11.454838 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-16d15a55-5271-43b6-a1cf-a52defd8b0b5 req-d5a7f110-4f8d-46f7-9539-d76ae82b7594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998094f1-0e7d-45da-8f63-429d4e948433", "name": "network-vif-deleted", "tag": "150dc7cc-552b-4c7c-a610-2004d5fef4d0"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:49:11.484796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-16d15a55-5271-43b6-a1cf-a52defd8b0b5 req-d5a7f110-4f8d-46f7-9539-d76ae82b7594 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:11.488107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-16d15a55-5271-43b6-a1cf-a52defd8b0b5 req-d5a7f110-4f8d-46f7-9539-d76ae82b7594 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:11.505367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-16d15a55-5271-43b6-a1cf-a52defd8b0b5 req-d5a7f110-4f8d-46f7-9539-d76ae82b7594 service nova] Creating event network-vif-deleted:150dc7cc-552b-4c7c-a610-2004d5fef4d0 for instance 998094f1-0e7d-45da-8f63-429d4e948433 on hv-cinder-73306 Mar 08 04:49:11.514120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-16d15a55-5271-43b6-a1cf-a52defd8b0b5 req-d5a7f110-4f8d-46f7-9539-d76ae82b7594 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066737 Mar 08 04:49:11.514999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1418/2787] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:49:11.519361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:11.520099 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:11.522697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-867bbd6f-150e-4f6f-98b8-1f7b2b72a27c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:11.523883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-867bbd6f-150e-4f6f-98b8-1f7b2b72a27c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:11.530881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:11.531460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:11.532395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:11.532559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-867bbd6f-150e-4f6f-98b8-1f7b2b72a27c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:11.532898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-867bbd6f-150e-4f6f-98b8-1f7b2b72a27c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:11.533457 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:11.533864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-867bbd6f-150e-4f6f-98b8-1f7b2b72a27c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:11.534713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-867bbd6f-150e-4f6f-98b8-1f7b2b72a27c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:11.572033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:11.572834 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:11.573538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lazy-loading 'fault' on Instance uuid 998094f1-0e7d-45da-8f63-429d4e948433 {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:49:11.623519 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-867bbd6f-150e-4f6f-98b8-1f7b2b72a27c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:11.631788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-867bbd6f-150e-4f6f-98b8-1f7b2b72a27c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 200 len: 1614 microversion: 2.1 time: 0.114058 Mar 08 04:49:11.642199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1419/2788] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:11 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 1614 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:49:11.642588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:11.649414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7084b528-dfc5-41f8-95af-d3b8a0903a03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 200 len: 1311 microversion: 2.1 time: 0.136158 Mar 08 04:49:11.650026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1370/2789] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:11 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 1311 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:12.650203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a0d1f560-1d19-4807-ac45-80c308253d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:12.650741 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a0d1f560-1d19-4807-ac45-80c308253d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:12.657763 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d1f560-1d19-4807-ac45-80c308253d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:12.658208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d1f560-1d19-4807-ac45-80c308253d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:12.658977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d1f560-1d19-4807-ac45-80c308253d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:12.659407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a0d1f560-1d19-4807-ac45-80c308253d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:12.667312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-65f2f9c3-177f-4ae9-aaf6-8f3cd642d1dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:12.669229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-65f2f9c3-177f-4ae9-aaf6-8f3cd642d1dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 998094f1-0e7d-45da-8f63-429d4e948433] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:12.673468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-a0d1f560-1d19-4807-ac45-80c308253d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 could not be found. Mar 08 04:49:12.674086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a0d1f560-1d19-4807-ac45-80c308253d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:49:12.674903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a0d1f560-1d19-4807-ac45-80c308253d12 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 404 len: 111 microversion: 2.1 time: 0.028661 Mar 08 04:49:12.675445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1420/2790] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:12 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:49:12.676351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-65f2f9c3-177f-4ae9-aaf6-8f3cd642d1dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:12.676925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-65f2f9c3-177f-4ae9-aaf6-8f3cd642d1dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:12.677839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-65f2f9c3-177f-4ae9-aaf6-8f3cd642d1dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:12.678414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-65f2f9c3-177f-4ae9-aaf6-8f3cd642d1dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:12.683317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1818674f-6362-4da2-a409-628f0dd7b759 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '.version_select at 0x7fe83712b040>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:12.694278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-65f2f9c3-177f-4ae9-aaf6-8f3cd642d1dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] HTTP exception thrown: Instance 998094f1-0e7d-45da-8f63-429d4e948433 could not be found. Mar 08 04:49:12.695097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-65f2f9c3-177f-4ae9-aaf6-8f3cd642d1dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Returning 404 to user: Instance 998094f1-0e7d-45da-8f63-429d4e948433 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:49:12.696082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-65f2f9c3-177f-4ae9-aaf6-8f3cd642d1dc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433" status: 404 len: 111 microversion: 2.1 time: 0.032708 Mar 08 04:49:12.696642 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1371/2791] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:12 2022] GET /compute/v2.1/servers/998094f1-0e7d-45da-8f63-429d4e948433 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:49:12.702298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1818674f-6362-4da2-a409-628f0dd7b759 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1351077523" status: 202 len: 0 microversion: 2.1 time: 0.022269 Mar 08 04:49:12.703071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1421/2792] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Mar 8 04:49:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1351077523 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:49:12.705341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-eb4e4024-7985-486d-b5ff-11895dd46fb8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:12.712859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eb4e4024-7985-486d-b5ff-11895dd46fb8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:12.719451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb4e4024-7985-486d-b5ff-11895dd46fb8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:12.719905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb4e4024-7985-486d-b5ff-11895dd46fb8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:12.720689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb4e4024-7985-486d-b5ff-11895dd46fb8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:12.721615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb4e4024-7985-486d-b5ff-11895dd46fb8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:12.753453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eb4e4024-7985-486d-b5ff-11895dd46fb8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:49:12.845002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eb4e4024-7985-486d-b5ff-11895dd46fb8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 204 len: 0 microversion: 2.1 time: 0.142927 Mar 08 04:49:12.845969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1372/2793] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:49:12 2022] DELETE /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 04:49:12.857226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f4eae7b4-90ce-46af-8b78-c966aaf87482 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:12.857944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f4eae7b4-90ce-46af-8b78-c966aaf87482 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:12.866734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4eae7b4-90ce-46af-8b78-c966aaf87482 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:12.867183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4eae7b4-90ce-46af-8b78-c966aaf87482 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:12.867953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4eae7b4-90ce-46af-8b78-c966aaf87482 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:12.868500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f4eae7b4-90ce-46af-8b78-c966aaf87482 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:13.016599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f4eae7b4-90ce-46af-8b78-c966aaf87482 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:13.024932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f4eae7b4-90ce-46af-8b78-c966aaf87482 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1568 microversion: 2.1 time: 0.173959 Mar 08 04:49:13.025581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1422/2794] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:13.349089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4ad10080-8495-4043-af88-695187127e04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: .version_select at 0x7fe8370acd30>, body: {"keypair": {"name": "tempest-keypair-263164407"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:49:13.363165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-4ad10080-8495-4043-af88-695187127e04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:49:13.366952 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-4ad10080-8495-4043-af88-695187127e04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:49:13.564978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-295a8156-3f88-41bc-b2c7-7ed17b57853d req-cd64089d-e6b2-49cf-acb2-983cd093c1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b7df88-e3f5-4a15-9f5f-499bb4a48194", "name": "network-vif-deleted", "tag": "ea01d2d4-9a5e-4fb9-93bf-72602e913d51"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:49:13.579461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-295a8156-3f88-41bc-b2c7-7ed17b57853d req-cd64089d-e6b2-49cf-acb2-983cd093c1dc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:13.581060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-295a8156-3f88-41bc-b2c7-7ed17b57853d req-cd64089d-e6b2-49cf-acb2-983cd093c1dc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:13.612105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-295a8156-3f88-41bc-b2c7-7ed17b57853d req-cd64089d-e6b2-49cf-acb2-983cd093c1dc service nova] Creating event network-vif-deleted:ea01d2d4-9a5e-4fb9-93bf-72602e913d51 for instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 on hv-cinder-73306 Mar 08 04:49:13.619960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-295a8156-3f88-41bc-b2c7-7ed17b57853d req-cd64089d-e6b2-49cf-acb2-983cd093c1dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062833 Mar 08 04:49:13.620911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1423/2795] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:49:13.627562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-e480dffb-2ae0-4f04-9018-e602021a426d req-d1d7e86b-172f-4f87-bf50-cc118658579a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f53eaeb-7b60-4548-bea0-fafe6e0c6a22", "name": "network-vif-unplugged", "status": "completed", "tag": "1c2dfd82-b52c-4418-8169-51f288073d7b"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:49:13.637040 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-e480dffb-2ae0-4f04-9018-e602021a426d req-d1d7e86b-172f-4f87-bf50-cc118658579a service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:13.637799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-e480dffb-2ae0-4f04-9018-e602021a426d req-d1d7e86b-172f-4f87-bf50-cc118658579a service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:13.651130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-e480dffb-2ae0-4f04-9018-e602021a426d req-d1d7e86b-172f-4f87-bf50-cc118658579a service nova] Creating event network-vif-unplugged:1c2dfd82-b52c-4418-8169-51f288073d7b for instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 on hv-cinder-73306 Mar 08 04:49:13.659244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-e480dffb-2ae0-4f04-9018-e602021a426d req-d1d7e86b-172f-4f87-bf50-cc118658579a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036738 Mar 08 04:49:13.660029 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1424/2796] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:49:13.874549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-4ad10080-8495-4043-af88-695187127e04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:49:13.878947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-4ad10080-8495-4043-af88-695187127e04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'key_pairs'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:49:13.892215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4ad10080-8495-4043-af88-695187127e04 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.547364 Mar 08 04:49:13.893010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1373/2797] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 04:49:13 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:14.043324 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7799b4e4-d4e7-4e6d-b902-d43ff59c7742 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:14.044436 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7799b4e4-d4e7-4e6d-b902-d43ff59c7742 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:14.050564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7799b4e4-d4e7-4e6d-b902-d43ff59c7742 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:14.051021 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7799b4e4-d4e7-4e6d-b902-d43ff59c7742 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:14.051798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7799b4e4-d4e7-4e6d-b902-d43ff59c7742 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:14.052415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7799b4e4-d4e7-4e6d-b902-d43ff59c7742 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:14.125031 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7799b4e4-d4e7-4e6d-b902-d43ff59c7742 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:14.133413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7799b4e4-d4e7-4e6d-b902-d43ff59c7742 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.095029 Mar 08 04:49:14.134381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1425/2798] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:15.126612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-310976244", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "551fbd03-e272-4e1c-ae72-e8d5eda5763a"}], "security_groups": [{"name": "tempest-securitygroup--1965546479"}], "key_name": "tempest-keypair-263164407", "user_data": "}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:49:15.152331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b8924f6b-0d20-43c2-9f2a-5f0b09c42118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:15.153294 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b8924f6b-0d20-43c2-9f2a-5f0b09c42118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:15.159660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8924f6b-0d20-43c2-9f2a-5f0b09c42118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:15.160105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8924f6b-0d20-43c2-9f2a-5f0b09c42118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:15.160858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8924f6b-0d20-43c2-9f2a-5f0b09c42118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:15.161289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b8924f6b-0d20-43c2-9f2a-5f0b09c42118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:15.232979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b8924f6b-0d20-43c2-9f2a-5f0b09c42118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:15.240512 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b8924f6b-0d20-43c2-9f2a-5f0b09c42118 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.093232 Mar 08 04:49:15.241108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1426/2799] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:15.253172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.network.neutron [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] validate_networks() for [('551fbd03-e272-4e1c-ae72-e8d5eda5763a', None, None, None, None, None)] {{(pid=116775) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:49:15.636336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-7b0912c1-f6d4-4ec8-9f18-272d5d0f8241 req-af498d96-1610-41b9-8357-ece06fbef5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f53eaeb-7b60-4548-bea0-fafe6e0c6a22", "name": "network-vif-deleted", "tag": "1c2dfd82-b52c-4418-8169-51f288073d7b"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:49:15.644167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7b0912c1-f6d4-4ec8-9f18-272d5d0f8241 req-af498d96-1610-41b9-8357-ece06fbef5d7 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:15.644606 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7b0912c1-f6d4-4ec8-9f18-272d5d0f8241 req-af498d96-1610-41b9-8357-ece06fbef5d7 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:15.655417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-7b0912c1-f6d4-4ec8-9f18-272d5d0f8241 req-af498d96-1610-41b9-8357-ece06fbef5d7 service nova] Creating event network-vif-deleted:1c2dfd82-b52c-4418-8169-51f288073d7b for instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 on hv-cinder-73306 Mar 08 04:49:15.660236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-7b0912c1-f6d4-4ec8-9f18-272d5d0f8241 req-af498d96-1610-41b9-8357-ece06fbef5d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027678 Mar 08 04:49:15.660812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1427/2800] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:49:15.665935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Flavor limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:49:15.666369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Image limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:49:15.666845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Flavor pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:49:15.667903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Image pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:49:15.668318 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:49:15.677032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:15.677505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:15.678806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:15.679367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:15.695230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:49:15.699583 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Getting quotas for user 9b00c2d10d9b4dda87645b24f3ebf672 and project e0bc0dc0628e4a139d418a8edca8621e. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:49:15.710065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Going to run 1 instances... {{(pid=116775) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:49:15.712394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:49:15.759218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f1e10d39-3674-4d39-8f3f-17bda5fe2327 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.637223 Mar 08 04:49:15.759775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1374/2801] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:49:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 04:49:15.770989 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3930fd84-a98c-4aaf-a87d-9f0319506a66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:15.771918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3930fd84-a98c-4aaf-a87d-9f0319506a66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:15.825281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3930fd84-a98c-4aaf-a87d-9f0319506a66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:15.831847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3930fd84-a98c-4aaf-a87d-9f0319506a66 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1240 microversion: 2.1 time: 0.065314 Mar 08 04:49:15.832409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1428/2802] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:15 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:16.258308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4cece8b0-fe86-4f9b-86ab-5fa31744648e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:16.258913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4cece8b0-fe86-4f9b-86ab-5fa31744648e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:16.266315 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cece8b0-fe86-4f9b-86ab-5fa31744648e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:16.266759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cece8b0-fe86-4f9b-86ab-5fa31744648e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:16.267519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cece8b0-fe86-4f9b-86ab-5fa31744648e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:16.267964 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4cece8b0-fe86-4f9b-86ab-5fa31744648e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:16.331887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4cece8b0-fe86-4f9b-86ab-5fa31744648e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:16.339923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4cece8b0-fe86-4f9b-86ab-5fa31744648e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.086004 Mar 08 04:49:16.340475 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1375/2803] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:16 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:16.849585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-78904de0-e2dc-426a-99b9-ecc8e93ee0c3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:16.850330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-78904de0-e2dc-426a-99b9-ecc8e93ee0c3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:16.859649 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78904de0-e2dc-426a-99b9-ecc8e93ee0c3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:16.860108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78904de0-e2dc-426a-99b9-ecc8e93ee0c3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:16.860931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78904de0-e2dc-426a-99b9-ecc8e93ee0c3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:16.861376 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78904de0-e2dc-426a-99b9-ecc8e93ee0c3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:16.922815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-78904de0-e2dc-426a-99b9-ecc8e93ee0c3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:16.929992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-78904de0-e2dc-426a-99b9-ecc8e93ee0c3 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1298 microversion: 2.1 time: 0.084290 Mar 08 04:49:16.938996 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1429/2804] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:16 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:17.356878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c998c7c1-8210-47bc-8090-046e4c95d526 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:17.358172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c998c7c1-8210-47bc-8090-046e4c95d526 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:17.364702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c998c7c1-8210-47bc-8090-046e4c95d526 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:17.365473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c998c7c1-8210-47bc-8090-046e4c95d526 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:17.366378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c998c7c1-8210-47bc-8090-046e4c95d526 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:17.366890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c998c7c1-8210-47bc-8090-046e4c95d526 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:17.430932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c998c7c1-8210-47bc-8090-046e4c95d526 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:17.438850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c998c7c1-8210-47bc-8090-046e4c95d526 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.086491 Mar 08 04:49:17.439835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1376/2805] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:17.940437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-e3f5f24f-58b9-47cc-bf1d-f9854083ae84 req-c8d2b936-049f-4c48-b5ff-31ac27a0d6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f49fb8-e371-4715-882a-b690939877b8", "tag": "3454109a-049b-4f5f-a7c9-c1f96f36527b"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:49:17.947771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-32f9daae-9063-4c23-860d-fff7a3a3a8df tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:17.950166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-32f9daae-9063-4c23-860d-fff7a3a3a8df tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:17.973297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32f9daae-9063-4c23-860d-fff7a3a3a8df tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:17.973773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32f9daae-9063-4c23-860d-fff7a3a3a8df tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:17.974568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32f9daae-9063-4c23-860d-fff7a3a3a8df tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:17.975061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32f9daae-9063-4c23-860d-fff7a3a3a8df tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:17.984078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-e3f5f24f-58b9-47cc-bf1d-f9854083ae84 req-c8d2b936-049f-4c48-b5ff-31ac27a0d6af service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:17.984685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-e3f5f24f-58b9-47cc-bf1d-f9854083ae84 req-c8d2b936-049f-4c48-b5ff-31ac27a0d6af service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:17.999139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-e3f5f24f-58b9-47cc-bf1d-f9854083ae84 req-c8d2b936-049f-4c48-b5ff-31ac27a0d6af service nova] Creating event network-changed:3454109a-049b-4f5f-a7c9-c1f96f36527b for instance 81f49fb8-e371-4715-882a-b690939877b8 on hv-cinder-73306 Mar 08 04:49:18.006147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-e3f5f24f-58b9-47cc-bf1d-f9854083ae84 req-c8d2b936-049f-4c48-b5ff-31ac27a0d6af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072191 Mar 08 04:49:18.007089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1430/2806] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:49:18.129734 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-32f9daae-9063-4c23-860d-fff7a3a3a8df tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:18.137687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-32f9daae-9063-4c23-860d-fff7a3a3a8df tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1366 microversion: 2.1 time: 0.193866 Mar 08 04:49:18.138266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1377/2807] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:17 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:18.456230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-569c8b23-3a18-4261-a160-b7fb6273902b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:18.456931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-569c8b23-3a18-4261-a160-b7fb6273902b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:18.463311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-569c8b23-3a18-4261-a160-b7fb6273902b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:18.463906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-569c8b23-3a18-4261-a160-b7fb6273902b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:18.464857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-569c8b23-3a18-4261-a160-b7fb6273902b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:18.465566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-569c8b23-3a18-4261-a160-b7fb6273902b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:18.530217 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-569c8b23-3a18-4261-a160-b7fb6273902b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:18.537928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-569c8b23-3a18-4261-a160-b7fb6273902b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.085892 Mar 08 04:49:18.538495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1431/2808] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:19.156177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-32fba0d8-4e34-4a87-b97a-37982842c89e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:19.157056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-32fba0d8-4e34-4a87-b97a-37982842c89e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:19.163939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32fba0d8-4e34-4a87-b97a-37982842c89e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:19.164390 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32fba0d8-4e34-4a87-b97a-37982842c89e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:19.165158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32fba0d8-4e34-4a87-b97a-37982842c89e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:19.165595 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32fba0d8-4e34-4a87-b97a-37982842c89e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:19.295052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-32fba0d8-4e34-4a87-b97a-37982842c89e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:19.302261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-32fba0d8-4e34-4a87-b97a-37982842c89e tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1366 microversion: 2.1 time: 0.151371 Mar 08 04:49:19.302829 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1378/2809] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:19 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:19.555616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-50d9390a-2d22-40b0-9fb3-047c9d40c960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:19.556223 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-50d9390a-2d22-40b0-9fb3-047c9d40c960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:19.563101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50d9390a-2d22-40b0-9fb3-047c9d40c960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:19.563547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50d9390a-2d22-40b0-9fb3-047c9d40c960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:19.564308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50d9390a-2d22-40b0-9fb3-047c9d40c960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:19.564738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-50d9390a-2d22-40b0-9fb3-047c9d40c960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:19.627429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-50d9390a-2d22-40b0-9fb3-047c9d40c960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:19.635171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-50d9390a-2d22-40b0-9fb3-047c9d40c960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083451 Mar 08 04:49:19.636307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1432/2810] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:20.319905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e75eeb0e-4784-422d-998f-301ca925fd16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:20.320515 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e75eeb0e-4784-422d-998f-301ca925fd16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:20.326843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e75eeb0e-4784-422d-998f-301ca925fd16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:20.327289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e75eeb0e-4784-422d-998f-301ca925fd16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:20.328051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e75eeb0e-4784-422d-998f-301ca925fd16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:20.328488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e75eeb0e-4784-422d-998f-301ca925fd16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:20.456754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e75eeb0e-4784-422d-998f-301ca925fd16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:20.463852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e75eeb0e-4784-422d-998f-301ca925fd16 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1366 microversion: 2.1 time: 0.147803 Mar 08 04:49:20.464599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1379/2811] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:20 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:20.652766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-819a3b79-561d-4e11-8df7-a1b96293007a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:20.653301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-819a3b79-561d-4e11-8df7-a1b96293007a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:20.659849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-819a3b79-561d-4e11-8df7-a1b96293007a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:20.660334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-819a3b79-561d-4e11-8df7-a1b96293007a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:20.661096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-819a3b79-561d-4e11-8df7-a1b96293007a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:20.661526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-819a3b79-561d-4e11-8df7-a1b96293007a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:20.719494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-819a3b79-561d-4e11-8df7-a1b96293007a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:20.727915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-819a3b79-561d-4e11-8df7-a1b96293007a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079537 Mar 08 04:49:20.728474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1433/2812] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:20 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:21.482142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f2e9af5b-fcaa-4a41-8636-dc9a534c1e8f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:21.482771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f2e9af5b-fcaa-4a41-8636-dc9a534c1e8f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:21.489172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2e9af5b-fcaa-4a41-8636-dc9a534c1e8f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:21.489624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2e9af5b-fcaa-4a41-8636-dc9a534c1e8f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:21.490444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2e9af5b-fcaa-4a41-8636-dc9a534c1e8f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:21.492701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f2e9af5b-fcaa-4a41-8636-dc9a534c1e8f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:21.507672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-af39b5c5-c2bb-4419-92ef-9d2fa675ecf8 req-caa58373-eb08-4928-b3c5-9b0bb229889e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f49fb8-e371-4715-882a-b690939877b8", "name": "network-vif-plugged", "status": "completed", "tag": "3454109a-049b-4f5f-a7c9-c1f96f36527b"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:49:21.516446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-af39b5c5-c2bb-4419-92ef-9d2fa675ecf8 req-caa58373-eb08-4928-b3c5-9b0bb229889e service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:21.516935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-af39b5c5-c2bb-4419-92ef-9d2fa675ecf8 req-caa58373-eb08-4928-b3c5-9b0bb229889e service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:21.528829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-af39b5c5-c2bb-4419-92ef-9d2fa675ecf8 req-caa58373-eb08-4928-b3c5-9b0bb229889e service nova] Creating event network-vif-plugged:3454109a-049b-4f5f-a7c9-c1f96f36527b for instance 81f49fb8-e371-4715-882a-b690939877b8 on hv-cinder-73306 Mar 08 04:49:21.533887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-af39b5c5-c2bb-4419-92ef-9d2fa675ecf8 req-caa58373-eb08-4928-b3c5-9b0bb229889e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029916 Mar 08 04:49:21.534675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1434/2813] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:49:21.633978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f2e9af5b-fcaa-4a41-8636-dc9a534c1e8f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:21.643517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f2e9af5b-fcaa-4a41-8636-dc9a534c1e8f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1366 microversion: 2.1 time: 0.166449 Mar 08 04:49:21.644358 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1380/2814] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:21 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:21.746745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9bdb0e1b-7300-4e86-8d14-34589a707ac5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:21.747591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9bdb0e1b-7300-4e86-8d14-34589a707ac5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:21.753619 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bdb0e1b-7300-4e86-8d14-34589a707ac5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:21.754101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bdb0e1b-7300-4e86-8d14-34589a707ac5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:21.754872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bdb0e1b-7300-4e86-8d14-34589a707ac5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:21.755308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9bdb0e1b-7300-4e86-8d14-34589a707ac5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:21.816724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9bdb0e1b-7300-4e86-8d14-34589a707ac5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:21.825157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9bdb0e1b-7300-4e86-8d14-34589a707ac5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.084167 Mar 08 04:49:21.826087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1435/2815] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:21 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:22.661026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-85993a81-4cd1-4fd9-8124-1f450511d7c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:22.661616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-85993a81-4cd1-4fd9-8124-1f450511d7c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:22.667895 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85993a81-4cd1-4fd9-8124-1f450511d7c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:22.668884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85993a81-4cd1-4fd9-8124-1f450511d7c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:22.669718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85993a81-4cd1-4fd9-8124-1f450511d7c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:22.670151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85993a81-4cd1-4fd9-8124-1f450511d7c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:22.808669 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-85993a81-4cd1-4fd9-8124-1f450511d7c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:22.816683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-85993a81-4cd1-4fd9-8124-1f450511d7c0 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1366 microversion: 2.1 time: 0.159483 Mar 08 04:49:22.817929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1381/2816] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:22 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:22.841653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bd5cba93-3ca7-4ad9-976f-56f826769a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:22.842281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bd5cba93-3ca7-4ad9-976f-56f826769a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:22.848533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd5cba93-3ca7-4ad9-976f-56f826769a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:22.848978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd5cba93-3ca7-4ad9-976f-56f826769a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:22.849797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd5cba93-3ca7-4ad9-976f-56f826769a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:22.850231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd5cba93-3ca7-4ad9-976f-56f826769a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:22.910870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bd5cba93-3ca7-4ad9-976f-56f826769a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:22.919779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bd5cba93-3ca7-4ad9-976f-56f826769a6c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081485 Mar 08 04:49:22.920380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1436/2817] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:23.835428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0199ed5e-15d4-4272-8526-fdf5b91efd5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:23.836032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0199ed5e-15d4-4272-8526-fdf5b91efd5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:23.842404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0199ed5e-15d4-4272-8526-fdf5b91efd5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:23.842849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0199ed5e-15d4-4272-8526-fdf5b91efd5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:23.843599 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0199ed5e-15d4-4272-8526-fdf5b91efd5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:23.844029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0199ed5e-15d4-4272-8526-fdf5b91efd5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:23.936844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6b2cf057-9695-48f3-b004-9563fd2a605d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:23.937481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6b2cf057-9695-48f3-b004-9563fd2a605d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:23.943729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6b2cf057-9695-48f3-b004-9563fd2a605d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:23.944181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6b2cf057-9695-48f3-b004-9563fd2a605d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:23.944960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6b2cf057-9695-48f3-b004-9563fd2a605d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:23.945399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6b2cf057-9695-48f3-b004-9563fd2a605d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:23.975673 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0199ed5e-15d4-4272-8526-fdf5b91efd5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:23.983467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0199ed5e-15d4-4272-8526-fdf5b91efd5c tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1555 microversion: 2.1 time: 0.151925 Mar 08 04:49:23.984030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1382/2818] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:23 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:23.999902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e87790a1-b8af-4dc0-97e5-5b42bdd7ae2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:24.000383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e87790a1-b8af-4dc0-97e5-5b42bdd7ae2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:24.004153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6b2cf057-9695-48f3-b004-9563fd2a605d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:24.006283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e87790a1-b8af-4dc0-97e5-5b42bdd7ae2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:24.006730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e87790a1-b8af-4dc0-97e5-5b42bdd7ae2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:24.007496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e87790a1-b8af-4dc0-97e5-5b42bdd7ae2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:24.007927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e87790a1-b8af-4dc0-97e5-5b42bdd7ae2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:24.012025 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6b2cf057-9695-48f3-b004-9563fd2a605d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079702 Mar 08 04:49:24.013147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1437/2819] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:49:24.088203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e87790a1-b8af-4dc0-97e5-5b42bdd7ae2d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092689 Mar 08 04:49:24.088792 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1383/2820] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 04:49:23 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:49:25.031097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d2937653-5fe4-4b87-9589-88e11486765e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:25.031715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d2937653-5fe4-4b87-9589-88e11486765e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:25.034276 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-a1c233ee-ed54-442c-b62e-fc9585e221c6 req-b4ec5b76-a381-4440-8062-cd485ef6fd11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f49fb8-e371-4715-882a-b690939877b8", "tag": "3454109a-049b-4f5f-a7c9-c1f96f36527b"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:49:25.037683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2937653-5fe4-4b87-9589-88e11486765e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:25.038137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2937653-5fe4-4b87-9589-88e11486765e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:25.038905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2937653-5fe4-4b87-9589-88e11486765e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:25.039336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d2937653-5fe4-4b87-9589-88e11486765e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:25.042904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-a1c233ee-ed54-442c-b62e-fc9585e221c6 req-b4ec5b76-a381-4440-8062-cd485ef6fd11 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:25.044030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-a1c233ee-ed54-442c-b62e-fc9585e221c6 req-b4ec5b76-a381-4440-8062-cd485ef6fd11 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:25.055315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-a1c233ee-ed54-442c-b62e-fc9585e221c6 req-b4ec5b76-a381-4440-8062-cd485ef6fd11 service nova] Creating event network-changed:3454109a-049b-4f5f-a7c9-c1f96f36527b for instance 81f49fb8-e371-4715-882a-b690939877b8 on hv-cinder-73306 Mar 08 04:49:25.060335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-a1c233ee-ed54-442c-b62e-fc9585e221c6 req-b4ec5b76-a381-4440-8062-cd485ef6fd11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040997 Mar 08 04:49:25.061241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1438/2821] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:49:25.109293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d2937653-5fe4-4b87-9589-88e11486765e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:25.117907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d2937653-5fe4-4b87-9589-88e11486765e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.092443 Mar 08 04:49:25.118866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1384/2822] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:25 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:49:26.135911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8d2512dd-996c-46af-802a-3b87483885ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:26.136502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8d2512dd-996c-46af-802a-3b87483885ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:26.145523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d2512dd-996c-46af-802a-3b87483885ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:26.146260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d2512dd-996c-46af-802a-3b87483885ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:26.147345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d2512dd-996c-46af-802a-3b87483885ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:26.147792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8d2512dd-996c-46af-802a-3b87483885ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:26.209049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8d2512dd-996c-46af-802a-3b87483885ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:26.217451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8d2512dd-996c-46af-802a-3b87483885ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.086241 Mar 08 04:49:26.218039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1439/2823] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:27.234046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e762b10b-87a0-4b91-b74d-fbd91c5ab902 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:27.234657 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e762b10b-87a0-4b91-b74d-fbd91c5ab902 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:27.240853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e762b10b-87a0-4b91-b74d-fbd91c5ab902 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:27.241304 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e762b10b-87a0-4b91-b74d-fbd91c5ab902 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:27.242119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e762b10b-87a0-4b91-b74d-fbd91c5ab902 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:27.242557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e762b10b-87a0-4b91-b74d-fbd91c5ab902 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:27.301158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e762b10b-87a0-4b91-b74d-fbd91c5ab902 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:27.308721 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e762b10b-87a0-4b91-b74d-fbd91c5ab902 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078675 Mar 08 04:49:27.309862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1385/2824] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:27 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:28.325808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f71cc386-18b6-4b9c-8a3f-5bb7afb90699 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:28.326400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f71cc386-18b6-4b9c-8a3f-5bb7afb90699 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:28.333338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f71cc386-18b6-4b9c-8a3f-5bb7afb90699 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:28.333821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f71cc386-18b6-4b9c-8a3f-5bb7afb90699 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:28.334582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f71cc386-18b6-4b9c-8a3f-5bb7afb90699 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:28.335014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f71cc386-18b6-4b9c-8a3f-5bb7afb90699 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:28.394112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f71cc386-18b6-4b9c-8a3f-5bb7afb90699 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:28.401673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f71cc386-18b6-4b9c-8a3f-5bb7afb90699 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079779 Mar 08 04:49:28.402225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1440/2825] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:29.418671 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-659dfef4-cb7b-4348-ba67-1814c37f43fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:29.419278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-659dfef4-cb7b-4348-ba67-1814c37f43fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:29.425416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-659dfef4-cb7b-4348-ba67-1814c37f43fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:29.425906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-659dfef4-cb7b-4348-ba67-1814c37f43fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:29.426662 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-659dfef4-cb7b-4348-ba67-1814c37f43fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:29.427094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-659dfef4-cb7b-4348-ba67-1814c37f43fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:29.485548 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-659dfef4-cb7b-4348-ba67-1814c37f43fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:29.493446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-659dfef4-cb7b-4348-ba67-1814c37f43fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078630 Mar 08 04:49:29.494041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1386/2826] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:29 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:30.511366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b2f07234-83c8-447c-a3ac-028a47b7a8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:30.511988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b2f07234-83c8-447c-a3ac-028a47b7a8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:30.518183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b2f07234-83c8-447c-a3ac-028a47b7a8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:30.518629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b2f07234-83c8-447c-a3ac-028a47b7a8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:30.519653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b2f07234-83c8-447c-a3ac-028a47b7a8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:30.520084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b2f07234-83c8-447c-a3ac-028a47b7a8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:30.578081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b2f07234-83c8-447c-a3ac-028a47b7a8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:30.585927 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b2f07234-83c8-447c-a3ac-028a47b7a8b4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078521 Mar 08 04:49:30.586484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1441/2827] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:30 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:31.602773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-18524a89-2227-4517-b46f-658fb886d2c1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:31.603434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-18524a89-2227-4517-b46f-658fb886d2c1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:31.609450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18524a89-2227-4517-b46f-658fb886d2c1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:31.609929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18524a89-2227-4517-b46f-658fb886d2c1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:31.610702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18524a89-2227-4517-b46f-658fb886d2c1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:31.611136 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18524a89-2227-4517-b46f-658fb886d2c1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:31.673347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-18524a89-2227-4517-b46f-658fb886d2c1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:31.681023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-18524a89-2227-4517-b46f-658fb886d2c1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082257 Mar 08 04:49:31.681581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1387/2828] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:32.698283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ab8dc2e7-ef84-4601-bdd2-69ed726205b0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:32.698932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ab8dc2e7-ef84-4601-bdd2-69ed726205b0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:32.705232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ab8dc2e7-ef84-4601-bdd2-69ed726205b0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:32.705708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ab8dc2e7-ef84-4601-bdd2-69ed726205b0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:32.706478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ab8dc2e7-ef84-4601-bdd2-69ed726205b0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:32.706921 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ab8dc2e7-ef84-4601-bdd2-69ed726205b0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:32.764814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ab8dc2e7-ef84-4601-bdd2-69ed726205b0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:32.772734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ab8dc2e7-ef84-4601-bdd2-69ed726205b0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078326 Mar 08 04:49:32.773305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1442/2829] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:33.789741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9b01f999-05ce-4a8d-8a73-26d61d28534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:33.790357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9b01f999-05ce-4a8d-8a73-26d61d28534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:33.796906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b01f999-05ce-4a8d-8a73-26d61d28534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:33.797355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b01f999-05ce-4a8d-8a73-26d61d28534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:33.798151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b01f999-05ce-4a8d-8a73-26d61d28534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:33.798606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b01f999-05ce-4a8d-8a73-26d61d28534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:33.857496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9b01f999-05ce-4a8d-8a73-26d61d28534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:33.865452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9b01f999-05ce-4a8d-8a73-26d61d28534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079579 Mar 08 04:49:33.866045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1388/2830] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:34.881356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0d1ba6f0-7e12-4458-aa1a-577ad83deca9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:34.881985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0d1ba6f0-7e12-4458-aa1a-577ad83deca9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:34.888214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d1ba6f0-7e12-4458-aa1a-577ad83deca9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:34.888660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d1ba6f0-7e12-4458-aa1a-577ad83deca9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:34.889414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d1ba6f0-7e12-4458-aa1a-577ad83deca9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:34.889880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0d1ba6f0-7e12-4458-aa1a-577ad83deca9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:34.952474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0d1ba6f0-7e12-4458-aa1a-577ad83deca9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:34.960138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0d1ba6f0-7e12-4458-aa1a-577ad83deca9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082676 Mar 08 04:49:34.960705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1443/2831] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:34 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:35.977439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3a627718-9ec9-4a5c-9cd2-5ab2834fa09e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:35.978064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3a627718-9ec9-4a5c-9cd2-5ab2834fa09e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:35.984105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a627718-9ec9-4a5c-9cd2-5ab2834fa09e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:35.984547 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a627718-9ec9-4a5c-9cd2-5ab2834fa09e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:35.985299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a627718-9ec9-4a5c-9cd2-5ab2834fa09e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:35.985757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a627718-9ec9-4a5c-9cd2-5ab2834fa09e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:36.043985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3a627718-9ec9-4a5c-9cd2-5ab2834fa09e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:36.052365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3a627718-9ec9-4a5c-9cd2-5ab2834fa09e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078842 Mar 08 04:49:36.052948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1389/2832] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:37.069705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b5f77e3b-de1d-4928-b647-ccb916505ca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:37.070317 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b5f77e3b-de1d-4928-b647-ccb916505ca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:37.077234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5f77e3b-de1d-4928-b647-ccb916505ca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:37.077761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5f77e3b-de1d-4928-b647-ccb916505ca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:37.078528 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5f77e3b-de1d-4928-b647-ccb916505ca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:37.078967 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b5f77e3b-de1d-4928-b647-ccb916505ca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:37.137124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b5f77e3b-de1d-4928-b647-ccb916505ca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:37.146298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b5f77e3b-de1d-4928-b647-ccb916505ca8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080222 Mar 08 04:49:37.146704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1444/2833] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:38.165119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6c8fec4f-69b9-473b-b9cd-9eb637128c45 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:38.165747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6c8fec4f-69b9-473b-b9cd-9eb637128c45 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:38.172613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c8fec4f-69b9-473b-b9cd-9eb637128c45 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:38.173054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c8fec4f-69b9-473b-b9cd-9eb637128c45 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:38.173914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c8fec4f-69b9-473b-b9cd-9eb637128c45 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:38.174347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6c8fec4f-69b9-473b-b9cd-9eb637128c45 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:38.241123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6c8fec4f-69b9-473b-b9cd-9eb637128c45 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:38.249562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6c8fec4f-69b9-473b-b9cd-9eb637128c45 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.088303 Mar 08 04:49:38.250153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1390/2834] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:38 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:39.266903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6f34e4e6-2e24-449b-a2fe-0b22c2adb07a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:39.267487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6f34e4e6-2e24-449b-a2fe-0b22c2adb07a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:39.273939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f34e4e6-2e24-449b-a2fe-0b22c2adb07a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:39.274388 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f34e4e6-2e24-449b-a2fe-0b22c2adb07a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:39.275141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f34e4e6-2e24-449b-a2fe-0b22c2adb07a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:39.275574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f34e4e6-2e24-449b-a2fe-0b22c2adb07a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:39.333188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6f34e4e6-2e24-449b-a2fe-0b22c2adb07a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:39.340748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6f34e4e6-2e24-449b-a2fe-0b22c2adb07a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078494 Mar 08 04:49:39.342062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1445/2835] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:40.358850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5d11bc80-48e6-4bc2-99fe-037e4a9ff9b3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:40.359460 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5d11bc80-48e6-4bc2-99fe-037e4a9ff9b3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:40.365688 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5d11bc80-48e6-4bc2-99fe-037e4a9ff9b3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:40.366130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5d11bc80-48e6-4bc2-99fe-037e4a9ff9b3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:40.366883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5d11bc80-48e6-4bc2-99fe-037e4a9ff9b3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:40.367308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5d11bc80-48e6-4bc2-99fe-037e4a9ff9b3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:40.426885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5d11bc80-48e6-4bc2-99fe-037e4a9ff9b3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:40.434434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5d11bc80-48e6-4bc2-99fe-037e4a9ff9b3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080184 Mar 08 04:49:40.435634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1391/2836] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:41.450939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7e8003a4-aea1-43ee-8de4-edda81f42b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:41.451530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7e8003a4-aea1-43ee-8de4-edda81f42b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:41.457805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8003a4-aea1-43ee-8de4-edda81f42b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:41.458248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8003a4-aea1-43ee-8de4-edda81f42b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:41.459001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8003a4-aea1-43ee-8de4-edda81f42b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:41.459432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7e8003a4-aea1-43ee-8de4-edda81f42b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:41.519070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7e8003a4-aea1-43ee-8de4-edda81f42b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:41.526725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7e8003a4-aea1-43ee-8de4-edda81f42b34 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079804 Mar 08 04:49:41.527281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1446/2837] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:42.543748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-97fbec37-9109-4d02-a883-80dfed3788d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:42.544401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-97fbec37-9109-4d02-a883-80dfed3788d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:42.550580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97fbec37-9109-4d02-a883-80dfed3788d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:42.551024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97fbec37-9109-4d02-a883-80dfed3788d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:42.551778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97fbec37-9109-4d02-a883-80dfed3788d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:42.552210 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97fbec37-9109-4d02-a883-80dfed3788d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:42.612022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-97fbec37-9109-4d02-a883-80dfed3788d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:42.619668 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-97fbec37-9109-4d02-a883-80dfed3788d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079777 Mar 08 04:49:42.620219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1392/2838] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:42 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:43.636736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e76f605d-aff6-4c6e-af94-cd72bd0ef03e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:43.637374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e76f605d-aff6-4c6e-af94-cd72bd0ef03e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:43.644097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e76f605d-aff6-4c6e-af94-cd72bd0ef03e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:43.644586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e76f605d-aff6-4c6e-af94-cd72bd0ef03e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:43.645340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e76f605d-aff6-4c6e-af94-cd72bd0ef03e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:43.645799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e76f605d-aff6-4c6e-af94-cd72bd0ef03e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:43.704535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e76f605d-aff6-4c6e-af94-cd72bd0ef03e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:43.712062 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e76f605d-aff6-4c6e-af94-cd72bd0ef03e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079306 Mar 08 04:49:43.712618 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1447/2839] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:44.729384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f1bca5bb-2cd0-4f11-b049-7d53e7dbe35e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:44.730014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f1bca5bb-2cd0-4f11-b049-7d53e7dbe35e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:44.736330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1bca5bb-2cd0-4f11-b049-7d53e7dbe35e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:44.736778 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1bca5bb-2cd0-4f11-b049-7d53e7dbe35e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:44.737534 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1bca5bb-2cd0-4f11-b049-7d53e7dbe35e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:44.738008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f1bca5bb-2cd0-4f11-b049-7d53e7dbe35e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:44.799029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f1bca5bb-2cd0-4f11-b049-7d53e7dbe35e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:44.806704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f1bca5bb-2cd0-4f11-b049-7d53e7dbe35e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081218 Mar 08 04:49:44.807271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1393/2840] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:45.823729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-541ad821-ba47-4d3c-b4f0-d3573d95d916 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:45.824371 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-541ad821-ba47-4d3c-b4f0-d3573d95d916 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:45.830880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-541ad821-ba47-4d3c-b4f0-d3573d95d916 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:45.831373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-541ad821-ba47-4d3c-b4f0-d3573d95d916 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:45.832200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-541ad821-ba47-4d3c-b4f0-d3573d95d916 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:45.832636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-541ad821-ba47-4d3c-b4f0-d3573d95d916 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:45.892079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-541ad821-ba47-4d3c-b4f0-d3573d95d916 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:45.899914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-541ad821-ba47-4d3c-b4f0-d3573d95d916 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080025 Mar 08 04:49:45.900469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1448/2841] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:46.916302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-00b3e7d7-0424-4837-bc17-b9a208b88bc3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:46.916903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-00b3e7d7-0424-4837-bc17-b9a208b88bc3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:46.923171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00b3e7d7-0424-4837-bc17-b9a208b88bc3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:46.923614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00b3e7d7-0424-4837-bc17-b9a208b88bc3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:46.924369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00b3e7d7-0424-4837-bc17-b9a208b88bc3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:46.924806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00b3e7d7-0424-4837-bc17-b9a208b88bc3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:46.982363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-00b3e7d7-0424-4837-bc17-b9a208b88bc3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:46.989987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-00b3e7d7-0424-4837-bc17-b9a208b88bc3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077537 Mar 08 04:49:46.990542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1394/2842] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:48.006615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ad79b019-bec2-4f02-87ad-d81d4ce2b7ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:48.007219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ad79b019-bec2-4f02-87ad-d81d4ce2b7ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:48.013110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad79b019-bec2-4f02-87ad-d81d4ce2b7ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:48.014094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad79b019-bec2-4f02-87ad-d81d4ce2b7ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:48.014848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad79b019-bec2-4f02-87ad-d81d4ce2b7ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:48.015280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ad79b019-bec2-4f02-87ad-d81d4ce2b7ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:48.074648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ad79b019-bec2-4f02-87ad-d81d4ce2b7ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:48.082823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ad79b019-bec2-4f02-87ad-d81d4ce2b7ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080088 Mar 08 04:49:48.083387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1449/2843] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:49.100409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2aafbf59-0b74-4934-ba18-2368d9c56987 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:49.101014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2aafbf59-0b74-4934-ba18-2368d9c56987 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:49.107919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2aafbf59-0b74-4934-ba18-2368d9c56987 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:49.108342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2aafbf59-0b74-4934-ba18-2368d9c56987 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:49.109097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2aafbf59-0b74-4934-ba18-2368d9c56987 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:49.109529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2aafbf59-0b74-4934-ba18-2368d9c56987 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:49.167570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2aafbf59-0b74-4934-ba18-2368d9c56987 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:49.175335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2aafbf59-0b74-4934-ba18-2368d9c56987 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078870 Mar 08 04:49:49.175883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1395/2844] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:50.192245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57e69167-9a89-4ad5-be43-a3a192bec960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:50.192853 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-57e69167-9a89-4ad5-be43-a3a192bec960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:50.199099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57e69167-9a89-4ad5-be43-a3a192bec960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:50.199552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57e69167-9a89-4ad5-be43-a3a192bec960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:50.200309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57e69167-9a89-4ad5-be43-a3a192bec960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:50.200766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57e69167-9a89-4ad5-be43-a3a192bec960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:50.259028 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-57e69167-9a89-4ad5-be43-a3a192bec960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:50.267282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-57e69167-9a89-4ad5-be43-a3a192bec960 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078870 Mar 08 04:49:50.267783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1450/2845] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:50 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:49:51.286024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2d33c4da-5301-4cc1-a49b-e9eed1fe883d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:51.286629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2d33c4da-5301-4cc1-a49b-e9eed1fe883d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:51.292788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2d33c4da-5301-4cc1-a49b-e9eed1fe883d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:51.293232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2d33c4da-5301-4cc1-a49b-e9eed1fe883d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:51.294008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2d33c4da-5301-4cc1-a49b-e9eed1fe883d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:51.294477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2d33c4da-5301-4cc1-a49b-e9eed1fe883d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:51.356145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2d33c4da-5301-4cc1-a49b-e9eed1fe883d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:51.364184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2d33c4da-5301-4cc1-a49b-e9eed1fe883d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081973 Mar 08 04:49:51.364748 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1396/2846] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:52.381400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-da08c735-6ec7-4725-83c7-2345ed4ee7db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:52.382045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-da08c735-6ec7-4725-83c7-2345ed4ee7db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:52.388820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da08c735-6ec7-4725-83c7-2345ed4ee7db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:52.389280 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da08c735-6ec7-4725-83c7-2345ed4ee7db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:52.390073 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da08c735-6ec7-4725-83c7-2345ed4ee7db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:52.390511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da08c735-6ec7-4725-83c7-2345ed4ee7db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:52.674241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-da08c735-6ec7-4725-83c7-2345ed4ee7db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:52.681960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-da08c735-6ec7-4725-83c7-2345ed4ee7db tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.304472 Mar 08 04:49:52.682515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1451/2847] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:53.699018 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d9946284-46ba-4fe7-9bbb-54f7c67f03a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:53.699617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d9946284-46ba-4fe7-9bbb-54f7c67f03a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:53.706012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9946284-46ba-4fe7-9bbb-54f7c67f03a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:53.706459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9946284-46ba-4fe7-9bbb-54f7c67f03a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:53.707212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9946284-46ba-4fe7-9bbb-54f7c67f03a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:53.707644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d9946284-46ba-4fe7-9bbb-54f7c67f03a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:53.767009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d9946284-46ba-4fe7-9bbb-54f7c67f03a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:53.775023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d9946284-46ba-4fe7-9bbb-54f7c67f03a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079809 Mar 08 04:49:53.775594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1397/2848] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:54.791212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-905ff207-2a34-4cb2-8cbd-a3a7ec0b0c41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:54.792001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-905ff207-2a34-4cb2-8cbd-a3a7ec0b0c41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:54.798876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-905ff207-2a34-4cb2-8cbd-a3a7ec0b0c41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:54.799327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-905ff207-2a34-4cb2-8cbd-a3a7ec0b0c41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:54.800098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-905ff207-2a34-4cb2-8cbd-a3a7ec0b0c41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:54.800535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-905ff207-2a34-4cb2-8cbd-a3a7ec0b0c41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:54.860478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-905ff207-2a34-4cb2-8cbd-a3a7ec0b0c41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:54.868238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-905ff207-2a34-4cb2-8cbd-a3a7ec0b0c41 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080891 Mar 08 04:49:54.868799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1452/2849] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:54 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:55.886267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d1fd7585-9e22-4926-9953-c9cb2655bb5f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:55.886800 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d1fd7585-9e22-4926-9953-c9cb2655bb5f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:55.893991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1fd7585-9e22-4926-9953-c9cb2655bb5f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:55.894437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1fd7585-9e22-4926-9953-c9cb2655bb5f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:55.895187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1fd7585-9e22-4926-9953-c9cb2655bb5f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:55.895618 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d1fd7585-9e22-4926-9953-c9cb2655bb5f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:55.952798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d1fd7585-9e22-4926-9953-c9cb2655bb5f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:55.960303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d1fd7585-9e22-4926-9953-c9cb2655bb5f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077983 Mar 08 04:49:55.960856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1398/2850] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:56.976811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1c141adc-8526-4a8e-9015-b9c37fbb56fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:56.977413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1c141adc-8526-4a8e-9015-b9c37fbb56fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:56.984051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c141adc-8526-4a8e-9015-b9c37fbb56fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:56.984505 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c141adc-8526-4a8e-9015-b9c37fbb56fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:56.985275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c141adc-8526-4a8e-9015-b9c37fbb56fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:56.985747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1c141adc-8526-4a8e-9015-b9c37fbb56fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:57.046266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1c141adc-8526-4a8e-9015-b9c37fbb56fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:57.053894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1c141adc-8526-4a8e-9015-b9c37fbb56fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080910 Mar 08 04:49:57.054452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1453/2851] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:58.070079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-aa14d41c-cf60-4e80-baa3-39961d77a178 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:58.070714 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-aa14d41c-cf60-4e80-baa3-39961d77a178 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:58.077560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aa14d41c-cf60-4e80-baa3-39961d77a178 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:58.078029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aa14d41c-cf60-4e80-baa3-39961d77a178 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:58.078790 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aa14d41c-cf60-4e80-baa3-39961d77a178 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:58.079228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-aa14d41c-cf60-4e80-baa3-39961d77a178 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:58.136469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-aa14d41c-cf60-4e80-baa3-39961d77a178 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:58.145113 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-aa14d41c-cf60-4e80-baa3-39961d77a178 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078874 Mar 08 04:49:58.145946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1399/2852] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:49:59.162038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-34cf8876-f6de-4801-9eca-3530d9cd35ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:49:59.162647 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-34cf8876-f6de-4801-9eca-3530d9cd35ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:49:59.168791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-34cf8876-f6de-4801-9eca-3530d9cd35ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:59.169268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-34cf8876-f6de-4801-9eca-3530d9cd35ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:59.170056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-34cf8876-f6de-4801-9eca-3530d9cd35ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:49:59.170491 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-34cf8876-f6de-4801-9eca-3530d9cd35ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:49:59.227926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-34cf8876-f6de-4801-9eca-3530d9cd35ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:49:59.235843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-34cf8876-f6de-4801-9eca-3530d9cd35ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077760 Mar 08 04:49:59.236993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1454/2853] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:49:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:00.252915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7af4c828-eb14-4919-9748-d2a42631f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:00.253511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7af4c828-eb14-4919-9748-d2a42631f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:00.259798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7af4c828-eb14-4919-9748-d2a42631f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:00.260249 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7af4c828-eb14-4919-9748-d2a42631f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:00.261011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7af4c828-eb14-4919-9748-d2a42631f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:00.261450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7af4c828-eb14-4919-9748-d2a42631f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:00.328429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7af4c828-eb14-4919-9748-d2a42631f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:00.337051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7af4c828-eb14-4919-9748-d2a42631f14b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.087852 Mar 08 04:50:00.338084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1400/2854] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:01.297011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-588191bc-982c-4e7f-b6d6-203b0977574a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:01.297598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-588191bc-982c-4e7f-b6d6-203b0977574a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:01.303855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-588191bc-982c-4e7f-b6d6-203b0977574a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:01.304303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-588191bc-982c-4e7f-b6d6-203b0977574a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:01.305069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-588191bc-982c-4e7f-b6d6-203b0977574a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:01.305507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-588191bc-982c-4e7f-b6d6-203b0977574a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:01.328123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-588191bc-982c-4e7f-b6d6-203b0977574a tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8/ips" status: 200 len: 148 microversion: 2.1 time: 0.035518 Mar 08 04:50:01.328682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1455/2855] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 04:50:01 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:50:01.353970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4b180761-fe80-4493-bc75-6d7d0d5c77c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:01.354605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4b180761-fe80-4493-bc75-6d7d0d5c77c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:01.361224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b180761-fe80-4493-bc75-6d7d0d5c77c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:01.361743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b180761-fe80-4493-bc75-6d7d0d5c77c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:01.362496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b180761-fe80-4493-bc75-6d7d0d5c77c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:01.362925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b180761-fe80-4493-bc75-6d7d0d5c77c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:01.421970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4b180761-fe80-4493-bc75-6d7d0d5c77c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:01.429578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4b180761-fe80-4493-bc75-6d7d0d5c77c9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079460 Mar 08 04:50:01.430152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1401/2856] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:02.446116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-980adf56-1ac3-4f4c-9320-7242dedda376 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:02.446752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-980adf56-1ac3-4f4c-9320-7242dedda376 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:02.453123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-980adf56-1ac3-4f4c-9320-7242dedda376 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:02.453570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-980adf56-1ac3-4f4c-9320-7242dedda376 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:02.454373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-980adf56-1ac3-4f4c-9320-7242dedda376 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:02.454789 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-980adf56-1ac3-4f4c-9320-7242dedda376 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:02.517206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-980adf56-1ac3-4f4c-9320-7242dedda376 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:02.525074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-980adf56-1ac3-4f4c-9320-7242dedda376 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082878 Mar 08 04:50:02.525636 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1456/2857] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:03.542065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6cea0aa4-791d-4a3b-b18c-85ed16dc0547 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:03.542648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6cea0aa4-791d-4a3b-b18c-85ed16dc0547 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:03.548809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6cea0aa4-791d-4a3b-b18c-85ed16dc0547 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:03.549257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6cea0aa4-791d-4a3b-b18c-85ed16dc0547 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:03.550043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6cea0aa4-791d-4a3b-b18c-85ed16dc0547 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:03.550476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6cea0aa4-791d-4a3b-b18c-85ed16dc0547 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:03.608559 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6cea0aa4-791d-4a3b-b18c-85ed16dc0547 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:03.616144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6cea0aa4-791d-4a3b-b18c-85ed16dc0547 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077981 Mar 08 04:50:03.616705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1402/2858] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:04.632296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d266fd0b-aa5e-40dc-8730-e4ec943df8dd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:04.632925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d266fd0b-aa5e-40dc-8730-e4ec943df8dd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:04.639258 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d266fd0b-aa5e-40dc-8730-e4ec943df8dd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:04.639715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d266fd0b-aa5e-40dc-8730-e4ec943df8dd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:04.640479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d266fd0b-aa5e-40dc-8730-e4ec943df8dd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:04.640919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d266fd0b-aa5e-40dc-8730-e4ec943df8dd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:04.698622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d266fd0b-aa5e-40dc-8730-e4ec943df8dd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:04.706362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d266fd0b-aa5e-40dc-8730-e4ec943df8dd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077938 Mar 08 04:50:04.706930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1457/2859] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:05.723188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-87a3fbef-9a68-4670-8b2d-e70096b0037d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:05.723781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-87a3fbef-9a68-4670-8b2d-e70096b0037d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:05.729779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87a3fbef-9a68-4670-8b2d-e70096b0037d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:05.730231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87a3fbef-9a68-4670-8b2d-e70096b0037d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:05.730988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87a3fbef-9a68-4670-8b2d-e70096b0037d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:05.731424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-87a3fbef-9a68-4670-8b2d-e70096b0037d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:05.789375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-87a3fbef-9a68-4670-8b2d-e70096b0037d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:05.797840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-87a3fbef-9a68-4670-8b2d-e70096b0037d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078470 Mar 08 04:50:05.798399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1403/2860] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:06.815188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7f124499-c863-4a50-8cb6-70ca49bb1839 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:06.815803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7f124499-c863-4a50-8cb6-70ca49bb1839 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:06.822173 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f124499-c863-4a50-8cb6-70ca49bb1839 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:06.822629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f124499-c863-4a50-8cb6-70ca49bb1839 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:06.823439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f124499-c863-4a50-8cb6-70ca49bb1839 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:06.823883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f124499-c863-4a50-8cb6-70ca49bb1839 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:06.883730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7f124499-c863-4a50-8cb6-70ca49bb1839 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:06.892241 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7f124499-c863-4a50-8cb6-70ca49bb1839 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081674 Mar 08 04:50:06.893109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1458/2861] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:07.909866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7bf72eb4-2bab-4391-b358-8aa8746d413e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:07.910401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7bf72eb4-2bab-4391-b358-8aa8746d413e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:07.916597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bf72eb4-2bab-4391-b358-8aa8746d413e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:07.917040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bf72eb4-2bab-4391-b358-8aa8746d413e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:07.917812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bf72eb4-2bab-4391-b358-8aa8746d413e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:07.918243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bf72eb4-2bab-4391-b358-8aa8746d413e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:07.977593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7bf72eb4-2bab-4391-b358-8aa8746d413e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:07.985203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7bf72eb4-2bab-4391-b358-8aa8746d413e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079317 Mar 08 04:50:07.985776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1404/2862] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:09.131162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b13d0e1b-f327-4379-90f0-71a8833d529b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:09.131771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b13d0e1b-f327-4379-90f0-71a8833d529b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:09.137711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b13d0e1b-f327-4379-90f0-71a8833d529b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:09.138162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b13d0e1b-f327-4379-90f0-71a8833d529b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:09.139022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b13d0e1b-f327-4379-90f0-71a8833d529b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:09.139485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b13d0e1b-f327-4379-90f0-71a8833d529b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:09.200565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b13d0e1b-f327-4379-90f0-71a8833d529b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:09.208348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b13d0e1b-f327-4379-90f0-71a8833d529b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.210576 Mar 08 04:50:09.208904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1459/2863] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:10.225754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e4d2c79b-27a4-471c-8eaa-41429adc48c2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:10.226363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e4d2c79b-27a4-471c-8eaa-41429adc48c2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:10.232625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4d2c79b-27a4-471c-8eaa-41429adc48c2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:10.233072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4d2c79b-27a4-471c-8eaa-41429adc48c2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:10.233875 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4d2c79b-27a4-471c-8eaa-41429adc48c2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:10.234324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e4d2c79b-27a4-471c-8eaa-41429adc48c2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:10.291949 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e4d2c79b-27a4-471c-8eaa-41429adc48c2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:10.300027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e4d2c79b-27a4-471c-8eaa-41429adc48c2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078167 Mar 08 04:50:10.300586 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1405/2864] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:11.316972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-733d28fe-b637-4377-8524-22003da28d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:11.317564 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-733d28fe-b637-4377-8524-22003da28d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:11.324041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-733d28fe-b637-4377-8524-22003da28d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:11.324481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-733d28fe-b637-4377-8524-22003da28d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:11.325230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-733d28fe-b637-4377-8524-22003da28d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:11.325677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-733d28fe-b637-4377-8524-22003da28d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:11.387768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-733d28fe-b637-4377-8524-22003da28d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:11.396216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-733d28fe-b637-4377-8524-22003da28d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083099 Mar 08 04:50:11.396765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1460/2865] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:12.413041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a3079a17-ac62-4010-b0e5-3ac09a790b90 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:12.413646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a3079a17-ac62-4010-b0e5-3ac09a790b90 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:12.420183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3079a17-ac62-4010-b0e5-3ac09a790b90 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:12.420802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3079a17-ac62-4010-b0e5-3ac09a790b90 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:12.421572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3079a17-ac62-4010-b0e5-3ac09a790b90 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:12.422042 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a3079a17-ac62-4010-b0e5-3ac09a790b90 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:12.480093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a3079a17-ac62-4010-b0e5-3ac09a790b90 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:12.487717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a3079a17-ac62-4010-b0e5-3ac09a790b90 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078531 Mar 08 04:50:12.488275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1406/2866] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:13.504087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f730e1bb-8c0b-40ca-88c9-0f62d91b14d8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:13.504695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f730e1bb-8c0b-40ca-88c9-0f62d91b14d8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:13.511065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f730e1bb-8c0b-40ca-88c9-0f62d91b14d8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:13.511543 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f730e1bb-8c0b-40ca-88c9-0f62d91b14d8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:13.512307 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f730e1bb-8c0b-40ca-88c9-0f62d91b14d8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:13.512744 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f730e1bb-8c0b-40ca-88c9-0f62d91b14d8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:13.571341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f730e1bb-8c0b-40ca-88c9-0f62d91b14d8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:13.579364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f730e1bb-8c0b-40ca-88c9-0f62d91b14d8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079124 Mar 08 04:50:13.579918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1461/2867] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:14.596418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a9caee7d-2ed5-453e-8895-5a1f58041707 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:14.597080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a9caee7d-2ed5-453e-8895-5a1f58041707 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:14.604726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-2ed5-453e-8895-5a1f58041707 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:14.605897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-2ed5-453e-8895-5a1f58041707 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:14.606698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-2ed5-453e-8895-5a1f58041707 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:14.607141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-2ed5-453e-8895-5a1f58041707 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:14.671135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a9caee7d-2ed5-453e-8895-5a1f58041707 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:14.678648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a9caee7d-2ed5-453e-8895-5a1f58041707 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.086634 Mar 08 04:50:14.679212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1407/2868] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:15.695299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-96b97cb8-e181-4020-a051-dcbb6a07d428 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:15.695915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-96b97cb8-e181-4020-a051-dcbb6a07d428 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:15.702341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96b97cb8-e181-4020-a051-dcbb6a07d428 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:15.702799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96b97cb8-e181-4020-a051-dcbb6a07d428 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:15.703570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96b97cb8-e181-4020-a051-dcbb6a07d428 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:15.704019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-96b97cb8-e181-4020-a051-dcbb6a07d428 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:15.765439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-96b97cb8-e181-4020-a051-dcbb6a07d428 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:15.773363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-96b97cb8-e181-4020-a051-dcbb6a07d428 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081971 Mar 08 04:50:15.773943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1462/2869] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:16.790001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-abcd0e6f-451e-4655-ab7d-596bc8d3ca50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:16.790613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-abcd0e6f-451e-4655-ab7d-596bc8d3ca50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:16.796856 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-abcd0e6f-451e-4655-ab7d-596bc8d3ca50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:16.797306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-abcd0e6f-451e-4655-ab7d-596bc8d3ca50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:16.798094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-abcd0e6f-451e-4655-ab7d-596bc8d3ca50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:16.798535 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-abcd0e6f-451e-4655-ab7d-596bc8d3ca50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:16.858976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-abcd0e6f-451e-4655-ab7d-596bc8d3ca50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:16.866726 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-abcd0e6f-451e-4655-ab7d-596bc8d3ca50 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080654 Mar 08 04:50:16.867277 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1408/2870] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:16 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:17.883785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7f091955-75db-43df-8883-0365b2dee47c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:17.884323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7f091955-75db-43df-8883-0365b2dee47c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:17.890855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f091955-75db-43df-8883-0365b2dee47c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:17.891298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f091955-75db-43df-8883-0365b2dee47c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:17.892054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f091955-75db-43df-8883-0365b2dee47c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:17.892492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7f091955-75db-43df-8883-0365b2dee47c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:17.952114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7f091955-75db-43df-8883-0365b2dee47c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:17.959727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7f091955-75db-43df-8883-0365b2dee47c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080014 Mar 08 04:50:17.960292 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1463/2871] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:18.976343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c03f006a-70fd-48f2-ab6c-4b3c034edeb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:18.976939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c03f006a-70fd-48f2-ab6c-4b3c034edeb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:18.983223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c03f006a-70fd-48f2-ab6c-4b3c034edeb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:18.983678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c03f006a-70fd-48f2-ab6c-4b3c034edeb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:18.984448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c03f006a-70fd-48f2-ab6c-4b3c034edeb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:18.984891 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c03f006a-70fd-48f2-ab6c-4b3c034edeb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:19.043204 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c03f006a-70fd-48f2-ab6c-4b3c034edeb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:19.051008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c03f006a-70fd-48f2-ab6c-4b3c034edeb5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078608 Mar 08 04:50:19.051562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1409/2872] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:20.067520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0f83baa0-19cb-4e43-bc8c-442cb518a271 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:20.068199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0f83baa0-19cb-4e43-bc8c-442cb518a271 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:20.074414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f83baa0-19cb-4e43-bc8c-442cb518a271 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:20.074858 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f83baa0-19cb-4e43-bc8c-442cb518a271 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:20.075626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f83baa0-19cb-4e43-bc8c-442cb518a271 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:20.076928 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f83baa0-19cb-4e43-bc8c-442cb518a271 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:20.134993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0f83baa0-19cb-4e43-bc8c-442cb518a271 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:20.147778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0f83baa0-19cb-4e43-bc8c-442cb518a271 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.084026 Mar 08 04:50:20.148358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1464/2873] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:20 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:21.164629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ff2347d8-aa15-4931-9cd0-f90bdfd05a33 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:21.165278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ff2347d8-aa15-4931-9cd0-f90bdfd05a33 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:21.171636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff2347d8-aa15-4931-9cd0-f90bdfd05a33 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:21.172085 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff2347d8-aa15-4931-9cd0-f90bdfd05a33 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:21.172843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff2347d8-aa15-4931-9cd0-f90bdfd05a33 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:21.173280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ff2347d8-aa15-4931-9cd0-f90bdfd05a33 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:21.231164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ff2347d8-aa15-4931-9cd0-f90bdfd05a33 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:21.238857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ff2347d8-aa15-4931-9cd0-f90bdfd05a33 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078246 Mar 08 04:50:21.239418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1410/2874] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:21 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:22.256151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c020dbde-d339-4675-99a4-613d51de40a2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:22.256716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c020dbde-d339-4675-99a4-613d51de40a2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:22.263082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c020dbde-d339-4675-99a4-613d51de40a2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:22.264325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c020dbde-d339-4675-99a4-613d51de40a2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:22.265269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c020dbde-d339-4675-99a4-613d51de40a2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:22.265742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c020dbde-d339-4675-99a4-613d51de40a2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:22.329443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c020dbde-d339-4675-99a4-613d51de40a2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:22.337197 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c020dbde-d339-4675-99a4-613d51de40a2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.085008 Mar 08 04:50:22.337775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1465/2875] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:23.353951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-95e6b33a-a85b-4916-9a7c-52a8abefce7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:23.354591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-95e6b33a-a85b-4916-9a7c-52a8abefce7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:23.360912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95e6b33a-a85b-4916-9a7c-52a8abefce7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:23.361357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95e6b33a-a85b-4916-9a7c-52a8abefce7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:23.362151 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95e6b33a-a85b-4916-9a7c-52a8abefce7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:23.362585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95e6b33a-a85b-4916-9a7c-52a8abefce7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:23.424577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-95e6b33a-a85b-4916-9a7c-52a8abefce7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:23.432243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-95e6b33a-a85b-4916-9a7c-52a8abefce7c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082158 Mar 08 04:50:23.432796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1411/2876] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:24.447855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-157b015a-55de-4835-9c76-1594b30160e2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:24.448464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-157b015a-55de-4835-9c76-1594b30160e2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:24.454842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-157b015a-55de-4835-9c76-1594b30160e2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:24.455287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-157b015a-55de-4835-9c76-1594b30160e2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:24.456051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-157b015a-55de-4835-9c76-1594b30160e2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:24.456487 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-157b015a-55de-4835-9c76-1594b30160e2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:24.513935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-157b015a-55de-4835-9c76-1594b30160e2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:24.522361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-157b015a-55de-4835-9c76-1594b30160e2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078430 Mar 08 04:50:24.522925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1466/2877] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:24 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:25.539608 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e0d8d8bd-973b-4a43-81ab-effb4ac3998b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:25.540190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e0d8d8bd-973b-4a43-81ab-effb4ac3998b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:25.546879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0d8d8bd-973b-4a43-81ab-effb4ac3998b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:25.547325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0d8d8bd-973b-4a43-81ab-effb4ac3998b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:25.548076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0d8d8bd-973b-4a43-81ab-effb4ac3998b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:25.548500 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e0d8d8bd-973b-4a43-81ab-effb4ac3998b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:25.606377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e0d8d8bd-973b-4a43-81ab-effb4ac3998b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:25.614590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e0d8d8bd-973b-4a43-81ab-effb4ac3998b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078879 Mar 08 04:50:25.615148 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1412/2878] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:25 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:26.632551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-31bb733c-4f41-4d69-b348-767d66370102 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:26.633143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-31bb733c-4f41-4d69-b348-767d66370102 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:26.640119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31bb733c-4f41-4d69-b348-767d66370102 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:26.640708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31bb733c-4f41-4d69-b348-767d66370102 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:26.641470 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31bb733c-4f41-4d69-b348-767d66370102 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:26.641923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-31bb733c-4f41-4d69-b348-767d66370102 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:26.702987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-31bb733c-4f41-4d69-b348-767d66370102 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:26.710714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-31bb733c-4f41-4d69-b348-767d66370102 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082411 Mar 08 04:50:26.711283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1467/2879] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:27.727156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7b0203c3-facd-4553-a3cc-dcc2264b144d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:27.727760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7b0203c3-facd-4553-a3cc-dcc2264b144d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:27.734006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b0203c3-facd-4553-a3cc-dcc2264b144d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:27.734451 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b0203c3-facd-4553-a3cc-dcc2264b144d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:27.735203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b0203c3-facd-4553-a3cc-dcc2264b144d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:27.735634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7b0203c3-facd-4553-a3cc-dcc2264b144d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:27.793760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7b0203c3-facd-4553-a3cc-dcc2264b144d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:27.801564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7b0203c3-facd-4553-a3cc-dcc2264b144d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078265 Mar 08 04:50:27.802147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1413/2880] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:27 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:28.818231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-53b0431b-9415-4b69-af2e-bb17d3c67afc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:28.818826 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-53b0431b-9415-4b69-af2e-bb17d3c67afc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:28.825051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-53b0431b-9415-4b69-af2e-bb17d3c67afc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:28.825498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-53b0431b-9415-4b69-af2e-bb17d3c67afc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:28.827171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-53b0431b-9415-4b69-af2e-bb17d3c67afc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:28.827617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-53b0431b-9415-4b69-af2e-bb17d3c67afc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:28.889578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-53b0431b-9415-4b69-af2e-bb17d3c67afc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:28.897530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-53b0431b-9415-4b69-af2e-bb17d3c67afc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083279 Mar 08 04:50:28.898109 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1468/2881] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:29.914386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4778ae27-d02b-49c2-afcd-e5c66e5c9589 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:29.915002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4778ae27-d02b-49c2-afcd-e5c66e5c9589 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:29.921985 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4778ae27-d02b-49c2-afcd-e5c66e5c9589 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:29.922431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4778ae27-d02b-49c2-afcd-e5c66e5c9589 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:29.923193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4778ae27-d02b-49c2-afcd-e5c66e5c9589 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:29.923636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4778ae27-d02b-49c2-afcd-e5c66e5c9589 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:29.980911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4778ae27-d02b-49c2-afcd-e5c66e5c9589 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:29.989052 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4778ae27-d02b-49c2-afcd-e5c66e5c9589 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078666 Mar 08 04:50:29.989602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1414/2882] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:29 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:31.005145 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b6fc59ca-7449-4528-a2d7-3e0b82c2dd2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:31.005784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b6fc59ca-7449-4528-a2d7-3e0b82c2dd2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:31.012414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b6fc59ca-7449-4528-a2d7-3e0b82c2dd2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:31.012857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b6fc59ca-7449-4528-a2d7-3e0b82c2dd2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:31.013634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b6fc59ca-7449-4528-a2d7-3e0b82c2dd2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:31.014687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b6fc59ca-7449-4528-a2d7-3e0b82c2dd2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:31.080432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b6fc59ca-7449-4528-a2d7-3e0b82c2dd2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:31.088001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b6fc59ca-7449-4528-a2d7-3e0b82c2dd2c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.086718 Mar 08 04:50:31.088562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1469/2883] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:32.104258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ce70f23d-50fb-4606-a0aa-1d16f0680882 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:32.104899 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ce70f23d-50fb-4606-a0aa-1d16f0680882 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:32.111140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce70f23d-50fb-4606-a0aa-1d16f0680882 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:32.111591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce70f23d-50fb-4606-a0aa-1d16f0680882 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:32.112388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce70f23d-50fb-4606-a0aa-1d16f0680882 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:32.112827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ce70f23d-50fb-4606-a0aa-1d16f0680882 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:32.171394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ce70f23d-50fb-4606-a0aa-1d16f0680882 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:32.179191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ce70f23d-50fb-4606-a0aa-1d16f0680882 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078791 Mar 08 04:50:32.179765 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1415/2884] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:50:33.196105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-69a8c650-0ceb-47ba-aef8-5275074e10cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:33.196696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-69a8c650-0ceb-47ba-aef8-5275074e10cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:33.203724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69a8c650-0ceb-47ba-aef8-5275074e10cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:33.204177 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69a8c650-0ceb-47ba-aef8-5275074e10cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:33.204937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69a8c650-0ceb-47ba-aef8-5275074e10cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:33.205375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-69a8c650-0ceb-47ba-aef8-5275074e10cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:33.262209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-69a8c650-0ceb-47ba-aef8-5275074e10cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:33.270959 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-69a8c650-0ceb-47ba-aef8-5275074e10cf tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078670 Mar 08 04:50:33.271527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1470/2885] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:34.288398 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6a747cac-2e71-4241-a605-7b5bf553716d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:34.289002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6a747cac-2e71-4241-a605-7b5bf553716d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:34.295754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a747cac-2e71-4241-a605-7b5bf553716d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:34.296242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a747cac-2e71-4241-a605-7b5bf553716d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:34.297012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a747cac-2e71-4241-a605-7b5bf553716d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:34.297442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6a747cac-2e71-4241-a605-7b5bf553716d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:34.356350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6a747cac-2e71-4241-a605-7b5bf553716d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:34.364481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6a747cac-2e71-4241-a605-7b5bf553716d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079896 Mar 08 04:50:34.365037 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1416/2886] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:34 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:50:35.381641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3894d77c-dc6e-47bb-8d23-dce08ddf0b6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:35.382271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3894d77c-dc6e-47bb-8d23-dce08ddf0b6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:35.389344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3894d77c-dc6e-47bb-8d23-dce08ddf0b6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:35.389897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3894d77c-dc6e-47bb-8d23-dce08ddf0b6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:35.390655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3894d77c-dc6e-47bb-8d23-dce08ddf0b6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:35.391087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3894d77c-dc6e-47bb-8d23-dce08ddf0b6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:35.452999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3894d77c-dc6e-47bb-8d23-dce08ddf0b6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:35.460786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3894d77c-dc6e-47bb-8d23-dce08ddf0b6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083061 Mar 08 04:50:35.461349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1471/2887] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:36.477345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b0822eac-0a2a-4d51-af52-49ac0c5bece5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:36.478025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b0822eac-0a2a-4d51-af52-49ac0c5bece5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:36.484531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0822eac-0a2a-4d51-af52-49ac0c5bece5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:36.485002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0822eac-0a2a-4d51-af52-49ac0c5bece5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:36.485782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0822eac-0a2a-4d51-af52-49ac0c5bece5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:36.486213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b0822eac-0a2a-4d51-af52-49ac0c5bece5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:36.545918 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b0822eac-0a2a-4d51-af52-49ac0c5bece5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:36.553480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b0822eac-0a2a-4d51-af52-49ac0c5bece5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079967 Mar 08 04:50:36.554064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1417/2888] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:37.569962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-48ff8260-1123-4c88-9989-198ccc509ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:37.570581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-48ff8260-1123-4c88-9989-198ccc509ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:37.577563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48ff8260-1123-4c88-9989-198ccc509ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:37.578041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48ff8260-1123-4c88-9989-198ccc509ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:37.578806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48ff8260-1123-4c88-9989-198ccc509ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:37.579244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48ff8260-1123-4c88-9989-198ccc509ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:37.637817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-48ff8260-1123-4c88-9989-198ccc509ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:37.646405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-48ff8260-1123-4c88-9989-198ccc509ecd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080381 Mar 08 04:50:37.646954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1472/2889] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:38.662909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7940458f-ea45-423e-901c-8d64f7c9f4ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:38.663498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7940458f-ea45-423e-901c-8d64f7c9f4ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:38.670416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7940458f-ea45-423e-901c-8d64f7c9f4ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:38.670869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7940458f-ea45-423e-901c-8d64f7c9f4ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:38.671626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7940458f-ea45-423e-901c-8d64f7c9f4ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:38.672057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7940458f-ea45-423e-901c-8d64f7c9f4ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:38.730602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7940458f-ea45-423e-901c-8d64f7c9f4ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:38.738879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7940458f-ea45-423e-901c-8d64f7c9f4ef tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079821 Mar 08 04:50:38.739464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1418/2890] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:38 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:39.755394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2c27d8dd-69a7-43b4-9f72-65134f4eb642 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:39.756036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2c27d8dd-69a7-43b4-9f72-65134f4eb642 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:39.762355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c27d8dd-69a7-43b4-9f72-65134f4eb642 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:39.762820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c27d8dd-69a7-43b4-9f72-65134f4eb642 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:39.764105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c27d8dd-69a7-43b4-9f72-65134f4eb642 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:39.764834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2c27d8dd-69a7-43b4-9f72-65134f4eb642 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:39.824101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2c27d8dd-69a7-43b4-9f72-65134f4eb642 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:39.832656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2c27d8dd-69a7-43b4-9f72-65134f4eb642 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081115 Mar 08 04:50:39.833212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1473/2891] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:39.985843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:50:39.986044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:50:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:50:40.848333 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9074f1df-3c37-48dc-8186-347bc5eab15e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:40.848941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9074f1df-3c37-48dc-8186-347bc5eab15e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:40.855240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9074f1df-3c37-48dc-8186-347bc5eab15e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:40.855682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9074f1df-3c37-48dc-8186-347bc5eab15e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:40.856448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9074f1df-3c37-48dc-8186-347bc5eab15e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:40.856878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9074f1df-3c37-48dc-8186-347bc5eab15e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:40.915474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9074f1df-3c37-48dc-8186-347bc5eab15e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:40.923361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9074f1df-3c37-48dc-8186-347bc5eab15e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078884 Mar 08 04:50:40.923912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1419/2892] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:41.940305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cccfb59d-eb1b-4a8f-a9ef-98885e839662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:41.940912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cccfb59d-eb1b-4a8f-a9ef-98885e839662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:41.947153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cccfb59d-eb1b-4a8f-a9ef-98885e839662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:41.947599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cccfb59d-eb1b-4a8f-a9ef-98885e839662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:41.948353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cccfb59d-eb1b-4a8f-a9ef-98885e839662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:41.948784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cccfb59d-eb1b-4a8f-a9ef-98885e839662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:42.010575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cccfb59d-eb1b-4a8f-a9ef-98885e839662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:42.018540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cccfb59d-eb1b-4a8f-a9ef-98885e839662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082089 Mar 08 04:50:42.019088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1474/2893] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:43.036570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e47d327e-eb99-4567-9319-18ef265b79ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:43.037185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e47d327e-eb99-4567-9319-18ef265b79ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:43.043409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e47d327e-eb99-4567-9319-18ef265b79ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:43.043849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e47d327e-eb99-4567-9319-18ef265b79ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:43.045212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e47d327e-eb99-4567-9319-18ef265b79ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:43.045694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e47d327e-eb99-4567-9319-18ef265b79ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:43.104103 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e47d327e-eb99-4567-9319-18ef265b79ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:43.112409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e47d327e-eb99-4567-9319-18ef265b79ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079933 Mar 08 04:50:43.112971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1420/2894] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:44.129726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4c9e2db0-faa4-4ef3-8c0f-c5cb930e2ef2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:44.130333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4c9e2db0-faa4-4ef3-8c0f-c5cb930e2ef2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:44.136780 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c9e2db0-faa4-4ef3-8c0f-c5cb930e2ef2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:44.137233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c9e2db0-faa4-4ef3-8c0f-c5cb930e2ef2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:44.138044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c9e2db0-faa4-4ef3-8c0f-c5cb930e2ef2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:44.138624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c9e2db0-faa4-4ef3-8c0f-c5cb930e2ef2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:44.197061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4c9e2db0-faa4-4ef3-8c0f-c5cb930e2ef2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:44.204729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4c9e2db0-faa4-4ef3-8c0f-c5cb930e2ef2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078939 Mar 08 04:50:44.205336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1475/2895] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:45.224161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-94c2a1b9-0ffc-421b-bf46-aa4f49edb563 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:45.224787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-94c2a1b9-0ffc-421b-bf46-aa4f49edb563 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:45.230948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94c2a1b9-0ffc-421b-bf46-aa4f49edb563 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:45.231398 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94c2a1b9-0ffc-421b-bf46-aa4f49edb563 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:45.232807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94c2a1b9-0ffc-421b-bf46-aa4f49edb563 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:45.233297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-94c2a1b9-0ffc-421b-bf46-aa4f49edb563 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:45.292259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-94c2a1b9-0ffc-421b-bf46-aa4f49edb563 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:45.300604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-94c2a1b9-0ffc-421b-bf46-aa4f49edb563 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081857 Mar 08 04:50:45.301153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1421/2896] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:50:46.317162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-225e31ec-56fe-470d-a141-99c14c07d6de tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:46.317786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-225e31ec-56fe-470d-a141-99c14c07d6de tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:46.324026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-225e31ec-56fe-470d-a141-99c14c07d6de tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:46.324477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-225e31ec-56fe-470d-a141-99c14c07d6de tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:46.325237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-225e31ec-56fe-470d-a141-99c14c07d6de tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:46.325749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-225e31ec-56fe-470d-a141-99c14c07d6de tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:46.388424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-225e31ec-56fe-470d-a141-99c14c07d6de tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:46.396315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-225e31ec-56fe-470d-a141-99c14c07d6de tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082998 Mar 08 04:50:46.396872 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1476/2897] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:47.415163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7666317d-54c0-4db4-a03b-ee01adb9c01c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:47.415759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7666317d-54c0-4db4-a03b-ee01adb9c01c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:47.422758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7666317d-54c0-4db4-a03b-ee01adb9c01c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:47.423212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7666317d-54c0-4db4-a03b-ee01adb9c01c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:47.423975 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7666317d-54c0-4db4-a03b-ee01adb9c01c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:47.424416 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7666317d-54c0-4db4-a03b-ee01adb9c01c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:47.486021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7666317d-54c0-4db4-a03b-ee01adb9c01c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:47.493779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7666317d-54c0-4db4-a03b-ee01adb9c01c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082476 Mar 08 04:50:47.494335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1422/2898] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:48.510432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7311ef27-1d92-4a9e-ab5a-dd3c331702c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:48.511042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7311ef27-1d92-4a9e-ab5a-dd3c331702c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:48.517149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7311ef27-1d92-4a9e-ab5a-dd3c331702c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:48.517912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7311ef27-1d92-4a9e-ab5a-dd3c331702c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:48.518670 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7311ef27-1d92-4a9e-ab5a-dd3c331702c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:48.519116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7311ef27-1d92-4a9e-ab5a-dd3c331702c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:48.577420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7311ef27-1d92-4a9e-ab5a-dd3c331702c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:48.585135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7311ef27-1d92-4a9e-ab5a-dd3c331702c5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078765 Mar 08 04:50:48.585719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1477/2899] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:49.601578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-27b936e2-316e-4841-82e2-3e774bf70384 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:49.602223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-27b936e2-316e-4841-82e2-3e774bf70384 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:49.609285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27b936e2-316e-4841-82e2-3e774bf70384 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:49.609775 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27b936e2-316e-4841-82e2-3e774bf70384 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:49.610536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27b936e2-316e-4841-82e2-3e774bf70384 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:49.610970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-27b936e2-316e-4841-82e2-3e774bf70384 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:49.670727 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-27b936e2-316e-4841-82e2-3e774bf70384 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:49.678402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-27b936e2-316e-4841-82e2-3e774bf70384 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080669 Mar 08 04:50:49.678965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1423/2900] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:50.694804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b400a181-a4a0-4767-b00e-4448e2dfd5d9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:50.695412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b400a181-a4a0-4767-b00e-4448e2dfd5d9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:50.701584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b400a181-a4a0-4767-b00e-4448e2dfd5d9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:50.702053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b400a181-a4a0-4767-b00e-4448e2dfd5d9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:50.702802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b400a181-a4a0-4767-b00e-4448e2dfd5d9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:50.703234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b400a181-a4a0-4767-b00e-4448e2dfd5d9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:50.761094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b400a181-a4a0-4767-b00e-4448e2dfd5d9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:50.769535 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b400a181-a4a0-4767-b00e-4448e2dfd5d9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078626 Mar 08 04:50:50.770132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1478/2901] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:50 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:51.785750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9b2d45bc-0229-4d67-b8dc-4096746cb17e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:51.786367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9b2d45bc-0229-4d67-b8dc-4096746cb17e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:51.792656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b2d45bc-0229-4d67-b8dc-4096746cb17e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:51.793112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b2d45bc-0229-4d67-b8dc-4096746cb17e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:51.793904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b2d45bc-0229-4d67-b8dc-4096746cb17e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:51.794889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9b2d45bc-0229-4d67-b8dc-4096746cb17e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:51.860050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9b2d45bc-0229-4d67-b8dc-4096746cb17e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:51.867954 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9b2d45bc-0229-4d67-b8dc-4096746cb17e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.086127 Mar 08 04:50:51.868530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1424/2902] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:52.885688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-32daad50-7e99-4ecc-b29c-47f39f9dbb4b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:52.886289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-32daad50-7e99-4ecc-b29c-47f39f9dbb4b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:52.892953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32daad50-7e99-4ecc-b29c-47f39f9dbb4b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:52.893401 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32daad50-7e99-4ecc-b29c-47f39f9dbb4b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:52.894191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32daad50-7e99-4ecc-b29c-47f39f9dbb4b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:52.894626 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-32daad50-7e99-4ecc-b29c-47f39f9dbb4b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:52.954362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-32daad50-7e99-4ecc-b29c-47f39f9dbb4b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:52.962231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-32daad50-7e99-4ecc-b29c-47f39f9dbb4b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080419 Mar 08 04:50:52.962797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1479/2903] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:53.978776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0af80502-6d02-415f-a7b7-bc136676d9d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:53.979497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0af80502-6d02-415f-a7b7-bc136676d9d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:53.985812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0af80502-6d02-415f-a7b7-bc136676d9d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:53.986264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0af80502-6d02-415f-a7b7-bc136676d9d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:53.987028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0af80502-6d02-415f-a7b7-bc136676d9d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:53.987464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0af80502-6d02-415f-a7b7-bc136676d9d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:54.049758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0af80502-6d02-415f-a7b7-bc136676d9d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:54.057430 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0af80502-6d02-415f-a7b7-bc136676d9d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082548 Mar 08 04:50:54.058023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1425/2904] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:50:55.073833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a3976dc2-f8e5-41ad-a27f-00d1155e1ae9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:55.074380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a3976dc2-f8e5-41ad-a27f-00d1155e1ae9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:55.080648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3976dc2-f8e5-41ad-a27f-00d1155e1ae9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:55.081085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3976dc2-f8e5-41ad-a27f-00d1155e1ae9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:55.081875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3976dc2-f8e5-41ad-a27f-00d1155e1ae9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:55.082309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a3976dc2-f8e5-41ad-a27f-00d1155e1ae9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:55.142194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a3976dc2-f8e5-41ad-a27f-00d1155e1ae9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:55.150043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a3976dc2-f8e5-41ad-a27f-00d1155e1ae9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080215 Mar 08 04:50:55.150598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1480/2905] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:56.166610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-31291e4a-ff5f-46ca-828c-91b631752a88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:56.167216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-31291e4a-ff5f-46ca-828c-91b631752a88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:56.173987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31291e4a-ff5f-46ca-828c-91b631752a88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:56.174440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31291e4a-ff5f-46ca-828c-91b631752a88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:56.175200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31291e4a-ff5f-46ca-828c-91b631752a88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:56.175636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31291e4a-ff5f-46ca-828c-91b631752a88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:56.233373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-31291e4a-ff5f-46ca-828c-91b631752a88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:56.240968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-31291e4a-ff5f-46ca-828c-91b631752a88 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078242 Mar 08 04:50:56.241525 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1426/2906] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:57.257955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6976fd7f-52ab-4be0-b6d7-5ba54c36a84d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:57.258556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6976fd7f-52ab-4be0-b6d7-5ba54c36a84d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:57.265341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6976fd7f-52ab-4be0-b6d7-5ba54c36a84d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:57.265814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6976fd7f-52ab-4be0-b6d7-5ba54c36a84d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:57.266569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6976fd7f-52ab-4be0-b6d7-5ba54c36a84d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:57.267002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6976fd7f-52ab-4be0-b6d7-5ba54c36a84d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:57.325140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6976fd7f-52ab-4be0-b6d7-5ba54c36a84d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:57.332917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6976fd7f-52ab-4be0-b6d7-5ba54c36a84d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078722 Mar 08 04:50:57.333474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1481/2907] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:58.350090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0e48756c-12ff-42cf-bf65-63a6f6c5d205 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:58.350709 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0e48756c-12ff-42cf-bf65-63a6f6c5d205 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:58.357427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e48756c-12ff-42cf-bf65-63a6f6c5d205 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:58.357922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e48756c-12ff-42cf-bf65-63a6f6c5d205 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:58.358694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e48756c-12ff-42cf-bf65-63a6f6c5d205 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:58.359134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0e48756c-12ff-42cf-bf65-63a6f6c5d205 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:58.417008 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0e48756c-12ff-42cf-bf65-63a6f6c5d205 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:58.425346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0e48756c-12ff-42cf-bf65-63a6f6c5d205 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079234 Mar 08 04:50:58.425965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1427/2908] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:50:59.441602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-45286671-20ae-450d-ae72-9b87fa791db6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:50:59.442234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-45286671-20ae-450d-ae72-9b87fa791db6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:50:59.448404 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45286671-20ae-450d-ae72-9b87fa791db6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:59.448852 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45286671-20ae-450d-ae72-9b87fa791db6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:59.449604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45286671-20ae-450d-ae72-9b87fa791db6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:50:59.450064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-45286671-20ae-450d-ae72-9b87fa791db6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:50:59.510435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-45286671-20ae-450d-ae72-9b87fa791db6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:50:59.518586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-45286671-20ae-450d-ae72-9b87fa791db6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080776 Mar 08 04:50:59.519138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1482/2909] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:50:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:00.535071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ba8636c2-07a5-4e79-a685-a89d5b0d28df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:00.535679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ba8636c2-07a5-4e79-a685-a89d5b0d28df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:00.541959 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba8636c2-07a5-4e79-a685-a89d5b0d28df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:00.542406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba8636c2-07a5-4e79-a685-a89d5b0d28df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:00.543164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba8636c2-07a5-4e79-a685-a89d5b0d28df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:00.543602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba8636c2-07a5-4e79-a685-a89d5b0d28df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:00.604810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ba8636c2-07a5-4e79-a685-a89d5b0d28df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:00.613045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ba8636c2-07a5-4e79-a685-a89d5b0d28df tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081830 Mar 08 04:51:00.613613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1428/2910] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:01.506446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ba7678e0-39ec-46fe-87d4-e1e4c60786e5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:01.506946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ba7678e0-39ec-46fe-87d4-e1e4c60786e5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:01.513220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba7678e0-39ec-46fe-87d4-e1e4c60786e5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:01.513778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba7678e0-39ec-46fe-87d4-e1e4c60786e5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:01.514613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba7678e0-39ec-46fe-87d4-e1e4c60786e5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:01.515101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba7678e0-39ec-46fe-87d4-e1e4c60786e5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:01.542633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ba7678e0-39ec-46fe-87d4-e1e4c60786e5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Going to try to terminate instance {{(pid=116774) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:51:01.615059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ba7678e0-39ec-46fe-87d4-e1e4c60786e5 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 204 len: 0 microversion: 2.1 time: 0.221524 Mar 08 04:51:01.615731 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1483/2911] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:51:01 2022] DELETE /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:51:01.625080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6bd7d486-86ad-469c-b8d2-456b288a0baa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:01.625819 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6bd7d486-86ad-469c-b8d2-456b288a0baa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:01.629851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-469157a2-9a20-42e0-bf83-9f06561cab07 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:01.630556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-469157a2-9a20-42e0-bf83-9f06561cab07 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:01.632138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6bd7d486-86ad-469c-b8d2-456b288a0baa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:01.632594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6bd7d486-86ad-469c-b8d2-456b288a0baa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:01.633367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6bd7d486-86ad-469c-b8d2-456b288a0baa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:01.633846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6bd7d486-86ad-469c-b8d2-456b288a0baa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:01.636155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-469157a2-9a20-42e0-bf83-9f06561cab07 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:01.636601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-469157a2-9a20-42e0-bf83-9f06561cab07 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:01.637365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-469157a2-9a20-42e0-bf83-9f06561cab07 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:01.638477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-469157a2-9a20-42e0-bf83-9f06561cab07 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:01.719059 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-469157a2-9a20-42e0-bf83-9f06561cab07 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:01.726859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-469157a2-9a20-42e0-bf83-9f06561cab07 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.101204 Mar 08 04:51:01.727592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1484/2912] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:51:01.792305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6bd7d486-86ad-469c-b8d2-456b288a0baa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:01.800308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6bd7d486-86ad-469c-b8d2-456b288a0baa tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1679 microversion: 2.1 time: 0.179692 Mar 08 04:51:01.800870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1429/2913] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:01 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:51:02.744419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-aff3258f-2e33-47a8-9834-a90ba507e81a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:02.745066 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-aff3258f-2e33-47a8-9834-a90ba507e81a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:02.753403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aff3258f-2e33-47a8-9834-a90ba507e81a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:02.753880 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aff3258f-2e33-47a8-9834-a90ba507e81a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:02.755306 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aff3258f-2e33-47a8-9834-a90ba507e81a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:02.755664 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aff3258f-2e33-47a8-9834-a90ba507e81a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:02.818097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-22917eb6-4e01-459e-945d-35a4d24a4f2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:02.818764 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-22917eb6-4e01-459e-945d-35a4d24a4f2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:02.825144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22917eb6-4e01-459e-945d-35a4d24a4f2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:02.825591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22917eb6-4e01-459e-945d-35a4d24a4f2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:02.826389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22917eb6-4e01-459e-945d-35a4d24a4f2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:02.826826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22917eb6-4e01-459e-945d-35a4d24a4f2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:02.834212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-aff3258f-2e33-47a8-9834-a90ba507e81a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:02.842304 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-aff3258f-2e33-47a8-9834-a90ba507e81a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.101713 Mar 08 04:51:02.843003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1485/2914] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:02.978067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-22917eb6-4e01-459e-945d-35a4d24a4f2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:02.986944 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-22917eb6-4e01-459e-945d-35a4d24a4f2f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1679 microversion: 2.1 time: 0.172848 Mar 08 04:51:02.987619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1430/2915] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:02 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:51:03.772798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-927dd174-62fe-411c-a292-f07b8aa6ac51 req-97056d2c-ca39-411d-916a-8ff14f39f4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f49fb8-e371-4715-882a-b690939877b8", "name": "network-vif-deleted", "tag": "3454109a-049b-4f5f-a7c9-c1f96f36527b"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:51:03.784813 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-927dd174-62fe-411c-a292-f07b8aa6ac51 req-97056d2c-ca39-411d-916a-8ff14f39f4dc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:03.785266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-927dd174-62fe-411c-a292-f07b8aa6ac51 req-97056d2c-ca39-411d-916a-8ff14f39f4dc service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:03.796514 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-927dd174-62fe-411c-a292-f07b8aa6ac51 req-97056d2c-ca39-411d-916a-8ff14f39f4dc service nova] Creating event network-vif-deleted:3454109a-049b-4f5f-a7c9-c1f96f36527b for instance 81f49fb8-e371-4715-882a-b690939877b8 on hv-cinder-73306 Mar 08 04:51:03.801820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-927dd174-62fe-411c-a292-f07b8aa6ac51 req-97056d2c-ca39-411d-916a-8ff14f39f4dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034085 Mar 08 04:51:03.802775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1486/2916] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:51:03.861422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4e9a1baa-31a9-4dd5-888c-b78a821a2932 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:03.862163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4e9a1baa-31a9-4dd5-888c-b78a821a2932 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:03.869067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e9a1baa-31a9-4dd5-888c-b78a821a2932 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:03.869614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e9a1baa-31a9-4dd5-888c-b78a821a2932 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:03.870661 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e9a1baa-31a9-4dd5-888c-b78a821a2932 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:03.871365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4e9a1baa-31a9-4dd5-888c-b78a821a2932 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:03.937526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4e9a1baa-31a9-4dd5-888c-b78a821a2932 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:03.945858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4e9a1baa-31a9-4dd5-888c-b78a821a2932 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.089174 Mar 08 04:51:03.946455 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1431/2917] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:04.014146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:04.014856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:04.021574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:04.022074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:04.022971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:04.023414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:04.053215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:04.053688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:04.054188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lazy-loading 'fault' on Instance uuid 81f49fb8-e371-4715-882a-b690939877b8 {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:51:04.094699 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b00c2d10d9b4dda87645b24f3ebf672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bc0dc0628e4a139d418a8edca8621e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:04.101900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e444d31b-0743-4467-b478-763e042d73be tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 200 len: 1330 microversion: 2.1 time: 0.092863 Mar 08 04:51:04.102460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1487/2918] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:04 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:04.962845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a28fdef0-746d-4d2f-8287-7e29f682f5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:04.963459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a28fdef0-746d-4d2f-8287-7e29f682f5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:04.970407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a28fdef0-746d-4d2f-8287-7e29f682f5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:04.970857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a28fdef0-746d-4d2f-8287-7e29f682f5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:04.971620 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a28fdef0-746d-4d2f-8287-7e29f682f5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:04.972055 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a28fdef0-746d-4d2f-8287-7e29f682f5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:05.034426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a28fdef0-746d-4d2f-8287-7e29f682f5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:05.041948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a28fdef0-746d-4d2f-8287-7e29f682f5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082944 Mar 08 04:51:05.042499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1432/2919] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:05.119300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57d85414-3acb-41f8-b86b-63a9ee587b4f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:05.119909 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-57d85414-3acb-41f8-b86b-63a9ee587b4f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:05.126363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57d85414-3acb-41f8-b86b-63a9ee587b4f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:05.126812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57d85414-3acb-41f8-b86b-63a9ee587b4f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:05.127576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57d85414-3acb-41f8-b86b-63a9ee587b4f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:05.128011 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57d85414-3acb-41f8-b86b-63a9ee587b4f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:05.141396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-57d85414-3acb-41f8-b86b-63a9ee587b4f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance 81f49fb8-e371-4715-882a-b690939877b8 could not be found. Mar 08 04:51:05.142019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57d85414-3acb-41f8-b86b-63a9ee587b4f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance 81f49fb8-e371-4715-882a-b690939877b8 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:51:05.143074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-57d85414-3acb-41f8-b86b-63a9ee587b4f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 404 len: 111 microversion: 2.1 time: 0.027742 Mar 08 04:51:05.143594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1488/2920] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:05 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:51:05.151969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-282cb77e-4b20-4004-a47a-848bccc5c9b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '.version_select at 0x7fe8370e1f70>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:05.169955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-282cb77e-4b20-4004-a47a-848bccc5c9b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-263164407" status: 202 len: 0 microversion: 2.1 time: 0.021733 Mar 08 04:51:05.170532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1433/2921] 10.222.0.30 () {58 vars in 1217 bytes} [Tue Mar 8 04:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-263164407 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:51:05.786189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-87a88fbe-91a7-49c5-b0bb-99cc5dd65c0f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:05.786689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-87a88fbe-91a7-49c5-b0bb-99cc5dd65c0f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:05.792656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87a88fbe-91a7-49c5-b0bb-99cc5dd65c0f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:05.793132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87a88fbe-91a7-49c5-b0bb-99cc5dd65c0f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:05.794563 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87a88fbe-91a7-49c5-b0bb-99cc5dd65c0f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:05.795003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-87a88fbe-91a7-49c5-b0bb-99cc5dd65c0f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:05.807865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-87a88fbe-91a7-49c5-b0bb-99cc5dd65c0f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance 81f49fb8-e371-4715-882a-b690939877b8 could not be found. Mar 08 04:51:05.808444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-87a88fbe-91a7-49c5-b0bb-99cc5dd65c0f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance 81f49fb8-e371-4715-882a-b690939877b8 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:51:05.809260 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-87a88fbe-91a7-49c5-b0bb-99cc5dd65c0f tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 404 len: 111 microversion: 2.1 time: 0.026964 Mar 08 04:51:05.810431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1489/2922] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:51:05 2022] DELETE /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:51:05.818365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-224c7e3f-147e-4328-aea8-fdc7e96d9aef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:05.819078 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-224c7e3f-147e-4328-aea8-fdc7e96d9aef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 81f49fb8-e371-4715-882a-b690939877b8] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:05.825068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-224c7e3f-147e-4328-aea8-fdc7e96d9aef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:05.825520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-224c7e3f-147e-4328-aea8-fdc7e96d9aef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:05.826331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-224c7e3f-147e-4328-aea8-fdc7e96d9aef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:05.826788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-224c7e3f-147e-4328-aea8-fdc7e96d9aef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:05.839491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-224c7e3f-147e-4328-aea8-fdc7e96d9aef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance 81f49fb8-e371-4715-882a-b690939877b8 could not be found. Mar 08 04:51:05.840064 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-224c7e3f-147e-4328-aea8-fdc7e96d9aef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance 81f49fb8-e371-4715-882a-b690939877b8 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:51:05.840874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-224c7e3f-147e-4328-aea8-fdc7e96d9aef tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8" status: 404 len: 111 microversion: 2.1 time: 0.026380 Mar 08 04:51:05.841387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1434/2923] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:05 2022] GET /compute/v2.1/servers/81f49fb8-e371-4715-882a-b690939877b8 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:51:06.057359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3d4ddb44-6475-436b-8608-1043c9d374a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:06.057985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3d4ddb44-6475-436b-8608-1043c9d374a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:06.064373 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d4ddb44-6475-436b-8608-1043c9d374a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:06.064820 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d4ddb44-6475-436b-8608-1043c9d374a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:06.065571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d4ddb44-6475-436b-8608-1043c9d374a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:06.066030 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d4ddb44-6475-436b-8608-1043c9d374a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:06.128101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3d4ddb44-6475-436b-8608-1043c9d374a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:06.135769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3d4ddb44-6475-436b-8608-1043c9d374a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082223 Mar 08 04:51:06.136325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1490/2924] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:07.152379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8724896c-1e8f-40c1-a0d1-ded055e2d1e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:07.153424 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8724896c-1e8f-40c1-a0d1-ded055e2d1e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:07.159831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8724896c-1e8f-40c1-a0d1-ded055e2d1e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:07.160308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8724896c-1e8f-40c1-a0d1-ded055e2d1e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:07.161053 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8724896c-1e8f-40c1-a0d1-ded055e2d1e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:07.161494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8724896c-1e8f-40c1-a0d1-ded055e2d1e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:07.219698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8724896c-1e8f-40c1-a0d1-ded055e2d1e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:07.227388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8724896c-1e8f-40c1-a0d1-ded055e2d1e0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078965 Mar 08 04:51:07.227951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1435/2925] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:08.244490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b1079a6d-8fb8-4999-ae2f-6f60ccce0407 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:08.245078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b1079a6d-8fb8-4999-ae2f-6f60ccce0407 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:08.252108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1079a6d-8fb8-4999-ae2f-6f60ccce0407 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:08.252557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1079a6d-8fb8-4999-ae2f-6f60ccce0407 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:08.253358 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1079a6d-8fb8-4999-ae2f-6f60ccce0407 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:08.253827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1079a6d-8fb8-4999-ae2f-6f60ccce0407 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:08.314000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b1079a6d-8fb8-4999-ae2f-6f60ccce0407 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:08.321786 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b1079a6d-8fb8-4999-ae2f-6f60ccce0407 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081084 Mar 08 04:51:08.322346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1491/2926] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:09.338497 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3d3ad20e-8ec1-4d32-88c2-afb7414f534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:09.339087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3d3ad20e-8ec1-4d32-88c2-afb7414f534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:09.346049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3d3ad20e-8ec1-4d32-88c2-afb7414f534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:09.346546 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3d3ad20e-8ec1-4d32-88c2-afb7414f534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:09.347309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3d3ad20e-8ec1-4d32-88c2-afb7414f534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:09.347749 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3d3ad20e-8ec1-4d32-88c2-afb7414f534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:09.405541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3d3ad20e-8ec1-4d32-88c2-afb7414f534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:09.413203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3d3ad20e-8ec1-4d32-88c2-afb7414f534a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078641 Mar 08 04:51:09.413782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1436/2927] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:09 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:10.430026 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7cf87ae9-df2c-49f4-8d2a-7e3e6dde55fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:10.430643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7cf87ae9-df2c-49f4-8d2a-7e3e6dde55fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:10.437507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7cf87ae9-df2c-49f4-8d2a-7e3e6dde55fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:10.437997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7cf87ae9-df2c-49f4-8d2a-7e3e6dde55fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:10.438768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7cf87ae9-df2c-49f4-8d2a-7e3e6dde55fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:10.439211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7cf87ae9-df2c-49f4-8d2a-7e3e6dde55fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:10.499611 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7cf87ae9-df2c-49f4-8d2a-7e3e6dde55fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:10.507305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7cf87ae9-df2c-49f4-8d2a-7e3e6dde55fc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081132 Mar 08 04:51:10.507860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1492/2928] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:11.523816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4ff77bc5-ec2e-4fc3-b096-c143ac1493af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:11.524398 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4ff77bc5-ec2e-4fc3-b096-c143ac1493af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:11.531155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ff77bc5-ec2e-4fc3-b096-c143ac1493af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:11.531603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ff77bc5-ec2e-4fc3-b096-c143ac1493af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:11.532362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ff77bc5-ec2e-4fc3-b096-c143ac1493af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:11.532793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4ff77bc5-ec2e-4fc3-b096-c143ac1493af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:11.593254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4ff77bc5-ec2e-4fc3-b096-c143ac1493af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:11.600962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4ff77bc5-ec2e-4fc3-b096-c143ac1493af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080964 Mar 08 04:51:11.601529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1437/2929] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:12.618283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d061b714-c401-4348-81c0-d72d15c047a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:12.618894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d061b714-c401-4348-81c0-d72d15c047a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:12.625935 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d061b714-c401-4348-81c0-d72d15c047a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:12.626387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d061b714-c401-4348-81c0-d72d15c047a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:12.627151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d061b714-c401-4348-81c0-d72d15c047a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:12.627591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d061b714-c401-4348-81c0-d72d15c047a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:12.689222 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d061b714-c401-4348-81c0-d72d15c047a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:12.696841 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d061b714-c401-4348-81c0-d72d15c047a0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082484 Mar 08 04:51:12.697407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1493/2930] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:13.713879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-39d651d7-4116-4b97-9162-1812a4309347 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:13.714491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-39d651d7-4116-4b97-9162-1812a4309347 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:13.721223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39d651d7-4116-4b97-9162-1812a4309347 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:13.721682 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39d651d7-4116-4b97-9162-1812a4309347 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:13.722474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39d651d7-4116-4b97-9162-1812a4309347 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:13.722910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-39d651d7-4116-4b97-9162-1812a4309347 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:13.782719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-39d651d7-4116-4b97-9162-1812a4309347 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:13.790432 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-39d651d7-4116-4b97-9162-1812a4309347 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080461 Mar 08 04:51:13.790996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1438/2931] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:14.807253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e4df2fda-6ca0-4f96-a0d9-644a9077b360 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:14.807881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e4df2fda-6ca0-4f96-a0d9-644a9077b360 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:14.817714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e4df2fda-6ca0-4f96-a0d9-644a9077b360 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:14.817714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e4df2fda-6ca0-4f96-a0d9-644a9077b360 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:14.817714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e4df2fda-6ca0-4f96-a0d9-644a9077b360 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:14.817714 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e4df2fda-6ca0-4f96-a0d9-644a9077b360 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:14.874240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e4df2fda-6ca0-4f96-a0d9-644a9077b360 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:14.882578 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e4df2fda-6ca0-4f96-a0d9-644a9077b360 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079172 Mar 08 04:51:14.883135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1494/2932] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:14 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:15.899401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-32a28b01-5e7a-41ea-a6a2-7e6b75d4c9bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:15.900017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-32a28b01-5e7a-41ea-a6a2-7e6b75d4c9bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:15.906799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32a28b01-5e7a-41ea-a6a2-7e6b75d4c9bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:15.907193 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32a28b01-5e7a-41ea-a6a2-7e6b75d4c9bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:15.908115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32a28b01-5e7a-41ea-a6a2-7e6b75d4c9bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:15.908554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-32a28b01-5e7a-41ea-a6a2-7e6b75d4c9bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:16.121219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-32a28b01-5e7a-41ea-a6a2-7e6b75d4c9bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:16.128987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-32a28b01-5e7a-41ea-a6a2-7e6b75d4c9bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.233414 Mar 08 04:51:16.129755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1439/2933] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:17.146044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-73a7c19d-7984-4609-86ee-687703c5fd62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:17.146627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-73a7c19d-7984-4609-86ee-687703c5fd62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:17.153017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73a7c19d-7984-4609-86ee-687703c5fd62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:17.153553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73a7c19d-7984-4609-86ee-687703c5fd62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:17.154443 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73a7c19d-7984-4609-86ee-687703c5fd62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:17.154963 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-73a7c19d-7984-4609-86ee-687703c5fd62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:17.215555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-73a7c19d-7984-4609-86ee-687703c5fd62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:17.223189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-73a7c19d-7984-4609-86ee-687703c5fd62 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081328 Mar 08 04:51:17.223746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1495/2934] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:18.239687 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ec57b9c9-0372-4803-a725-5249d37c1d95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:18.240299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ec57b9c9-0372-4803-a725-5249d37c1d95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:18.246532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec57b9c9-0372-4803-a725-5249d37c1d95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:18.246973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec57b9c9-0372-4803-a725-5249d37c1d95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:18.247724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec57b9c9-0372-4803-a725-5249d37c1d95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:18.248153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ec57b9c9-0372-4803-a725-5249d37c1d95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:18.305610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ec57b9c9-0372-4803-a725-5249d37c1d95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:18.313169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ec57b9c9-0372-4803-a725-5249d37c1d95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077360 Mar 08 04:51:18.313731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1440/2935] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:19.330168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6ef86e90-9b70-406b-b37a-00fedfb7eae1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:19.330823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6ef86e90-9b70-406b-b37a-00fedfb7eae1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:19.336753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ef86e90-9b70-406b-b37a-00fedfb7eae1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:19.337201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ef86e90-9b70-406b-b37a-00fedfb7eae1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:19.337991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ef86e90-9b70-406b-b37a-00fedfb7eae1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:19.338429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ef86e90-9b70-406b-b37a-00fedfb7eae1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:19.399614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6ef86e90-9b70-406b-b37a-00fedfb7eae1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:19.407912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6ef86e90-9b70-406b-b37a-00fedfb7eae1 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081637 Mar 08 04:51:19.408464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1496/2936] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:20.424488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6e261a4c-697a-4517-9ee0-6c5c6053eb06 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:20.425079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6e261a4c-697a-4517-9ee0-6c5c6053eb06 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:20.431369 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6e261a4c-697a-4517-9ee0-6c5c6053eb06 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:20.431812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6e261a4c-697a-4517-9ee0-6c5c6053eb06 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:20.432564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6e261a4c-697a-4517-9ee0-6c5c6053eb06 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:20.432997 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6e261a4c-697a-4517-9ee0-6c5c6053eb06 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:20.490382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6e261a4c-697a-4517-9ee0-6c5c6053eb06 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:20.498408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6e261a4c-697a-4517-9ee0-6c5c6053eb06 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077766 Mar 08 04:51:20.498952 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1441/2937] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:20 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:21.515469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ece07e1a-5dd5-46a8-af83-a602015bb662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:21.516070 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ece07e1a-5dd5-46a8-af83-a602015bb662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:21.522556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece07e1a-5dd5-46a8-af83-a602015bb662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:21.523000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece07e1a-5dd5-46a8-af83-a602015bb662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:21.523756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece07e1a-5dd5-46a8-af83-a602015bb662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:21.524190 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ece07e1a-5dd5-46a8-af83-a602015bb662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:21.582311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ece07e1a-5dd5-46a8-af83-a602015bb662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:21.589857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ece07e1a-5dd5-46a8-af83-a602015bb662 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078614 Mar 08 04:51:21.590419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1497/2938] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:21 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:22.607807 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a91ed177-d9d0-4f70-b09c-d51a2cd3c2cd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:22.608414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a91ed177-d9d0-4f70-b09c-d51a2cd3c2cd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:22.614754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a91ed177-d9d0-4f70-b09c-d51a2cd3c2cd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:22.615121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a91ed177-d9d0-4f70-b09c-d51a2cd3c2cd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:22.615881 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a91ed177-d9d0-4f70-b09c-d51a2cd3c2cd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:22.616317 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a91ed177-d9d0-4f70-b09c-d51a2cd3c2cd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:22.675872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a91ed177-d9d0-4f70-b09c-d51a2cd3c2cd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:22.683459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a91ed177-d9d0-4f70-b09c-d51a2cd3c2cd tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080178 Mar 08 04:51:22.684399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1442/2939] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:23.700827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b30c4e03-6b1f-45f5-905c-1311223b8946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:23.701431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b30c4e03-6b1f-45f5-905c-1311223b8946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:23.707725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b30c4e03-6b1f-45f5-905c-1311223b8946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:23.708170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b30c4e03-6b1f-45f5-905c-1311223b8946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:23.708939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b30c4e03-6b1f-45f5-905c-1311223b8946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:23.709355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b30c4e03-6b1f-45f5-905c-1311223b8946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:23.769008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b30c4e03-6b1f-45f5-905c-1311223b8946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:23.776681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b30c4e03-6b1f-45f5-905c-1311223b8946 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080303 Mar 08 04:51:23.777240 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1498/2940] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:24.792291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bd8d1dcc-114d-4897-bf5a-b6f8ec958d80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:24.792886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bd8d1dcc-114d-4897-bf5a-b6f8ec958d80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:24.799238 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd8d1dcc-114d-4897-bf5a-b6f8ec958d80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:24.799685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd8d1dcc-114d-4897-bf5a-b6f8ec958d80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:24.800450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd8d1dcc-114d-4897-bf5a-b6f8ec958d80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:24.800879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bd8d1dcc-114d-4897-bf5a-b6f8ec958d80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:24.862543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bd8d1dcc-114d-4897-bf5a-b6f8ec958d80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:24.870300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bd8d1dcc-114d-4897-bf5a-b6f8ec958d80 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081886 Mar 08 04:51:24.870854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1443/2941] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:24 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:25.887554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2a9a9320-9103-4f4e-b853-5aec1efa94c3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:25.888157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2a9a9320-9103-4f4e-b853-5aec1efa94c3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:25.894733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a9a9320-9103-4f4e-b853-5aec1efa94c3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:25.895178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a9a9320-9103-4f4e-b853-5aec1efa94c3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:25.895932 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a9a9320-9103-4f4e-b853-5aec1efa94c3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:25.896378 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a9a9320-9103-4f4e-b853-5aec1efa94c3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:25.958661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2a9a9320-9103-4f4e-b853-5aec1efa94c3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:25.966903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2a9a9320-9103-4f4e-b853-5aec1efa94c3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083346 Mar 08 04:51:25.967472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1499/2942] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:25 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:26.983448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-55e37a35-f9fa-45a6-bcfa-c6e43696bd57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:26.984060 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-55e37a35-f9fa-45a6-bcfa-c6e43696bd57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:26.990265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55e37a35-f9fa-45a6-bcfa-c6e43696bd57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:26.990716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55e37a35-f9fa-45a6-bcfa-c6e43696bd57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:26.991476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55e37a35-f9fa-45a6-bcfa-c6e43696bd57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:26.991917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55e37a35-f9fa-45a6-bcfa-c6e43696bd57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:27.050295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-55e37a35-f9fa-45a6-bcfa-c6e43696bd57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:27.057971 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-55e37a35-f9fa-45a6-bcfa-c6e43696bd57 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078442 Mar 08 04:51:27.058639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1444/2943] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:28.075308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ce216b00-5027-48b2-8d1e-7cf5391ed630 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:28.075916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ce216b00-5027-48b2-8d1e-7cf5391ed630 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:28.082138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce216b00-5027-48b2-8d1e-7cf5391ed630 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:28.082589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce216b00-5027-48b2-8d1e-7cf5391ed630 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:28.083389 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce216b00-5027-48b2-8d1e-7cf5391ed630 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:28.083828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ce216b00-5027-48b2-8d1e-7cf5391ed630 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:28.143135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ce216b00-5027-48b2-8d1e-7cf5391ed630 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:28.153634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ce216b00-5027-48b2-8d1e-7cf5391ed630 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082847 Mar 08 04:51:28.154233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1500/2944] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:29.171022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9a5900a9-9cc4-4ec1-859d-51fba167a395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:29.171633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9a5900a9-9cc4-4ec1-859d-51fba167a395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:29.177852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9a5900a9-9cc4-4ec1-859d-51fba167a395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:29.178295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9a5900a9-9cc4-4ec1-859d-51fba167a395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:29.179045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9a5900a9-9cc4-4ec1-859d-51fba167a395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:29.179474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9a5900a9-9cc4-4ec1-859d-51fba167a395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:29.238983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9a5900a9-9cc4-4ec1-859d-51fba167a395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:29.247410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9a5900a9-9cc4-4ec1-859d-51fba167a395 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080866 Mar 08 04:51:29.247953 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1445/2945] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:29 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:51:30.264627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d470d059-aba5-48f2-b2ab-a8f86f735b20 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:30.265268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d470d059-aba5-48f2-b2ab-a8f86f735b20 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:30.271808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d470d059-aba5-48f2-b2ab-a8f86f735b20 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:30.272253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d470d059-aba5-48f2-b2ab-a8f86f735b20 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:30.273014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d470d059-aba5-48f2-b2ab-a8f86f735b20 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:30.273441 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d470d059-aba5-48f2-b2ab-a8f86f735b20 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:30.332406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d470d059-aba5-48f2-b2ab-a8f86f735b20 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:30.340235 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d470d059-aba5-48f2-b2ab-a8f86f735b20 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080174 Mar 08 04:51:30.340806 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1501/2946] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:30 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:31.356879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bfd502f1-e89d-4b3a-ad8b-f5f621daffe0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:31.357486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bfd502f1-e89d-4b3a-ad8b-f5f621daffe0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:31.363762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfd502f1-e89d-4b3a-ad8b-f5f621daffe0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:31.364214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfd502f1-e89d-4b3a-ad8b-f5f621daffe0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:31.364974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfd502f1-e89d-4b3a-ad8b-f5f621daffe0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:31.365410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bfd502f1-e89d-4b3a-ad8b-f5f621daffe0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:31.423130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bfd502f1-e89d-4b3a-ad8b-f5f621daffe0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:31.430729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bfd502f1-e89d-4b3a-ad8b-f5f621daffe0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077848 Mar 08 04:51:31.431276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1446/2947] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:32.446557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7bcfcb21-037c-479a-a648-96cee327a381 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:32.447163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7bcfcb21-037c-479a-a648-96cee327a381 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:32.453988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bcfcb21-037c-479a-a648-96cee327a381 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:32.454431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bcfcb21-037c-479a-a648-96cee327a381 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:32.455181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bcfcb21-037c-479a-a648-96cee327a381 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:32.455613 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7bcfcb21-037c-479a-a648-96cee327a381 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:32.516733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7bcfcb21-037c-479a-a648-96cee327a381 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:32.525527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7bcfcb21-037c-479a-a648-96cee327a381 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082571 Mar 08 04:51:32.526153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1502/2948] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:33.542892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ed212b8d-b5e9-47fc-9278-dabf813ea3a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:33.543518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ed212b8d-b5e9-47fc-9278-dabf813ea3a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:33.550019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed212b8d-b5e9-47fc-9278-dabf813ea3a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:33.550491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed212b8d-b5e9-47fc-9278-dabf813ea3a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:33.551303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed212b8d-b5e9-47fc-9278-dabf813ea3a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:33.551741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ed212b8d-b5e9-47fc-9278-dabf813ea3a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:33.610024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ed212b8d-b5e9-47fc-9278-dabf813ea3a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:33.617820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ed212b8d-b5e9-47fc-9278-dabf813ea3a6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078710 Mar 08 04:51:33.618373 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1447/2949] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:34.636993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-10e91847-1c17-4655-9e86-30ee545a9e9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:34.637976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-10e91847-1c17-4655-9e86-30ee545a9e9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:34.644414 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10e91847-1c17-4655-9e86-30ee545a9e9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:34.644859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10e91847-1c17-4655-9e86-30ee545a9e9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:34.645619 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10e91847-1c17-4655-9e86-30ee545a9e9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:34.646074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-10e91847-1c17-4655-9e86-30ee545a9e9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:34.704195 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-10e91847-1c17-4655-9e86-30ee545a9e9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:34.711765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-10e91847-1c17-4655-9e86-30ee545a9e9e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078611 Mar 08 04:51:34.712314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1503/2950] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:34 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:35.728593 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f206908a-a505-4971-93fd-135496718e92 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:35.729227 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f206908a-a505-4971-93fd-135496718e92 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:35.735233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f206908a-a505-4971-93fd-135496718e92 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:35.735691 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f206908a-a505-4971-93fd-135496718e92 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:35.736499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f206908a-a505-4971-93fd-135496718e92 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:35.736941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f206908a-a505-4971-93fd-135496718e92 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:35.794666 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f206908a-a505-4971-93fd-135496718e92 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:35.802343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f206908a-a505-4971-93fd-135496718e92 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077872 Mar 08 04:51:35.802901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1448/2951] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:36.819682 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-79ce2e16-d16b-4236-b436-6ad8ecdfdc3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:36.820314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-79ce2e16-d16b-4236-b436-6ad8ecdfdc3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:36.827038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79ce2e16-d16b-4236-b436-6ad8ecdfdc3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:36.827484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79ce2e16-d16b-4236-b436-6ad8ecdfdc3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:36.828239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79ce2e16-d16b-4236-b436-6ad8ecdfdc3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:36.828668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-79ce2e16-d16b-4236-b436-6ad8ecdfdc3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:36.886844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-79ce2e16-d16b-4236-b436-6ad8ecdfdc3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:36.895346 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-79ce2e16-d16b-4236-b436-6ad8ecdfdc3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079487 Mar 08 04:51:36.895902 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1504/2952] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:37.912394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d18c29ad-9a99-4b21-9af0-a8118c35cf95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:37.913002 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d18c29ad-9a99-4b21-9af0-a8118c35cf95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:37.919351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d18c29ad-9a99-4b21-9af0-a8118c35cf95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:37.919745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d18c29ad-9a99-4b21-9af0-a8118c35cf95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:37.920511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d18c29ad-9a99-4b21-9af0-a8118c35cf95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:37.920952 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d18c29ad-9a99-4b21-9af0-a8118c35cf95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:37.978346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d18c29ad-9a99-4b21-9af0-a8118c35cf95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:37.986066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d18c29ad-9a99-4b21-9af0-a8118c35cf95 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077446 Mar 08 04:51:37.986622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1449/2953] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:37 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:39.003092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6a573f30-50d7-4ab4-b8f5-3212cdf21a87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:39.003723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6a573f30-50d7-4ab4-b8f5-3212cdf21a87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:39.009971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a573f30-50d7-4ab4-b8f5-3212cdf21a87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:39.010419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a573f30-50d7-4ab4-b8f5-3212cdf21a87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:39.011180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a573f30-50d7-4ab4-b8f5-3212cdf21a87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:39.011614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6a573f30-50d7-4ab4-b8f5-3212cdf21a87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:39.074390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6a573f30-50d7-4ab4-b8f5-3212cdf21a87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:39.082938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6a573f30-50d7-4ab4-b8f5-3212cdf21a87 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083682 Mar 08 04:51:39.083501 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1505/2954] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:38 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:40.099728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1dbb1fcb-b837-4991-b68a-d1be387937d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:40.100291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1dbb1fcb-b837-4991-b68a-d1be387937d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:40.106801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1dbb1fcb-b837-4991-b68a-d1be387937d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:40.107254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1dbb1fcb-b837-4991-b68a-d1be387937d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:40.108048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1dbb1fcb-b837-4991-b68a-d1be387937d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:40.108600 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1dbb1fcb-b837-4991-b68a-d1be387937d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:40.167292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1dbb1fcb-b837-4991-b68a-d1be387937d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:40.175090 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1dbb1fcb-b837-4991-b68a-d1be387937d2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079335 Mar 08 04:51:40.175645 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1450/2955] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:41.192113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dbffec72-e435-4974-8be7-2defba2d7194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:41.192731 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dbffec72-e435-4974-8be7-2defba2d7194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:41.198939 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbffec72-e435-4974-8be7-2defba2d7194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:41.199387 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbffec72-e435-4974-8be7-2defba2d7194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:41.200144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbffec72-e435-4974-8be7-2defba2d7194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:41.200690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dbffec72-e435-4974-8be7-2defba2d7194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:41.262060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dbffec72-e435-4974-8be7-2defba2d7194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:41.270315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dbffec72-e435-4974-8be7-2defba2d7194 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082155 Mar 08 04:51:41.270878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1506/2956] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:42.287251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-1c668738-921e-4f75-8c76-c2e4a87a8d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:42.287867 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-1c668738-921e-4f75-8c76-c2e4a87a8d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:42.294760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c668738-921e-4f75-8c76-c2e4a87a8d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:42.295216 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c668738-921e-4f75-8c76-c2e4a87a8d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:42.295983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c668738-921e-4f75-8c76-c2e4a87a8d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:42.296428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-1c668738-921e-4f75-8c76-c2e4a87a8d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:42.354273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-1c668738-921e-4f75-8c76-c2e4a87a8d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:42.362694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-1c668738-921e-4f75-8c76-c2e4a87a8d38 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079253 Mar 08 04:51:42.363251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1451/2957] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:42 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:43.379154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f7ad3841-e66e-4a00-b8bd-df24ab41585c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:43.379739 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f7ad3841-e66e-4a00-b8bd-df24ab41585c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:43.385985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3841-e66e-4a00-b8bd-df24ab41585c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:43.386432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3841-e66e-4a00-b8bd-df24ab41585c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:43.387194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3841-e66e-4a00-b8bd-df24ab41585c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:43.387624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3841-e66e-4a00-b8bd-df24ab41585c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:43.445484 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f7ad3841-e66e-4a00-b8bd-df24ab41585c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:43.453918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f7ad3841-e66e-4a00-b8bd-df24ab41585c tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078504 Mar 08 04:51:43.454476 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1507/2958] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:44.471038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cd02fca1-2a88-46ea-8615-1b84805ccd2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:44.471652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cd02fca1-2a88-46ea-8615-1b84805ccd2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:44.477959 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd02fca1-2a88-46ea-8615-1b84805ccd2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:44.478418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd02fca1-2a88-46ea-8615-1b84805ccd2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:44.479188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd02fca1-2a88-46ea-8615-1b84805ccd2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:44.479630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cd02fca1-2a88-46ea-8615-1b84805ccd2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:44.543219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cd02fca1-2a88-46ea-8615-1b84805ccd2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:44.550940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cd02fca1-2a88-46ea-8615-1b84805ccd2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083759 Mar 08 04:51:44.551493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1452/2959] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:45.567282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-76d495d3-419a-4367-baa1-c46f75e994fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:45.567904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-76d495d3-419a-4367-baa1-c46f75e994fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:45.574126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76d495d3-419a-4367-baa1-c46f75e994fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:45.574576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76d495d3-419a-4367-baa1-c46f75e994fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:45.575980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76d495d3-419a-4367-baa1-c46f75e994fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:45.576415 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76d495d3-419a-4367-baa1-c46f75e994fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:45.636861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-76d495d3-419a-4367-baa1-c46f75e994fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:45.645729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-76d495d3-419a-4367-baa1-c46f75e994fe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082332 Mar 08 04:51:45.646303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1508/2960] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:46.663059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f89a401c-eb45-4a4c-aab6-a70d71025bb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:46.663643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f89a401c-eb45-4a4c-aab6-a70d71025bb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:46.669961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f89a401c-eb45-4a4c-aab6-a70d71025bb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:46.670408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f89a401c-eb45-4a4c-aab6-a70d71025bb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:46.671167 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f89a401c-eb45-4a4c-aab6-a70d71025bb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:46.671596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f89a401c-eb45-4a4c-aab6-a70d71025bb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:46.729848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f89a401c-eb45-4a4c-aab6-a70d71025bb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:46.738466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f89a401c-eb45-4a4c-aab6-a70d71025bb2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079307 Mar 08 04:51:46.739024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1453/2961] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:47.755078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-aed58974-be27-4c7f-91a0-b6bce9f57594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:47.755688 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-aed58974-be27-4c7f-91a0-b6bce9f57594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:47.762089 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aed58974-be27-4c7f-91a0-b6bce9f57594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:47.762547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aed58974-be27-4c7f-91a0-b6bce9f57594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:47.763591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aed58974-be27-4c7f-91a0-b6bce9f57594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:47.764038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-aed58974-be27-4c7f-91a0-b6bce9f57594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:47.822691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-aed58974-be27-4c7f-91a0-b6bce9f57594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:47.830907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-aed58974-be27-4c7f-91a0-b6bce9f57594 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079711 Mar 08 04:51:47.831475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1509/2962] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:48.847839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b61c04e3-54c4-4288-b76d-be9477e34b7f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:48.848441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b61c04e3-54c4-4288-b76d-be9477e34b7f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:48.854763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b61c04e3-54c4-4288-b76d-be9477e34b7f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:48.855219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b61c04e3-54c4-4288-b76d-be9477e34b7f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:48.855983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b61c04e3-54c4-4288-b76d-be9477e34b7f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:48.857094 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b61c04e3-54c4-4288-b76d-be9477e34b7f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:48.919013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b61c04e3-54c4-4288-b76d-be9477e34b7f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:48.926719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b61c04e3-54c4-4288-b76d-be9477e34b7f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082799 Mar 08 04:51:48.927273 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1454/2963] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:49.943362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b10b10f3-8f79-4952-b832-b478729281b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:49.943886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b10b10f3-8f79-4952-b832-b478729281b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:49.950910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b10b10f3-8f79-4952-b832-b478729281b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:49.951660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b10b10f3-8f79-4952-b832-b478729281b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:49.952437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b10b10f3-8f79-4952-b832-b478729281b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:49.952878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b10b10f3-8f79-4952-b832-b478729281b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:50.010642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b10b10f3-8f79-4952-b832-b478729281b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:50.019312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b10b10f3-8f79-4952-b832-b478729281b6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079972 Mar 08 04:51:50.020010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1510/2964] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:49 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:51.035913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d8db433b-b2d6-4ddf-b734-d2ddc20a9931 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:51.036545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d8db433b-b2d6-4ddf-b734-d2ddc20a9931 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:51.042788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8db433b-b2d6-4ddf-b734-d2ddc20a9931 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:51.043232 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8db433b-b2d6-4ddf-b734-d2ddc20a9931 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:51.043989 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8db433b-b2d6-4ddf-b734-d2ddc20a9931 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:51.044420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d8db433b-b2d6-4ddf-b734-d2ddc20a9931 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:51.102208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d8db433b-b2d6-4ddf-b734-d2ddc20a9931 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:51.110484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d8db433b-b2d6-4ddf-b734-d2ddc20a9931 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078358 Mar 08 04:51:51.111229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1455/2965] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:52.128432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d2fd012c-bbb9-4d6b-8ddc-b24a9696540a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:52.129032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d2fd012c-bbb9-4d6b-8ddc-b24a9696540a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:52.135281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2fd012c-bbb9-4d6b-8ddc-b24a9696540a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:52.135730 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2fd012c-bbb9-4d6b-8ddc-b24a9696540a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:52.136481 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2fd012c-bbb9-4d6b-8ddc-b24a9696540a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:52.136914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d2fd012c-bbb9-4d6b-8ddc-b24a9696540a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:52.200419 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-d2fd012c-bbb9-4d6b-8ddc-b24a9696540a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:52.208034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d2fd012c-bbb9-4d6b-8ddc-b24a9696540a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083563 Mar 08 04:51:52.208598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1511/2966] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:53.225016 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fb09b8c5-2101-422d-a340-39148e5819ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:53.225625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fb09b8c5-2101-422d-a340-39148e5819ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:53.233144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb09b8c5-2101-422d-a340-39148e5819ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:53.233596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb09b8c5-2101-422d-a340-39148e5819ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:53.234384 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb09b8c5-2101-422d-a340-39148e5819ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:53.234816 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fb09b8c5-2101-422d-a340-39148e5819ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:53.295082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fb09b8c5-2101-422d-a340-39148e5819ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:53.303481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fb09b8c5-2101-422d-a340-39148e5819ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082302 Mar 08 04:51:53.304027 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1456/2967] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:54.320186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c027d4c5-7562-40c7-9767-797865c36b7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:54.320790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c027d4c5-7562-40c7-9767-797865c36b7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:54.327141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c027d4c5-7562-40c7-9767-797865c36b7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:54.327585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c027d4c5-7562-40c7-9767-797865c36b7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:54.328338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c027d4c5-7562-40c7-9767-797865c36b7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:54.328774 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c027d4c5-7562-40c7-9767-797865c36b7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:54.386184 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c027d4c5-7562-40c7-9767-797865c36b7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:54.393947 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c027d4c5-7562-40c7-9767-797865c36b7a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077565 Mar 08 04:51:54.394496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1512/2968] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:54 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:55.410965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bce9a696-59ef-4c99-b5e4-ec7c48a97535 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:55.411588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bce9a696-59ef-4c99-b5e4-ec7c48a97535 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:55.417781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bce9a696-59ef-4c99-b5e4-ec7c48a97535 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:55.418226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bce9a696-59ef-4c99-b5e4-ec7c48a97535 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:55.418978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bce9a696-59ef-4c99-b5e4-ec7c48a97535 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:55.419408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bce9a696-59ef-4c99-b5e4-ec7c48a97535 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:55.477188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bce9a696-59ef-4c99-b5e4-ec7c48a97535 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:55.485851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bce9a696-59ef-4c99-b5e4-ec7c48a97535 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078703 Mar 08 04:51:55.486408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1457/2969] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:56.502893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-fdb65325-12e9-4c3d-83ba-b297a77700cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:56.503506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-fdb65325-12e9-4c3d-83ba-b297a77700cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:56.509769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdb65325-12e9-4c3d-83ba-b297a77700cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:56.510406 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdb65325-12e9-4c3d-83ba-b297a77700cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:56.511188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdb65325-12e9-4c3d-83ba-b297a77700cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:56.511630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-fdb65325-12e9-4c3d-83ba-b297a77700cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:56.571609 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-fdb65325-12e9-4c3d-83ba-b297a77700cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:56.579435 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-fdb65325-12e9-4c3d-83ba-b297a77700cc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080980 Mar 08 04:51:56.579993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1513/2970] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:57.596486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-89aed3f0-2459-4344-a710-d50ae881c355 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:57.597074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-89aed3f0-2459-4344-a710-d50ae881c355 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:57.603389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-89aed3f0-2459-4344-a710-d50ae881c355 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:57.603833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-89aed3f0-2459-4344-a710-d50ae881c355 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:57.604588 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-89aed3f0-2459-4344-a710-d50ae881c355 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:57.605017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-89aed3f0-2459-4344-a710-d50ae881c355 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:57.664705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-89aed3f0-2459-4344-a710-d50ae881c355 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:57.672846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-89aed3f0-2459-4344-a710-d50ae881c355 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080947 Mar 08 04:51:57.673400 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1458/2971] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:58.689400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-976af6a3-1001-4b1d-a3df-0e2ccb29ee59 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:58.690043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-976af6a3-1001-4b1d-a3df-0e2ccb29ee59 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:58.696354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-976af6a3-1001-4b1d-a3df-0e2ccb29ee59 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:58.696803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-976af6a3-1001-4b1d-a3df-0e2ccb29ee59 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:58.697570 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-976af6a3-1001-4b1d-a3df-0e2ccb29ee59 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:58.698037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-976af6a3-1001-4b1d-a3df-0e2ccb29ee59 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:58.759228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-976af6a3-1001-4b1d-a3df-0e2ccb29ee59 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:58.767655 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-976af6a3-1001-4b1d-a3df-0e2ccb29ee59 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082104 Mar 08 04:51:58.768213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1514/2972] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:51:59.784873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9fff6c15-aaaf-4004-82fb-c1c147355a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:51:59.785509 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9fff6c15-aaaf-4004-82fb-c1c147355a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:51:59.791732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9fff6c15-aaaf-4004-82fb-c1c147355a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:59.792182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9fff6c15-aaaf-4004-82fb-c1c147355a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:59.792943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9fff6c15-aaaf-4004-82fb-c1c147355a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:51:59.793382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9fff6c15-aaaf-4004-82fb-c1c147355a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:51:59.851715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9fff6c15-aaaf-4004-82fb-c1c147355a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:51:59.860164 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9fff6c15-aaaf-4004-82fb-c1c147355a26 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079218 Mar 08 04:51:59.860718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1459/2973] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:51:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:00.877268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b91559f1-b0f7-458f-82d0-c7bd58ccbc6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:00.877924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b91559f1-b0f7-458f-82d0-c7bd58ccbc6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:00.884338 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b91559f1-b0f7-458f-82d0-c7bd58ccbc6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:00.884787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b91559f1-b0f7-458f-82d0-c7bd58ccbc6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:00.885555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b91559f1-b0f7-458f-82d0-c7bd58ccbc6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:00.886024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b91559f1-b0f7-458f-82d0-c7bd58ccbc6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:00.944202 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-b91559f1-b0f7-458f-82d0-c7bd58ccbc6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:00.951827 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b91559f1-b0f7-458f-82d0-c7bd58ccbc6a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079158 Mar 08 04:52:00.952384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1515/2974] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:01.967753 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a5f14882-d807-4ccc-9c16-6dbff43534bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:01.968301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a5f14882-d807-4ccc-9c16-6dbff43534bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:01.974496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5f14882-d807-4ccc-9c16-6dbff43534bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:01.974941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5f14882-d807-4ccc-9c16-6dbff43534bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:01.975692 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5f14882-d807-4ccc-9c16-6dbff43534bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:01.976124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5f14882-d807-4ccc-9c16-6dbff43534bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:02.034312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a5f14882-d807-4ccc-9c16-6dbff43534bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:02.041838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a5f14882-d807-4ccc-9c16-6dbff43534bc tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078023 Mar 08 04:52:02.042386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1460/2975] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:01 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:03.058573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bcd6826c-e71a-4c77-8071-d417ad922709 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:03.059175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bcd6826c-e71a-4c77-8071-d417ad922709 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:03.066037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bcd6826c-e71a-4c77-8071-d417ad922709 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:03.066489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bcd6826c-e71a-4c77-8071-d417ad922709 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:03.067251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bcd6826c-e71a-4c77-8071-d417ad922709 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:03.067690 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bcd6826c-e71a-4c77-8071-d417ad922709 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:03.126057 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bcd6826c-e71a-4c77-8071-d417ad922709 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:03.133900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bcd6826c-e71a-4c77-8071-d417ad922709 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079195 Mar 08 04:52:03.134463 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1516/2976] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:04.150820 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9fb24488-e85f-4be0-a526-82b340fec479 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:04.151370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9fb24488-e85f-4be0-a526-82b340fec479 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:04.158268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9fb24488-e85f-4be0-a526-82b340fec479 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:04.158716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9fb24488-e85f-4be0-a526-82b340fec479 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:04.159470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9fb24488-e85f-4be0-a526-82b340fec479 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:04.159904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9fb24488-e85f-4be0-a526-82b340fec479 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:04.218740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9fb24488-e85f-4be0-a526-82b340fec479 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:04.226387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9fb24488-e85f-4be0-a526-82b340fec479 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079564 Mar 08 04:52:04.226939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1461/2977] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:52:05.242782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5624c017-0f44-41c9-bd45-d45011307972 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:05.243428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5624c017-0f44-41c9-bd45-d45011307972 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:05.250627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5624c017-0f44-41c9-bd45-d45011307972 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:05.251078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5624c017-0f44-41c9-bd45-d45011307972 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:05.251913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5624c017-0f44-41c9-bd45-d45011307972 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:05.252350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5624c017-0f44-41c9-bd45-d45011307972 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:05.314526 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5624c017-0f44-41c9-bd45-d45011307972 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:05.322242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5624c017-0f44-41c9-bd45-d45011307972 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083370 Mar 08 04:52:05.322799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1517/2978] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:06.338336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e255d880-9b8d-4470-acc8-78aed975c0a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:06.338943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e255d880-9b8d-4470-acc8-78aed975c0a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:06.345072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e255d880-9b8d-4470-acc8-78aed975c0a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:06.345520 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e255d880-9b8d-4470-acc8-78aed975c0a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:06.346313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e255d880-9b8d-4470-acc8-78aed975c0a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:06.346745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e255d880-9b8d-4470-acc8-78aed975c0a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:06.410080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e255d880-9b8d-4470-acc8-78aed975c0a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:06.417893 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e255d880-9b8d-4470-acc8-78aed975c0a3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083556 Mar 08 04:52:06.418463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1462/2979] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:07.435312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0f4cb54a-313f-4739-adf3-29a5773579be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:07.435905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0f4cb54a-313f-4739-adf3-29a5773579be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:07.442146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f4cb54a-313f-4739-adf3-29a5773579be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:07.442595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f4cb54a-313f-4739-adf3-29a5773579be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:07.443359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f4cb54a-313f-4739-adf3-29a5773579be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:07.443794 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f4cb54a-313f-4739-adf3-29a5773579be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:07.502832 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0f4cb54a-313f-4739-adf3-29a5773579be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:07.510319 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0f4cb54a-313f-4739-adf3-29a5773579be tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078901 Mar 08 04:52:07.510890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1518/2980] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:08.527264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-67e57c75-8f41-4cf6-90f6-0d880902eb03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:08.527874 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-67e57c75-8f41-4cf6-90f6-0d880902eb03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:08.534872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67e57c75-8f41-4cf6-90f6-0d880902eb03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:08.535325 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67e57c75-8f41-4cf6-90f6-0d880902eb03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:08.536089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67e57c75-8f41-4cf6-90f6-0d880902eb03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:08.536525 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-67e57c75-8f41-4cf6-90f6-0d880902eb03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:08.594435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-67e57c75-8f41-4cf6-90f6-0d880902eb03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:08.602100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-67e57c75-8f41-4cf6-90f6-0d880902eb03 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078699 Mar 08 04:52:08.602659 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1463/2981] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:09.618747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4036007d-deac-49c5-89f2-a73bc0cfa1ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:09.619365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4036007d-deac-49c5-89f2-a73bc0cfa1ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:09.626531 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4036007d-deac-49c5-89f2-a73bc0cfa1ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:09.626984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4036007d-deac-49c5-89f2-a73bc0cfa1ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:09.627784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4036007d-deac-49c5-89f2-a73bc0cfa1ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:09.628224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4036007d-deac-49c5-89f2-a73bc0cfa1ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:09.686923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4036007d-deac-49c5-89f2-a73bc0cfa1ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:09.694524 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4036007d-deac-49c5-89f2-a73bc0cfa1ae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079619 Mar 08 04:52:09.695077 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1519/2982] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:09 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:10.711616 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-23e1f59f-6445-499a-a80d-7ded537fcfbe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:10.712260 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-23e1f59f-6445-499a-a80d-7ded537fcfbe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:10.719363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-23e1f59f-6445-499a-a80d-7ded537fcfbe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:10.719814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-23e1f59f-6445-499a-a80d-7ded537fcfbe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:10.720591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-23e1f59f-6445-499a-a80d-7ded537fcfbe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:10.721031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-23e1f59f-6445-499a-a80d-7ded537fcfbe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:10.781102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-23e1f59f-6445-499a-a80d-7ded537fcfbe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:10.788883 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-23e1f59f-6445-499a-a80d-7ded537fcfbe tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081124 Mar 08 04:52:10.789446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1464/2983] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:10 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:11.804513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-93a7da0e-a320-43a7-85a1-1df04aeb9b3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:11.805120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-93a7da0e-a320-43a7-85a1-1df04aeb9b3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:11.812100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93a7da0e-a320-43a7-85a1-1df04aeb9b3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:11.812595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93a7da0e-a320-43a7-85a1-1df04aeb9b3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:11.813382 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93a7da0e-a320-43a7-85a1-1df04aeb9b3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:11.813861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93a7da0e-a320-43a7-85a1-1df04aeb9b3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:11.876053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-93a7da0e-a320-43a7-85a1-1df04aeb9b3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:11.883718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-93a7da0e-a320-43a7-85a1-1df04aeb9b3f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083017 Mar 08 04:52:11.884279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1520/2984] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:11 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:12.900689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-374b32cc-bbe3-4e19-bcba-a082bf1eb234 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:12.901292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-374b32cc-bbe3-4e19-bcba-a082bf1eb234 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:12.907956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-374b32cc-bbe3-4e19-bcba-a082bf1eb234 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:12.908400 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-374b32cc-bbe3-4e19-bcba-a082bf1eb234 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:12.909155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-374b32cc-bbe3-4e19-bcba-a082bf1eb234 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:12.909587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-374b32cc-bbe3-4e19-bcba-a082bf1eb234 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:12.969610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-374b32cc-bbe3-4e19-bcba-a082bf1eb234 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:12.977158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-374b32cc-bbe3-4e19-bcba-a082bf1eb234 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080283 Mar 08 04:52:12.977731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1465/2985] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:12 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:13.993829 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e3066ebf-7c4d-43f1-ad49-3565aa92fd17 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:13.994375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e3066ebf-7c4d-43f1-ad49-3565aa92fd17 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:14.000672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3066ebf-7c4d-43f1-ad49-3565aa92fd17 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:14.001122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3066ebf-7c4d-43f1-ad49-3565aa92fd17 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:14.001910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3066ebf-7c4d-43f1-ad49-3565aa92fd17 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:14.002350 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e3066ebf-7c4d-43f1-ad49-3565aa92fd17 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:14.060110 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e3066ebf-7c4d-43f1-ad49-3565aa92fd17 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:14.067735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e3066ebf-7c4d-43f1-ad49-3565aa92fd17 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077853 Mar 08 04:52:14.068288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1521/2986] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:13 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:15.083804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4a3f3663-ad6c-4829-bd29-c4136a623a99 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:15.084403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4a3f3663-ad6c-4829-bd29-c4136a623a99 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:15.090673 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a3f3663-ad6c-4829-bd29-c4136a623a99 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:15.091121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a3f3663-ad6c-4829-bd29-c4136a623a99 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:15.092058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a3f3663-ad6c-4829-bd29-c4136a623a99 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:15.092533 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a3f3663-ad6c-4829-bd29-c4136a623a99 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:15.153838 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4a3f3663-ad6c-4829-bd29-c4136a623a99 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:15.161514 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4a3f3663-ad6c-4829-bd29-c4136a623a99 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081590 Mar 08 04:52:15.162108 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1466/2987] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:15 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:16.178729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c28c86e8-5a55-49ee-90df-c1b0d382a5ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:16.179336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c28c86e8-5a55-49ee-90df-c1b0d382a5ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:16.186201 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c28c86e8-5a55-49ee-90df-c1b0d382a5ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:16.186770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c28c86e8-5a55-49ee-90df-c1b0d382a5ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:16.187585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c28c86e8-5a55-49ee-90df-c1b0d382a5ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:16.188016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c28c86e8-5a55-49ee-90df-c1b0d382a5ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:16.245790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c28c86e8-5a55-49ee-90df-c1b0d382a5ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:16.254064 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c28c86e8-5a55-49ee-90df-c1b0d382a5ac tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079098 Mar 08 04:52:16.254619 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1522/2988] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:16 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:52:17.270890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-55fabe30-c93b-41fa-84ab-748520cfecae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:17.271502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-55fabe30-c93b-41fa-84ab-748520cfecae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:17.277754 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55fabe30-c93b-41fa-84ab-748520cfecae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:17.278203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55fabe30-c93b-41fa-84ab-748520cfecae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:17.278968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55fabe30-c93b-41fa-84ab-748520cfecae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:17.279979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-55fabe30-c93b-41fa-84ab-748520cfecae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:17.339437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-55fabe30-c93b-41fa-84ab-748520cfecae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:17.347848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-55fabe30-c93b-41fa-84ab-748520cfecae tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081100 Mar 08 04:52:17.348401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1467/2989] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:17 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:18.365001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-458ca3cd-c2fc-48ea-9d33-faa5def9e58b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:18.365637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-458ca3cd-c2fc-48ea-9d33-faa5def9e58b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:18.371599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-458ca3cd-c2fc-48ea-9d33-faa5def9e58b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:18.372048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-458ca3cd-c2fc-48ea-9d33-faa5def9e58b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:18.372849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-458ca3cd-c2fc-48ea-9d33-faa5def9e58b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:18.373348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-458ca3cd-c2fc-48ea-9d33-faa5def9e58b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:18.434119 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-458ca3cd-c2fc-48ea-9d33-faa5def9e58b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:18.442440 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-458ca3cd-c2fc-48ea-9d33-faa5def9e58b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081411 Mar 08 04:52:18.443001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1523/2990] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:18 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:19.459825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-88064197-8537-49ef-abd8-8ac0379cf000 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:19.460420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-88064197-8537-49ef-abd8-8ac0379cf000 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:19.466901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88064197-8537-49ef-abd8-8ac0379cf000 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:19.467341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88064197-8537-49ef-abd8-8ac0379cf000 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:19.468096 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88064197-8537-49ef-abd8-8ac0379cf000 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:19.468530 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-88064197-8537-49ef-abd8-8ac0379cf000 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:19.526357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-88064197-8537-49ef-abd8-8ac0379cf000 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:19.534286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-88064197-8537-49ef-abd8-8ac0379cf000 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078418 Mar 08 04:52:19.534841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1468/2991] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:19 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:20.551490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-049ed0f8-badb-451b-901a-ad77256c5488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:20.552105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-049ed0f8-badb-451b-901a-ad77256c5488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:20.558411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-049ed0f8-badb-451b-901a-ad77256c5488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:20.558869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-049ed0f8-badb-451b-901a-ad77256c5488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:20.559638 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-049ed0f8-badb-451b-901a-ad77256c5488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:20.560158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-049ed0f8-badb-451b-901a-ad77256c5488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:20.618842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-049ed0f8-badb-451b-901a-ad77256c5488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:20.627572 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-049ed0f8-badb-451b-901a-ad77256c5488 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079959 Mar 08 04:52:20.628138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1524/2992] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:20 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:21.644503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-401e719f-3b39-4ce5-a3d0-810e41045cd5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:21.645032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-401e719f-3b39-4ce5-a3d0-810e41045cd5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:21.651271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-401e719f-3b39-4ce5-a3d0-810e41045cd5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:21.651724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-401e719f-3b39-4ce5-a3d0-810e41045cd5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:21.652490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-401e719f-3b39-4ce5-a3d0-810e41045cd5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:21.652929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-401e719f-3b39-4ce5-a3d0-810e41045cd5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:21.711032 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-401e719f-3b39-4ce5-a3d0-810e41045cd5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:21.719154 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-401e719f-3b39-4ce5-a3d0-810e41045cd5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078846 Mar 08 04:52:21.719708 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1469/2993] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:21 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:22.736170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5f9393ef-4599-4aa8-912a-879510171193 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:22.736781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5f9393ef-4599-4aa8-912a-879510171193 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:22.743314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5f9393ef-4599-4aa8-912a-879510171193 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:22.743770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5f9393ef-4599-4aa8-912a-879510171193 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:22.744606 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5f9393ef-4599-4aa8-912a-879510171193 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:22.745033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5f9393ef-4599-4aa8-912a-879510171193 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:22.805442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5f9393ef-4599-4aa8-912a-879510171193 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:22.814002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5f9393ef-4599-4aa8-912a-879510171193 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082201 Mar 08 04:52:22.814568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1525/2994] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:22 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:23.831187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5758d348-42e7-4f89-95fc-b6c365462a8f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:23.831786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5758d348-42e7-4f89-95fc-b6c365462a8f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:23.838044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5758d348-42e7-4f89-95fc-b6c365462a8f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:23.838492 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5758d348-42e7-4f89-95fc-b6c365462a8f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:23.839247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5758d348-42e7-4f89-95fc-b6c365462a8f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:23.839679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5758d348-42e7-4f89-95fc-b6c365462a8f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:23.898461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5758d348-42e7-4f89-95fc-b6c365462a8f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:23.906377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5758d348-42e7-4f89-95fc-b6c365462a8f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079099 Mar 08 04:52:23.906933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1470/2995] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:23 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:24.923363 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7a119ffc-3a77-41ee-b3c1-3212ae73603d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:24.923966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7a119ffc-3a77-41ee-b3c1-3212ae73603d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:24.930154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a119ffc-3a77-41ee-b3c1-3212ae73603d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:24.930600 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a119ffc-3a77-41ee-b3c1-3212ae73603d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:24.931352 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a119ffc-3a77-41ee-b3c1-3212ae73603d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:24.931781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a119ffc-3a77-41ee-b3c1-3212ae73603d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:24.992890 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7a119ffc-3a77-41ee-b3c1-3212ae73603d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:25.001394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7a119ffc-3a77-41ee-b3c1-3212ae73603d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082485 Mar 08 04:52:25.001997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1526/2996] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:24 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:25.180286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:52:25.180707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:52:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:52:26.017969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-12e74e6c-ecb2-4a8f-b466-f67fe20d32a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:26.018517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-12e74e6c-ecb2-4a8f-b466-f67fe20d32a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:26.024707 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12e74e6c-ecb2-4a8f-b466-f67fe20d32a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:26.025158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12e74e6c-ecb2-4a8f-b466-f67fe20d32a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:26.025974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12e74e6c-ecb2-4a8f-b466-f67fe20d32a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:26.026413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12e74e6c-ecb2-4a8f-b466-f67fe20d32a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:26.083973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-12e74e6c-ecb2-4a8f-b466-f67fe20d32a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:26.092107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-12e74e6c-ecb2-4a8f-b466-f67fe20d32a4 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077899 Mar 08 04:52:26.092731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1471/2997] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:26 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:27.109756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-25d536a0-76ad-45b9-a3a3-5c7bab1070d0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:27.110349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-25d536a0-76ad-45b9-a3a3-5c7bab1070d0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:27.116516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25d536a0-76ad-45b9-a3a3-5c7bab1070d0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:27.116964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25d536a0-76ad-45b9-a3a3-5c7bab1070d0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:27.117754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25d536a0-76ad-45b9-a3a3-5c7bab1070d0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:27.118196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-25d536a0-76ad-45b9-a3a3-5c7bab1070d0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:27.176677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-25d536a0-76ad-45b9-a3a3-5c7bab1070d0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:27.184270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-25d536a0-76ad-45b9-a3a3-5c7bab1070d0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079407 Mar 08 04:52:27.184870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1527/2998] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:27 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:28.201454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b736229c-82d0-4e62-a542-b5ebab8e6da3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:28.202698 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b736229c-82d0-4e62-a542-b5ebab8e6da3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:28.208974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b736229c-82d0-4e62-a542-b5ebab8e6da3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:28.209418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b736229c-82d0-4e62-a542-b5ebab8e6da3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:28.210206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b736229c-82d0-4e62-a542-b5ebab8e6da3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:28.210638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b736229c-82d0-4e62-a542-b5ebab8e6da3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:28.270043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b736229c-82d0-4e62-a542-b5ebab8e6da3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:28.277568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b736229c-82d0-4e62-a542-b5ebab8e6da3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079999 Mar 08 04:52:28.278152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1472/2999] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:28 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:29.294999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cd8e2b9c-4b71-44e5-bf77-84a5d76773cb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:29.295732 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cd8e2b9c-4b71-44e5-bf77-84a5d76773cb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:29.301817 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd8e2b9c-4b71-44e5-bf77-84a5d76773cb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:29.302263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd8e2b9c-4b71-44e5-bf77-84a5d76773cb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:29.303019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd8e2b9c-4b71-44e5-bf77-84a5d76773cb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:29.303453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cd8e2b9c-4b71-44e5-bf77-84a5d76773cb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:29.361783 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cd8e2b9c-4b71-44e5-bf77-84a5d76773cb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:29.369409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cd8e2b9c-4b71-44e5-bf77-84a5d76773cb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078876 Mar 08 04:52:29.369988 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1528/3000] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:29 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:30.386962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cc0c7ad2-8f28-4adb-8d2a-f7285ac4da84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:30.387587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cc0c7ad2-8f28-4adb-8d2a-f7285ac4da84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:30.394681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc0c7ad2-8f28-4adb-8d2a-f7285ac4da84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:30.395149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc0c7ad2-8f28-4adb-8d2a-f7285ac4da84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:30.395905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc0c7ad2-8f28-4adb-8d2a-f7285ac4da84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:30.396363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cc0c7ad2-8f28-4adb-8d2a-f7285ac4da84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:30.455659 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cc0c7ad2-8f28-4adb-8d2a-f7285ac4da84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:30.463551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cc0c7ad2-8f28-4adb-8d2a-f7285ac4da84 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080683 Mar 08 04:52:30.464102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1473/3001] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:30 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:31.480391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-23665c66-8c12-4700-9fea-6993d61b87aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:31.481003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-23665c66-8c12-4700-9fea-6993d61b87aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:31.487854 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23665c66-8c12-4700-9fea-6993d61b87aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:31.488287 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23665c66-8c12-4700-9fea-6993d61b87aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:31.489042 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23665c66-8c12-4700-9fea-6993d61b87aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:31.489603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-23665c66-8c12-4700-9fea-6993d61b87aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:31.551586 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-23665c66-8c12-4700-9fea-6993d61b87aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:31.559368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-23665c66-8c12-4700-9fea-6993d61b87aa tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082889 Mar 08 04:52:31.560016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1529/3002] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:31 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:32.575163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cdac75f9-5b61-4061-bc09-9b51cc32eaf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:32.576488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cdac75f9-5b61-4061-bc09-9b51cc32eaf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:32.582784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cdac75f9-5b61-4061-bc09-9b51cc32eaf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:32.583233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cdac75f9-5b61-4061-bc09-9b51cc32eaf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:32.583990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cdac75f9-5b61-4061-bc09-9b51cc32eaf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:32.584426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cdac75f9-5b61-4061-bc09-9b51cc32eaf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:32.642694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cdac75f9-5b61-4061-bc09-9b51cc32eaf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:32.650211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cdac75f9-5b61-4061-bc09-9b51cc32eaf5 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078930 Mar 08 04:52:32.650766 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1474/3003] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:32 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:33.667866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e6583951-8303-42cd-a690-f20c753e6449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:33.668506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e6583951-8303-42cd-a690-f20c753e6449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:33.675288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6583951-8303-42cd-a690-f20c753e6449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:33.675729 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6583951-8303-42cd-a690-f20c753e6449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:33.676483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6583951-8303-42cd-a690-f20c753e6449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:33.676916 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6583951-8303-42cd-a690-f20c753e6449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:33.735399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e6583951-8303-42cd-a690-f20c753e6449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:33.742946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e6583951-8303-42cd-a690-f20c753e6449 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079001 Mar 08 04:52:33.743506 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1530/3004] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:33 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:34.759267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-858cbc40-813a-43f4-a862-7a7a1829d0f3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:34.759855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-858cbc40-813a-43f4-a862-7a7a1829d0f3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:34.767030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-858cbc40-813a-43f4-a862-7a7a1829d0f3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:34.767481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-858cbc40-813a-43f4-a862-7a7a1829d0f3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:34.768246 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-858cbc40-813a-43f4-a862-7a7a1829d0f3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:34.768683 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-858cbc40-813a-43f4-a862-7a7a1829d0f3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:34.828926 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-858cbc40-813a-43f4-a862-7a7a1829d0f3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:34.836650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-858cbc40-813a-43f4-a862-7a7a1829d0f3 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081222 Mar 08 04:52:34.837206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1475/3005] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:34 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:35.852999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3e5b86e6-7fa6-4cca-bd85-3ef1c60e5f25 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:35.853766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3e5b86e6-7fa6-4cca-bd85-3ef1c60e5f25 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:35.860726 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e5b86e6-7fa6-4cca-bd85-3ef1c60e5f25 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:35.861504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e5b86e6-7fa6-4cca-bd85-3ef1c60e5f25 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:35.862875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e5b86e6-7fa6-4cca-bd85-3ef1c60e5f25 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:35.863448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3e5b86e6-7fa6-4cca-bd85-3ef1c60e5f25 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:35.925449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3e5b86e6-7fa6-4cca-bd85-3ef1c60e5f25 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:35.933083 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3e5b86e6-7fa6-4cca-bd85-3ef1c60e5f25 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.083968 Mar 08 04:52:35.933644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1531/3006] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:35 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:36.949799 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4b613419-e7e8-4b3a-80a5-a96b59936433 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:36.951080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4b613419-e7e8-4b3a-80a5-a96b59936433 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:36.956916 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b613419-e7e8-4b3a-80a5-a96b59936433 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:36.957360 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b613419-e7e8-4b3a-80a5-a96b59936433 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:36.958142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b613419-e7e8-4b3a-80a5-a96b59936433 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:36.958576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4b613419-e7e8-4b3a-80a5-a96b59936433 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:37.015762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4b613419-e7e8-4b3a-80a5-a96b59936433 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:37.023523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4b613419-e7e8-4b3a-80a5-a96b59936433 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077663 Mar 08 04:52:37.024074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1476/3007] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:36 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:38.040277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-910f4ae7-b187-4fef-8e6d-f4906535176f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:38.040842 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-910f4ae7-b187-4fef-8e6d-f4906535176f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:38.047614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-910f4ae7-b187-4fef-8e6d-f4906535176f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:38.048060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-910f4ae7-b187-4fef-8e6d-f4906535176f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:38.048819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-910f4ae7-b187-4fef-8e6d-f4906535176f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:38.049252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-910f4ae7-b187-4fef-8e6d-f4906535176f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:38.110022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-910f4ae7-b187-4fef-8e6d-f4906535176f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:38.117537 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-910f4ae7-b187-4fef-8e6d-f4906535176f tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081156 Mar 08 04:52:38.118116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1532/3008] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:38 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:39.134286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-56fb8eb6-83f2-4865-93c3-b940cb9e520d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:39.134855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-56fb8eb6-83f2-4865-93c3-b940cb9e520d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:39.141048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56fb8eb6-83f2-4865-93c3-b940cb9e520d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:39.141798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56fb8eb6-83f2-4865-93c3-b940cb9e520d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:39.142562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56fb8eb6-83f2-4865-93c3-b940cb9e520d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:39.142999 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-56fb8eb6-83f2-4865-93c3-b940cb9e520d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:39.202543 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-56fb8eb6-83f2-4865-93c3-b940cb9e520d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:39.210365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-56fb8eb6-83f2-4865-93c3-b940cb9e520d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080016 Mar 08 04:52:39.210924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1477/3009] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:39 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:40.226347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-682b4bd2-cfc3-411c-aea4-f53dbcf6257b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:40.226956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-682b4bd2-cfc3-411c-aea4-f53dbcf6257b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:40.233941 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-682b4bd2-cfc3-411c-aea4-f53dbcf6257b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:40.234391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-682b4bd2-cfc3-411c-aea4-f53dbcf6257b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:40.235167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-682b4bd2-cfc3-411c-aea4-f53dbcf6257b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:40.235588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-682b4bd2-cfc3-411c-aea4-f53dbcf6257b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:40.292737 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-682b4bd2-cfc3-411c-aea4-f53dbcf6257b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:40.301213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-682b4bd2-cfc3-411c-aea4-f53dbcf6257b tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078764 Mar 08 04:52:40.301788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1533/3010] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:40 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:41.318256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dc3968d1-8fd0-4d06-b538-a0a74c3408b2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:41.318850 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dc3968d1-8fd0-4d06-b538-a0a74c3408b2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:41.325751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc3968d1-8fd0-4d06-b538-a0a74c3408b2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:41.326206 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc3968d1-8fd0-4d06-b538-a0a74c3408b2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:41.326970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc3968d1-8fd0-4d06-b538-a0a74c3408b2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:41.327409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc3968d1-8fd0-4d06-b538-a0a74c3408b2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:41.385812 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dc3968d1-8fd0-4d06-b538-a0a74c3408b2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:41.394105 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dc3968d1-8fd0-4d06-b538-a0a74c3408b2 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079709 Mar 08 04:52:41.394670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1478/3011] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:41 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:42.410403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-be38d036-26c3-4d49-b0d3-149e0c257409 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:42.411007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-be38d036-26c3-4d49-b0d3-149e0c257409 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:42.417237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be38d036-26c3-4d49-b0d3-149e0c257409 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:42.417716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be38d036-26c3-4d49-b0d3-149e0c257409 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:42.418520 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be38d036-26c3-4d49-b0d3-149e0c257409 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:42.418942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-be38d036-26c3-4d49-b0d3-149e0c257409 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:42.476797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-be38d036-26c3-4d49-b0d3-149e0c257409 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:42.484460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-be38d036-26c3-4d49-b0d3-149e0c257409 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077923 Mar 08 04:52:42.485017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1534/3012] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:42 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:43.500921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e995090f-7bf1-481c-a499-97e069f741bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:43.501513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e995090f-7bf1-481c-a499-97e069f741bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:43.507736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e995090f-7bf1-481c-a499-97e069f741bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:43.508180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e995090f-7bf1-481c-a499-97e069f741bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:43.508937 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e995090f-7bf1-481c-a499-97e069f741bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:43.509461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e995090f-7bf1-481c-a499-97e069f741bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:43.568361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e995090f-7bf1-481c-a499-97e069f741bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:43.576544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e995090f-7bf1-481c-a499-97e069f741bb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079665 Mar 08 04:52:43.577102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1479/3013] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:43 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:44.592964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6d41d0df-1e5a-4d76-ac4f-0bccf46600eb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:44.593585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6d41d0df-1e5a-4d76-ac4f-0bccf46600eb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:44.599850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d41d0df-1e5a-4d76-ac4f-0bccf46600eb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:44.600300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d41d0df-1e5a-4d76-ac4f-0bccf46600eb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:44.601065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d41d0df-1e5a-4d76-ac4f-0bccf46600eb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:44.601503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6d41d0df-1e5a-4d76-ac4f-0bccf46600eb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:44.662725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6d41d0df-1e5a-4d76-ac4f-0bccf46600eb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:44.670562 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6d41d0df-1e5a-4d76-ac4f-0bccf46600eb tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082245 Mar 08 04:52:44.671114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1535/3014] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:44 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:45.687728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b5213bc6-6396-4fb0-a54b-2c4f8a31db2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:45.688309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b5213bc6-6396-4fb0-a54b-2c4f8a31db2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:45.694505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5213bc6-6396-4fb0-a54b-2c4f8a31db2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:45.694950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5213bc6-6396-4fb0-a54b-2c4f8a31db2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:45.695696 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5213bc6-6396-4fb0-a54b-2c4f8a31db2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:45.696132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b5213bc6-6396-4fb0-a54b-2c4f8a31db2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:45.754577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b5213bc6-6396-4fb0-a54b-2c4f8a31db2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:45.762911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b5213bc6-6396-4fb0-a54b-2c4f8a31db2e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079065 Mar 08 04:52:45.763468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1480/3015] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:45 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:46.780136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-15463607-77e4-478c-9bd1-bb580c0fb35d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:46.780736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-15463607-77e4-478c-9bd1-bb580c0fb35d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:46.787055 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-15463607-77e4-478c-9bd1-bb580c0fb35d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:46.787508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-15463607-77e4-478c-9bd1-bb580c0fb35d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:46.788278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-15463607-77e4-478c-9bd1-bb580c0fb35d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:46.788746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-15463607-77e4-478c-9bd1-bb580c0fb35d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:46.847779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-15463607-77e4-478c-9bd1-bb580c0fb35d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:46.855525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-15463607-77e4-478c-9bd1-bb580c0fb35d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079926 Mar 08 04:52:46.856293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1536/3016] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:46 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:47.872876 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ba3028ba-51b5-4508-a861-e362b2b4070a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:47.873517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ba3028ba-51b5-4508-a861-e362b2b4070a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:47.879800 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba3028ba-51b5-4508-a861-e362b2b4070a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:47.880254 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba3028ba-51b5-4508-a861-e362b2b4070a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:47.881030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba3028ba-51b5-4508-a861-e362b2b4070a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:47.881470 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ba3028ba-51b5-4508-a861-e362b2b4070a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:47.945106 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ba3028ba-51b5-4508-a861-e362b2b4070a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:47.953686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ba3028ba-51b5-4508-a861-e362b2b4070a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.085119 Mar 08 04:52:47.954191 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1481/3017] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:47 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:48.970846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-320429bc-10ff-47c8-8f56-d344f2b24533 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:48.971510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-320429bc-10ff-47c8-8f56-d344f2b24533 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:48.977374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-320429bc-10ff-47c8-8f56-d344f2b24533 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:48.977862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-320429bc-10ff-47c8-8f56-d344f2b24533 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:48.978629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-320429bc-10ff-47c8-8f56-d344f2b24533 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:48.979068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-320429bc-10ff-47c8-8f56-d344f2b24533 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:49.036527 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-320429bc-10ff-47c8-8f56-d344f2b24533 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:49.044142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-320429bc-10ff-47c8-8f56-d344f2b24533 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077268 Mar 08 04:52:49.044704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1537/3018] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:48 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:50.060863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f6898f8f-daec-4347-9742-8e09c9538db9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:50.061502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f6898f8f-daec-4347-9742-8e09c9538db9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:50.067725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f6898f8f-daec-4347-9742-8e09c9538db9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:50.068172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f6898f8f-daec-4347-9742-8e09c9538db9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:50.068933 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f6898f8f-daec-4347-9742-8e09c9538db9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:50.069371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f6898f8f-daec-4347-9742-8e09c9538db9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:50.126965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f6898f8f-daec-4347-9742-8e09c9538db9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:50.134802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f6898f8f-daec-4347-9742-8e09c9538db9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.077997 Mar 08 04:52:50.135408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1482/3019] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:50 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:51.152248 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-04e11450-18ad-408f-9132-8a809116994e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:51.153150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-04e11450-18ad-408f-9132-8a809116994e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:51.160460 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04e11450-18ad-408f-9132-8a809116994e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:51.160972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04e11450-18ad-408f-9132-8a809116994e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:51.161911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04e11450-18ad-408f-9132-8a809116994e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:51.162355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-04e11450-18ad-408f-9132-8a809116994e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:51.229622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-04e11450-18ad-408f-9132-8a809116994e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:51.237997 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-04e11450-18ad-408f-9132-8a809116994e tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.089707 Mar 08 04:52:51.238553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1538/3020] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:51 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:52.255080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bb7e2793-16d2-4477-9287-e8fabe5d8df0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:52.255702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bb7e2793-16d2-4477-9287-e8fabe5d8df0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:52.262067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb7e2793-16d2-4477-9287-e8fabe5d8df0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:52.262605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb7e2793-16d2-4477-9287-e8fabe5d8df0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:52.263405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb7e2793-16d2-4477-9287-e8fabe5d8df0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:52.263845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bb7e2793-16d2-4477-9287-e8fabe5d8df0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:52.321966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bb7e2793-16d2-4477-9287-e8fabe5d8df0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:52.329651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bb7e2793-16d2-4477-9287-e8fabe5d8df0 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078393 Mar 08 04:52:52.330229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1483/3021] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:52 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:53.346429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2d6de457-c36f-44df-8e14-43b63879a5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:53.347069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2d6de457-c36f-44df-8e14-43b63879a5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:53.353238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d6de457-c36f-44df-8e14-43b63879a5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:53.353711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d6de457-c36f-44df-8e14-43b63879a5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:53.354473 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d6de457-c36f-44df-8e14-43b63879a5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:53.354915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2d6de457-c36f-44df-8e14-43b63879a5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:53.412620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2d6de457-c36f-44df-8e14-43b63879a5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:53.421380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2d6de457-c36f-44df-8e14-43b63879a5af tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078807 Mar 08 04:52:53.421978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1539/3022] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:53 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:52:54.439433 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dcdd2a11-ca0c-43b8-90dc-acb952409241 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:54.440033 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dcdd2a11-ca0c-43b8-90dc-acb952409241 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:54.445901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dcdd2a11-ca0c-43b8-90dc-acb952409241 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:54.446352 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dcdd2a11-ca0c-43b8-90dc-acb952409241 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:54.447109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dcdd2a11-ca0c-43b8-90dc-acb952409241 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:54.447544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dcdd2a11-ca0c-43b8-90dc-acb952409241 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:54.506143 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dcdd2a11-ca0c-43b8-90dc-acb952409241 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:54.516612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dcdd2a11-ca0c-43b8-90dc-acb952409241 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082242 Mar 08 04:52:54.517472 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1484/3023] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:54 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:55.534521 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1250da10-a21e-4d62-a82b-dfb4dd4d0ff9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:55.535120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1250da10-a21e-4d62-a82b-dfb4dd4d0ff9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:55.541328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1250da10-a21e-4d62-a82b-dfb4dd4d0ff9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:55.541799 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1250da10-a21e-4d62-a82b-dfb4dd4d0ff9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:55.542568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1250da10-a21e-4d62-a82b-dfb4dd4d0ff9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:55.543669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1250da10-a21e-4d62-a82b-dfb4dd4d0ff9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:55.601977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1250da10-a21e-4d62-a82b-dfb4dd4d0ff9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:55.609713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1250da10-a21e-4d62-a82b-dfb4dd4d0ff9 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079090 Mar 08 04:52:55.610271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1540/3024] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:55 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:56.625434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d962f2fc-66a4-48fb-a857-b988870479d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:56.626062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d962f2fc-66a4-48fb-a857-b988870479d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:56.632781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d962f2fc-66a4-48fb-a857-b988870479d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:56.633229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d962f2fc-66a4-48fb-a857-b988870479d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:56.634024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d962f2fc-66a4-48fb-a857-b988870479d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:56.634458 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d962f2fc-66a4-48fb-a857-b988870479d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:56.698506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d962f2fc-66a4-48fb-a857-b988870479d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:56.706906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d962f2fc-66a4-48fb-a857-b988870479d6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.085366 Mar 08 04:52:56.707467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1485/3025] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:56 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:57.723744 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-22e2e3bd-ffe7-4b9b-b565-040d93fa04ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:57.724356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-22e2e3bd-ffe7-4b9b-b565-040d93fa04ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:57.731474 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-22e2e3bd-ffe7-4b9b-b565-040d93fa04ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:57.731930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-22e2e3bd-ffe7-4b9b-b565-040d93fa04ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:57.732709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-22e2e3bd-ffe7-4b9b-b565-040d93fa04ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:57.733131 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-22e2e3bd-ffe7-4b9b-b565-040d93fa04ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:57.794742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-22e2e3bd-ffe7-4b9b-b565-040d93fa04ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:57.802522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-22e2e3bd-ffe7-4b9b-b565-040d93fa04ec tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.082619 Mar 08 04:52:57.803083 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1541/3026] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:57 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:58.819298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-00001772-52d1-47dd-9b31-217930ae8c4d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:58.819915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-00001772-52d1-47dd-9b31-217930ae8c4d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:58.826263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00001772-52d1-47dd-9b31-217930ae8c4d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:58.826710 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00001772-52d1-47dd-9b31-217930ae8c4d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:58.827467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00001772-52d1-47dd-9b31-217930ae8c4d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:58.827900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-00001772-52d1-47dd-9b31-217930ae8c4d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:58.885465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-00001772-52d1-47dd-9b31-217930ae8c4d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:58.893781 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-00001772-52d1-47dd-9b31-217930ae8c4d tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078372 Mar 08 04:52:58.894342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1486/3027] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:58 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:52:59.911192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5ae5e42e-b3a1-44fa-99de-2a6a1d402909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:52:59.911808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5ae5e42e-b3a1-44fa-99de-2a6a1d402909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:52:59.918400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ae5e42e-b3a1-44fa-99de-2a6a1d402909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:59.918785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ae5e42e-b3a1-44fa-99de-2a6a1d402909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:59.919557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ae5e42e-b3a1-44fa-99de-2a6a1d402909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:52:59.920000 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5ae5e42e-b3a1-44fa-99de-2a6a1d402909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:52:59.977734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5ae5e42e-b3a1-44fa-99de-2a6a1d402909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:52:59.987017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5ae5e42e-b3a1-44fa-99de-2a6a1d402909 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079431 Mar 08 04:52:59.987823 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1542/3028] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:52:59 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:01.004319 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a091f3fa-c0f9-4f6f-9c82-c9c47e283cf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:01.004935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a091f3fa-c0f9-4f6f-9c82-c9c47e283cf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:01.011142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a091f3fa-c0f9-4f6f-9c82-c9c47e283cf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:01.012128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a091f3fa-c0f9-4f6f-9c82-c9c47e283cf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:01.012980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a091f3fa-c0f9-4f6f-9c82-c9c47e283cf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:01.013420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a091f3fa-c0f9-4f6f-9c82-c9c47e283cf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:01.070981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a091f3fa-c0f9-4f6f-9c82-c9c47e283cf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:01.079169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a091f3fa-c0f9-4f6f-9c82-c9c47e283cf6 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.078754 Mar 08 04:53:01.079730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1487/3029] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:00 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:02.096334 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5892ee1c-fa0c-4afa-b6f8-ddc6d6548d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:02.096892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5892ee1c-fa0c-4afa-b6f8-ddc6d6548d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:02.103155 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5892ee1c-fa0c-4afa-b6f8-ddc6d6548d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:02.103608 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5892ee1c-fa0c-4afa-b6f8-ddc6d6548d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:02.104369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5892ee1c-fa0c-4afa-b6f8-ddc6d6548d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:02.104804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5892ee1c-fa0c-4afa-b6f8-ddc6d6548d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:02.163361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5892ee1c-fa0c-4afa-b6f8-ddc6d6548d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:02.171840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5892ee1c-fa0c-4afa-b6f8-ddc6d6548d79 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079461 Mar 08 04:53:02.172399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1543/3030] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:02 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:03.187643 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-359aa86b-063b-49b0-93be-c24b1783eeed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:03.188279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-359aa86b-063b-49b0-93be-c24b1783eeed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:03.194518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-359aa86b-063b-49b0-93be-c24b1783eeed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:03.194967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-359aa86b-063b-49b0-93be-c24b1783eeed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:03.195733 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-359aa86b-063b-49b0-93be-c24b1783eeed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:03.196169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-359aa86b-063b-49b0-93be-c24b1783eeed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:03.254463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-359aa86b-063b-49b0-93be-c24b1783eeed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:03.262877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-359aa86b-063b-49b0-93be-c24b1783eeed tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.079204 Mar 08 04:53:03.263434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1488/3031] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:03 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:04.279800 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-57fa2fc0-4126-4d39-9b6d-978cb708850a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:04.280407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-57fa2fc0-4126-4d39-9b6d-978cb708850a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:04.286673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57fa2fc0-4126-4d39-9b6d-978cb708850a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:04.287123 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57fa2fc0-4126-4d39-9b6d-978cb708850a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:04.287884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57fa2fc0-4126-4d39-9b6d-978cb708850a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:04.288318 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-57fa2fc0-4126-4d39-9b6d-978cb708850a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:04.349621 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-57fa2fc0-4126-4d39-9b6d-978cb708850a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:04.357422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-57fa2fc0-4126-4d39-9b6d-978cb708850a tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.081634 Mar 08 04:53:04.358014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1544/3032] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:04 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:05.375258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-62f7fee1-1eff-40cd-bed7-b3b61913a024 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:05.375863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-62f7fee1-1eff-40cd-bed7-b3b61913a024 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:05.382675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62f7fee1-1eff-40cd-bed7-b3b61913a024 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:05.383127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62f7fee1-1eff-40cd-bed7-b3b61913a024 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:05.383903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62f7fee1-1eff-40cd-bed7-b3b61913a024 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:05.384337 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62f7fee1-1eff-40cd-bed7-b3b61913a024 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:05.447938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-62f7fee1-1eff-40cd-bed7-b3b61913a024 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:05.455640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-62f7fee1-1eff-40cd-bed7-b3b61913a024 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.086390 Mar 08 04:53:05.456197 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1489/3033] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:05 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:06.472168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-91c32bf6-0e41-40c0-94da-aea1c193bd55 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:06.472777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-91c32bf6-0e41-40c0-94da-aea1c193bd55 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:06.479090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91c32bf6-0e41-40c0-94da-aea1c193bd55 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:06.479541 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91c32bf6-0e41-40c0-94da-aea1c193bd55 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:06.480907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91c32bf6-0e41-40c0-94da-aea1c193bd55 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:06.481345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-91c32bf6-0e41-40c0-94da-aea1c193bd55 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:06.540919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-91c32bf6-0e41-40c0-94da-aea1c193bd55 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:06.549288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-91c32bf6-0e41-40c0-94da-aea1c193bd55 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1353 microversion: 2.1 time: 0.080950 Mar 08 04:53:06.549885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1545/3034] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:06 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:07.566693 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:07.567291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:07.574066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:07.574517 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:07.586532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:07.588276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:07.601998 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e797ef3b-cb78-4662-a3dd-0208e36bb9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5671069f-7996-403a-a290-2a952d35d16b"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:07.603199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e797ef3b-cb78-4662-a3dd-0208e36bb9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:07.610469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e797ef3b-cb78-4662-a3dd-0208e36bb9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:07.611077 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e797ef3b-cb78-4662-a3dd-0208e36bb9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:07.612270 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e797ef3b-cb78-4662-a3dd-0208e36bb9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:07.612945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e797ef3b-cb78-4662-a3dd-0208e36bb9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:07.633868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:07.634239 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:07.634702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lazy-loading 'fault' on Instance uuid 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:53:07.709587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a95742d54d4f3d9a5e802e95d7c9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673612dac9a4f24976855c12beba590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:07.727750 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-18566b22-3855-4b85-b022-318fb9cf2ed8 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 200 len: 1401 microversion: 2.1 time: 0.165090 Mar 08 04:53:07.728877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1490/3035] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:07 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 1401 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:08.026614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e797ef3b-cb78-4662-a3dd-0208e36bb9bc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428483 Mar 08 04:53:08.027246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1546/3036] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:53:07 2022] POST /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:08.630638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-e7bd1e33-38c2-47e7-8b7b-bea38e8aa918 req-d6791198-9383-4d41-8e69-e46106e2e6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1088612f-57f5-4e1a-bf1a-5f218b6f9eb5", "name": "network-vif-deleted", "tag": "f1b4d95e-df7d-4dd5-a257-db8b401c5084"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:08.639030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-e7bd1e33-38c2-47e7-8b7b-bea38e8aa918 req-d6791198-9383-4d41-8e69-e46106e2e6e6 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:08.639467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-e7bd1e33-38c2-47e7-8b7b-bea38e8aa918 req-d6791198-9383-4d41-8e69-e46106e2e6e6 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:08.649956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-e7bd1e33-38c2-47e7-8b7b-bea38e8aa918 req-d6791198-9383-4d41-8e69-e46106e2e6e6 service nova] Creating event network-vif-deleted:f1b4d95e-df7d-4dd5-a257-db8b401c5084 for instance 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 on hv-cinder-73306 Mar 08 04:53:08.656622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-e7bd1e33-38c2-47e7-8b7b-bea38e8aa918 req-d6791198-9383-4d41-8e69-e46106e2e6e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088475 Mar 08 04:53:08.657194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1491/3037] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:08.746008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4f738717-e720-4fb2-a495-864a02e74d74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:08.747152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4f738717-e720-4fb2-a495-864a02e74d74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] [instance: 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:08.753944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f738717-e720-4fb2-a495-864a02e74d74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:08.754398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f738717-e720-4fb2-a495-864a02e74d74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:08.755165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f738717-e720-4fb2-a495-864a02e74d74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:08.755634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4f738717-e720-4fb2-a495-864a02e74d74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:08.769695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-4f738717-e720-4fb2-a495-864a02e74d74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] HTTP exception thrown: Instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 could not be found. Mar 08 04:53:08.770220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4f738717-e720-4fb2-a495-864a02e74d74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] Returning 404 to user: Instance 4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:53:08.771037 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4f738717-e720-4fb2-a495-864a02e74d74 tempest-ServerRescueNegativeTestJSON-1613826032 tempest-ServerRescueNegativeTestJSON-1613826032-project] 10.222.0.30 "GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22" status: 404 len: 111 microversion: 2.1 time: 0.029332 Mar 08 04:53:08.771560 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1547/3038] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:08 2022] GET /compute/v2.1/servers/4f53eaeb-7b60-4548-bea0-fafe6e0c6a22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:53:12.469089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-32f808b2-9714-4216-bb5a-31113e3044d6 req-bfea9216-b94f-48b2-a879-86cd2f086850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d0c157-7b91-4fe9-aa50-c33e2e1f18ef", "name": "network-vif-deleted", "tag": "2771b3b1-8e55-423b-b896-353c71b4a88f"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:12.478406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-32f808b2-9714-4216-bb5a-31113e3044d6 req-bfea9216-b94f-48b2-a879-86cd2f086850 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:12.478919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-32f808b2-9714-4216-bb5a-31113e3044d6 req-bfea9216-b94f-48b2-a879-86cd2f086850 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:12.491851 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-32f808b2-9714-4216-bb5a-31113e3044d6 req-bfea9216-b94f-48b2-a879-86cd2f086850 service nova] Creating event network-vif-deleted:2771b3b1-8e55-423b-b896-353c71b4a88f for instance 08d0c157-7b91-4fe9-aa50-c33e2e1f18ef on hv-cinder-73306 Mar 08 04:53:12.498046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-32f808b2-9714-4216-bb5a-31113e3044d6 req-bfea9216-b94f-48b2-a879-86cd2f086850 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033023 Mar 08 04:53:12.498846 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1492/3039] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:17.344539 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e647a653-95d7-4edc-a897-cdbb01fc382a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'create', calling method: .version_select at 0x7fe8324aef70>, body: {"keypair": {"name": "tempest-keypair-1292408308"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:17.359180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-e647a653-95d7-4edc-a897-cdbb01fc382a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for project 151b2e10af2e44ae84b8846b557c2833. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:53:17.363559 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-e647a653-95d7-4edc-a897-cdbb01fc382a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for user bde776f1a50e4d87ad153df6f6f8d315 and project 151b2e10af2e44ae84b8846b557c2833. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:53:17.550804 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-e647a653-95d7-4edc-a897-cdbb01fc382a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for project 151b2e10af2e44ae84b8846b557c2833. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:53:17.554561 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-e647a653-95d7-4edc-a897-cdbb01fc382a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for user bde776f1a50e4d87ad153df6f6f8d315 and project 151b2e10af2e44ae84b8846b557c2833. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:53:17.567711 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e647a653-95d7-4edc-a897-cdbb01fc382a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.345397 Mar 08 04:53:17.568299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1548/3040] 10.222.0.30 () {62 vars in 1198 bytes} [Tue Mar 8 04:53:17 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 347 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 08 04:53:18.860328 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2047197623", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e25b776-a7fe-4fc1-8a46-a03e164be347"}], "security_groups": [{"name": "tempest-securitygroup--1255623555"}], "key_name": "tempest-keypair-1292408308", "user_data": "}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:18.964835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.network.neutron [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] validate_networks() for [('4e25b776-a7fe-4fc1-8a46-a03e164be347', None, None, None, None, None)] {{(pid=116775) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:53:19.349784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Flavor limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:53:19.350308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Image limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:53:19.351076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Flavor pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:53:19.351557 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Image pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:53:19.352175 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:53:19.363744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:19.364436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:19.365308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:19.365855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:19.385911 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for project 151b2e10af2e44ae84b8846b557c2833. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:53:19.391115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for user bde776f1a50e4d87ad153df6f6f8d315 and project 151b2e10af2e44ae84b8846b557c2833. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:53:19.401910 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Going to run 1 instances... {{(pid=116775) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:53:19.404932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:53:19.451024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-48f51d9b-8fdd-49c0-ba76-78bf6083c1c1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.596472 Mar 08 04:53:19.452024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1493/3041] 10.222.0.30 () {62 vars in 1187 bytes} [Tue Mar 8 04:53:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 04:53:19.461986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a578efd4-35fc-4fd2-86ef-cdb83be5e6d0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:19.462722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a578efd4-35fc-4fd2-86ef-cdb83be5e6d0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:19.517167 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a578efd4-35fc-4fd2-86ef-cdb83be5e6d0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:19.525253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a578efd4-35fc-4fd2-86ef-cdb83be5e6d0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:19.527071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a578efd4-35fc-4fd2-86ef-cdb83be5e6d0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:19.528923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a578efd4-35fc-4fd2-86ef-cdb83be5e6d0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1282 microversion: 2.20 time: 0.071240 Mar 08 04:53:19.529771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1549/3042] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:53:19 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:53:20.548286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:20.549093 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:20.555563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:20.556014 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:20.556782 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:20.557213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:20.626879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:20.635481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:20.637579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:20.639015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e7d47c70-dc05-4696-9a9b-f80c6aa4725d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1334 microversion: 2.20 time: 0.095999 Mar 08 04:53:20.639770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1494/3043] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:53:20 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:53:20.984354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-270e2cf9-816d-4da3-a5db-789ddd71efa4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:20.985336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-270e2cf9-816d-4da3-a5db-789ddd71efa4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:20.992592 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-270e2cf9-816d-4da3-a5db-789ddd71efa4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:20.993034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-270e2cf9-816d-4da3-a5db-789ddd71efa4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:20.993824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-270e2cf9-816d-4da3-a5db-789ddd71efa4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:20.994256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-270e2cf9-816d-4da3-a5db-789ddd71efa4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:21.034024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-270e2cf9-816d-4da3-a5db-789ddd71efa4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053017 Mar 08 04:53:21.034614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1550/3044] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:53:20 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:21.049178 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-306f3f42-28fd-4ccc-9a43-2bcbf13ebec3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:21.049736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-306f3f42-28fd-4ccc-9a43-2bcbf13ebec3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:21.055931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-306f3f42-28fd-4ccc-9a43-2bcbf13ebec3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:21.056391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-306f3f42-28fd-4ccc-9a43-2bcbf13ebec3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:21.057169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-306f3f42-28fd-4ccc-9a43-2bcbf13ebec3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:21.057606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-306f3f42-28fd-4ccc-9a43-2bcbf13ebec3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:21.092715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-306f3f42-28fd-4ccc-9a43-2bcbf13ebec3 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/5671069f-7996-403a-a290-2a952d35d16b" status: 200 len: 194 microversion: 2.1 time: 0.047887 Mar 08 04:53:21.093329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1495/3045] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Mar 8 04:53:21 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/5671069f-7996-403a-a290-2a952d35d16b => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:21.664648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:21.666750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:21.674072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:21.674862 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:21.675656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:21.676100 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:21.914496 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:21.924681 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:21.926815 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:21.928211 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-40861694-23d1-4a5c-88c1-952b89ea813b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1408 microversion: 2.20 time: 0.269785 Mar 08 04:53:21.939517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1551/3046] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:53:21 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:53:22.332218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-15e3e0be-e2d5-4762-93b3-aacafdd0a5b0 req-45e775ee-0dc8-4dfc-837f-d292f6b3777d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d893a718-bf02-4bf4-a648-27ae785dbfdb", "tag": "c0a86271-cf56-4114-916f-e0a180245907"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:22.338624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-15e3e0be-e2d5-4762-93b3-aacafdd0a5b0 req-45e775ee-0dc8-4dfc-837f-d292f6b3777d service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:22.339376 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-15e3e0be-e2d5-4762-93b3-aacafdd0a5b0 req-45e775ee-0dc8-4dfc-837f-d292f6b3777d service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:22.354840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-15e3e0be-e2d5-4762-93b3-aacafdd0a5b0 req-45e775ee-0dc8-4dfc-837f-d292f6b3777d service nova] Creating event network-changed:c0a86271-cf56-4114-916f-e0a180245907 for instance d893a718-bf02-4bf4-a648-27ae785dbfdb on hv-cinder-73306 Mar 08 04:53:22.360356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-15e3e0be-e2d5-4762-93b3-aacafdd0a5b0 req-45e775ee-0dc8-4dfc-837f-d292f6b3777d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034678 Mar 08 04:53:22.361363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1496/3047] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:22.463234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-81bf05ce-5462-4f63-9072-52270ab00bfc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51f3866d-f37c-4274-bc7d-83bf60b80b67"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:22.464285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-81bf05ce-5462-4f63-9072-52270ab00bfc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:22.471404 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-81bf05ce-5462-4f63-9072-52270ab00bfc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:22.472130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-81bf05ce-5462-4f63-9072-52270ab00bfc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:22.473134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-81bf05ce-5462-4f63-9072-52270ab00bfc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:22.473615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-81bf05ce-5462-4f63-9072-52270ab00bfc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:22.721607 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-81bf05ce-5462-4f63-9072-52270ab00bfc tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "POST /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262151 Mar 08 04:53:22.722551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1552/3048] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:53:22 2022] POST /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:22.947809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:22.948966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:22.956636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:22.957796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:22.958835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:22.959431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:23.094442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:23.102402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:23.103996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:23.105203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2eda2731-74d2-4773-a05d-bbde0c8ba8f9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1408 microversion: 2.20 time: 0.161715 Mar 08 04:53:23.106125 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1497/3049] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:53:22 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:53:24.123523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:24.124213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:24.130264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:24.130716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:24.131477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:24.131920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:24.273464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:24.282866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:24.284658 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:24.286407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9433322d-5119-4438-959b-95842ca53271 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1408 microversion: 2.20 time: 0.167134 Mar 08 04:53:24.286985 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1553/3050] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:53:24 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:53:25.304566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:25.305181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:25.311511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:25.311963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:25.312732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:25.313401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:25.453848 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:25.461731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:25.463241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:25.464320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-beaa227e-e897-4f70-b834-b3f8e0233021 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1408 microversion: 2.20 time: 0.163940 Mar 08 04:53:25.465633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1498/3051] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:53:25 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:53:26.484432 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:26.485390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:26.493013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:26.493673 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:26.494865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:26.495650 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:26.639107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:26.647023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:26.648530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:26.649622 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-36657145-8040-421e-bd7c-ef68a42c246c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1408 microversion: 2.20 time: 0.170807 Mar 08 04:53:26.650218 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1554/3052] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:53:26 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:53:27.362199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-7253fcca-e6a7-43ed-a46e-2d08d6d64eb6 req-2b8db478-c85b-4767-954e-44955fb85159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893a718-bf02-4bf4-a648-27ae785dbfdb", "name": "network-vif-plugged", "status": "completed", "tag": "c0a86271-cf56-4114-916f-e0a180245907"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:27.370443 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-7253fcca-e6a7-43ed-a46e-2d08d6d64eb6 req-2b8db478-c85b-4767-954e-44955fb85159 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:27.371902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-7253fcca-e6a7-43ed-a46e-2d08d6d64eb6 req-2b8db478-c85b-4767-954e-44955fb85159 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:27.382719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-7253fcca-e6a7-43ed-a46e-2d08d6d64eb6 req-2b8db478-c85b-4767-954e-44955fb85159 service nova] Creating event network-vif-plugged:c0a86271-cf56-4114-916f-e0a180245907 for instance d893a718-bf02-4bf4-a648-27ae785dbfdb on hv-cinder-73306 Mar 08 04:53:27.387826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-7253fcca-e6a7-43ed-a46e-2d08d6d64eb6 req-2b8db478-c85b-4767-954e-44955fb85159 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098024 Mar 08 04:53:27.388402 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1499/3053] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:53:27.667381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:27.668099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:27.674384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:27.674837 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:27.675599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:27.676038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:27.810779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:27.818408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:27.819911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:27.821007 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c3863a5f-5223-479e-a0bc-d7420377aab1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1408 microversion: 2.20 time: 0.157524 Mar 08 04:53:27.821551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1555/3054] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:53:27 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:53:28.840256 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:28.840925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:28.847152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:28.847596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:28.848391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:28.851334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:28.992711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:29.000651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:29.002184 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:29.003322 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-41428b4d-3551-4543-83e3-7288c4b09cbd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1600 microversion: 2.20 time: 0.169079 Mar 08 04:53:29.003870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1500/3055] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:53:28 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:53:29.020851 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9b529c9f-fb49-49be-aafc-1c0142ca01cd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:29.021382 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9b529c9f-fb49-49be-aafc-1c0142ca01cd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:29.027966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b529c9f-fb49-49be-aafc-1c0142ca01cd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:29.028407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b529c9f-fb49-49be-aafc-1c0142ca01cd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:29.029161 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b529c9f-fb49-49be-aafc-1c0142ca01cd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:29.029601 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9b529c9f-fb49-49be-aafc-1c0142ca01cd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:29.111205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9b529c9f-fb49-49be-aafc-1c0142ca01cd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094201 Mar 08 04:53:29.111782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1556/3056] 10.222.0.30 () {60 vars in 1315 bytes} [Tue Mar 8 04:53:29 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:53:30.202114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0f9a1f83-707a-493b-b1dc-a1585341d6ae tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:30.203035 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0f9a1f83-707a-493b-b1dc-a1585341d6ae tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:30.209252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f9a1f83-707a-493b-b1dc-a1585341d6ae tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:30.209731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f9a1f83-707a-493b-b1dc-a1585341d6ae tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:30.210496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f9a1f83-707a-493b-b1dc-a1585341d6ae tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:30.210936 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f9a1f83-707a-493b-b1dc-a1585341d6ae tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:30.241495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0f9a1f83-707a-493b-b1dc-a1585341d6ae tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044133 Mar 08 04:53:30.242072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1501/3057] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:53:30 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:30.329747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-8481fcd7-1da3-4b9c-aeab-a2c34f225804 req-4e321a72-3255-4f69-9962-a6e993fe3021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d893a718-bf02-4bf4-a648-27ae785dbfdb", "tag": "c0a86271-cf56-4114-916f-e0a180245907"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:30.338278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-8481fcd7-1da3-4b9c-aeab-a2c34f225804 req-4e321a72-3255-4f69-9962-a6e993fe3021 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:30.338718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-8481fcd7-1da3-4b9c-aeab-a2c34f225804 req-4e321a72-3255-4f69-9962-a6e993fe3021 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:30.349978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-8481fcd7-1da3-4b9c-aeab-a2c34f225804 req-4e321a72-3255-4f69-9962-a6e993fe3021 service nova] Creating event network-changed:c0a86271-cf56-4114-916f-e0a180245907 for instance d893a718-bf02-4bf4-a648-27ae785dbfdb on hv-cinder-73306 Mar 08 04:53:30.355755 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-8481fcd7-1da3-4b9c-aeab-a2c34f225804 req-4e321a72-3255-4f69-9962-a6e993fe3021 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032094 Mar 08 04:53:30.356313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1557/3058] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:30.387853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5216559f-7f95-4c63-bc66-c09877c35067 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:30.388723 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5216559f-7f95-4c63-bc66-c09877c35067 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:30.397718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5216559f-7f95-4c63-bc66-c09877c35067 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:30.398774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5216559f-7f95-4c63-bc66-c09877c35067 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:30.399587 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5216559f-7f95-4c63-bc66-c09877c35067 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:30.400397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5216559f-7f95-4c63-bc66-c09877c35067 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:30.429917 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5216559f-7f95-4c63-bc66-c09877c35067 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/5671069f-7996-403a-a290-2a952d35d16b" status: 200 len: 194 microversion: 2.1 time: 0.046506 Mar 08 04:53:30.430515 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1502/3059] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Mar 8 04:53:30 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/5671069f-7996-403a-a290-2a952d35d16b => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:30.441801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8c026a38-9d58-4c3a-a8e7-e0db7831d32a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:30.442394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8c026a38-9d58-4c3a-a8e7-e0db7831d32a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:30.449612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c026a38-9d58-4c3a-a8e7-e0db7831d32a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:30.450428 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c026a38-9d58-4c3a-a8e7-e0db7831d32a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:30.451245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c026a38-9d58-4c3a-a8e7-e0db7831d32a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:30.451687 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8c026a38-9d58-4c3a-a8e7-e0db7831d32a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:30.539284 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-8c026a38-9d58-4c3a-a8e7-e0db7831d32a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lazy-loading 'services' on Instance uuid adb2c3ec-cdda-41fd-ae30-d3d636d41896 {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:53:30.614165 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8c026a38-9d58-4c3a-a8e7-e0db7831d32a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/5671069f-7996-403a-a290-2a952d35d16b" status: 202 len: 0 microversion: 2.1 time: 0.176749 Mar 08 04:53:30.614674 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1558/3060] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:53:30 2022] DELETE /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/5671069f-7996-403a-a290-2a952d35d16b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:53:31.752946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-22536032-2375-4c35-b050-e8043d18b12a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:31.753480 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-22536032-2375-4c35-b050-e8043d18b12a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:31.759822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22536032-2375-4c35-b050-e8043d18b12a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:31.760282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22536032-2375-4c35-b050-e8043d18b12a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:31.761054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22536032-2375-4c35-b050-e8043d18b12a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:31.762028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22536032-2375-4c35-b050-e8043d18b12a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:31.790914 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-22536032-2375-4c35-b050-e8043d18b12a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/51f3866d-f37c-4274-bc7d-83bf60b80b67" status: 200 len: 194 microversion: 2.1 time: 0.041967 Mar 08 04:53:31.791486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1503/3061] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Mar 8 04:53:31 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/51f3866d-f37c-4274-bc7d-83bf60b80b67 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:53:31.802775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-00fd9f0f-3b02-4081-8841-c98f2a722530 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:31.803359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-00fd9f0f-3b02-4081-8841-c98f2a722530 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:31.810593 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00fd9f0f-3b02-4081-8841-c98f2a722530 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:31.811041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00fd9f0f-3b02-4081-8841-c98f2a722530 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:31.811830 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00fd9f0f-3b02-4081-8841-c98f2a722530 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:31.812266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-00fd9f0f-3b02-4081-8841-c98f2a722530 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:31.889850 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-00fd9f0f-3b02-4081-8841-c98f2a722530 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lazy-loading 'services' on Instance uuid adb2c3ec-cdda-41fd-ae30-d3d636d41896 {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:53:31.964282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-00fd9f0f-3b02-4081-8841-c98f2a722530 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/51f3866d-f37c-4274-bc7d-83bf60b80b67" status: 202 len: 0 microversion: 2.1 time: 0.166011 Mar 08 04:53:31.966035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1559/3062] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:53:31 2022] DELETE /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments/51f3866d-f37c-4274-bc7d-83bf60b80b67 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:53:33.140124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6672fc3f-5798-4a80-9daf-77ea91bde77c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:33.141323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6672fc3f-5798-4a80-9daf-77ea91bde77c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:33.148292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6672fc3f-5798-4a80-9daf-77ea91bde77c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:33.148738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6672fc3f-5798-4a80-9daf-77ea91bde77c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:33.149526 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6672fc3f-5798-4a80-9daf-77ea91bde77c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:33.150006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6672fc3f-5798-4a80-9daf-77ea91bde77c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:33.180719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6672fc3f-5798-4a80-9daf-77ea91bde77c tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046882 Mar 08 04:53:33.181278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1504/3063] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:53:33 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 08 04:53:33.284635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c8529896-eef9-4125-92ab-2cab6a6d7f6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:33.285635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c8529896-eef9-4125-92ab-2cab6a6d7f6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:33.293312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c8529896-eef9-4125-92ab-2cab6a6d7f6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:33.293801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c8529896-eef9-4125-92ab-2cab6a6d7f6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:33.294583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c8529896-eef9-4125-92ab-2cab6a6d7f6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:33.295033 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c8529896-eef9-4125-92ab-2cab6a6d7f6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:33.324086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c8529896-eef9-4125-92ab-2cab6a6d7f6d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043772 Mar 08 04:53:33.324637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1560/3064] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:53:33 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 04:53:33.379615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d4a7dbbe-db0d-4116-8695-23f325fbdaed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:33.380107 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d4a7dbbe-db0d-4116-8695-23f325fbdaed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:33.385854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4a7dbbe-db0d-4116-8695-23f325fbdaed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:33.386456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4a7dbbe-db0d-4116-8695-23f325fbdaed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:33.387293 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4a7dbbe-db0d-4116-8695-23f325fbdaed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:33.387724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4a7dbbe-db0d-4116-8695-23f325fbdaed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:33.411283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d4a7dbbe-db0d-4116-8695-23f325fbdaed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:53:33.482814 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d4a7dbbe-db0d-4116-8695-23f325fbdaed tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 204 len: 0 microversion: 2.1 time: 0.106651 Mar 08 04:53:33.483435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1505/3065] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:53:33 2022] DELETE /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:53:33.491696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1b88493a-942b-4184-b9db-f5703ac4e37d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:33.492400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1b88493a-942b-4184-b9db-f5703ac4e37d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:33.498198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b88493a-942b-4184-b9db-f5703ac4e37d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:33.498643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b88493a-942b-4184-b9db-f5703ac4e37d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:33.499417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b88493a-942b-4184-b9db-f5703ac4e37d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:33.499879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1b88493a-942b-4184-b9db-f5703ac4e37d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:33.632516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1b88493a-942b-4184-b9db-f5703ac4e37d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:33.640583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1b88493a-942b-4184-b9db-f5703ac4e37d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1674 microversion: 2.1 time: 0.152508 Mar 08 04:53:33.641141 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1561/3066] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:33 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:34.659334 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2bfef3c3-f931-4a41-87df-b88b46bc199a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:34.660038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2bfef3c3-f931-4a41-87df-b88b46bc199a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:34.666345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2bfef3c3-f931-4a41-87df-b88b46bc199a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:34.666801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2bfef3c3-f931-4a41-87df-b88b46bc199a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:34.667705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2bfef3c3-f931-4a41-87df-b88b46bc199a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:34.668461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2bfef3c3-f931-4a41-87df-b88b46bc199a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:34.802650 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2bfef3c3-f931-4a41-87df-b88b46bc199a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:34.809901 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2bfef3c3-f931-4a41-87df-b88b46bc199a tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1674 microversion: 2.1 time: 0.154784 Mar 08 04:53:34.810467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1506/3067] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:34 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:35.481394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-1f489e9c-6e95-4d7b-a0f3-65e2b76c64de req-37059ed0-2b70-4ae0-bcf8-a94b427d102c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb2c3ec-cdda-41fd-ae30-d3d636d41896", "name": "network-vif-deleted", "tag": "13ceff6e-d742-42c3-8580-fb70f3cd48ee"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:53:35.492032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-1f489e9c-6e95-4d7b-a0f3-65e2b76c64de req-37059ed0-2b70-4ae0-bcf8-a94b427d102c service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:35.492803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-1f489e9c-6e95-4d7b-a0f3-65e2b76c64de req-37059ed0-2b70-4ae0-bcf8-a94b427d102c service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:35.506951 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-1f489e9c-6e95-4d7b-a0f3-65e2b76c64de req-37059ed0-2b70-4ae0-bcf8-a94b427d102c service nova] Creating event network-vif-deleted:13ceff6e-d742-42c3-8580-fb70f3cd48ee for instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 on hv-cinder-73306 Mar 08 04:53:35.512831 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-1f489e9c-6e95-4d7b-a0f3-65e2b76c64de req-37059ed0-2b70-4ae0-bcf8-a94b427d102c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035628 Mar 08 04:53:35.513409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1562/3068] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:35.828159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:35.828979 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:35.834871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:35.835441 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:35.836420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:35.836871 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:35.869465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:35.869947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:35.870924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lazy-loading 'fault' on Instance uuid adb2c3ec-cdda-41fd-ae30-d3d636d41896 {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:53:35.913003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3686d5d0c5e43a29d52b8b39bbae64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f34ab0c91a4b3e9ccf9a201daab904', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:53:35.921056 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2116cf1c-e650-4d6b-872d-893eaedf8900 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 200 len: 1328 microversion: 2.1 time: 0.097988 Mar 08 04:53:35.921718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1507/3069] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:35 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:36.939249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1f66dd06-718c-42ec-b90b-59f09d1f97c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:36.939960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1f66dd06-718c-42ec-b90b-59f09d1f97c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:36.946437 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f66dd06-718c-42ec-b90b-59f09d1f97c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:36.946884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f66dd06-718c-42ec-b90b-59f09d1f97c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:36.947640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f66dd06-718c-42ec-b90b-59f09d1f97c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:36.948074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1f66dd06-718c-42ec-b90b-59f09d1f97c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:36.961013 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-1f66dd06-718c-42ec-b90b-59f09d1f97c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] HTTP exception thrown: Instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 could not be found. Mar 08 04:53:36.961583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1f66dd06-718c-42ec-b90b-59f09d1f97c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Returning 404 to user: Instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:53:36.962407 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1f66dd06-718c-42ec-b90b-59f09d1f97c4 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 404 len: 111 microversion: 2.1 time: 0.027380 Mar 08 04:53:36.962911 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1563/3070] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:36 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 04:53:36.971627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-691d6340-d4fd-448b-8eac-71de32b8250d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '.version_select at 0x7fe836fff550>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:36.988835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-691d6340-d4fd-448b-8eac-71de32b8250d tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1711824141" status: 202 len: 0 microversion: 2.1 time: 0.021002 Mar 08 04:53:36.989388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1508/3071] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Mar 8 04:53:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1711824141 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:53:39.830133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7101e003-3e93-49b3-a2bb-1adfa763dc40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:39.830654 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7101e003-3e93-49b3-a2bb-1adfa763dc40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:39.836735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7101e003-3e93-49b3-a2bb-1adfa763dc40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:39.837180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7101e003-3e93-49b3-a2bb-1adfa763dc40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:39.838045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7101e003-3e93-49b3-a2bb-1adfa763dc40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:39.838483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7101e003-3e93-49b3-a2bb-1adfa763dc40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:39.851937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-7101e003-3e93-49b3-a2bb-1adfa763dc40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] HTTP exception thrown: Instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 could not be found. Mar 08 04:53:39.852511 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7101e003-3e93-49b3-a2bb-1adfa763dc40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Returning 404 to user: Instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:53:39.853314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7101e003-3e93-49b3-a2bb-1adfa763dc40 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 404 len: 111 microversion: 2.1 time: 0.027041 Mar 08 04:53:39.853855 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1564/3072] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:53:39 2022] DELETE /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:53:39.862935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9c34bdb1-a774-4cc0-978c-f1eb3dcbde6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:39.863540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9c34bdb1-a774-4cc0-978c-f1eb3dcbde6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: adb2c3ec-cdda-41fd-ae30-d3d636d41896] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:39.870183 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c34bdb1-a774-4cc0-978c-f1eb3dcbde6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:39.871268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c34bdb1-a774-4cc0-978c-f1eb3dcbde6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:39.872123 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c34bdb1-a774-4cc0-978c-f1eb3dcbde6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:39.872592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9c34bdb1-a774-4cc0-978c-f1eb3dcbde6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:39.884961 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-9c34bdb1-a774-4cc0-978c-f1eb3dcbde6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] HTTP exception thrown: Instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 could not be found. Mar 08 04:53:39.885566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9c34bdb1-a774-4cc0-978c-f1eb3dcbde6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Returning 404 to user: Instance adb2c3ec-cdda-41fd-ae30-d3d636d41896 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:53:39.886551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9c34bdb1-a774-4cc0-978c-f1eb3dcbde6b tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896" status: 404 len: 111 microversion: 2.1 time: 0.027888 Mar 08 04:53:39.887066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1509/3073] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:39 2022] GET /compute/v2.1/servers/adb2c3ec-cdda-41fd-ae30-d3d636d41896 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:53:41.013479 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d44819e8-220a-46dc-b604-f85a4c2de9d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:41.014035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d44819e8-220a-46dc-b604-f85a4c2de9d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:41.020489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d44819e8-220a-46dc-b604-f85a4c2de9d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:41.020942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d44819e8-220a-46dc-b604-f85a4c2de9d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:41.021736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d44819e8-220a-46dc-b604-f85a4c2de9d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:41.022178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d44819e8-220a-46dc-b604-f85a4c2de9d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:41.035686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-d44819e8-220a-46dc-b604-f85a4c2de9d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] HTTP exception thrown: Instance 94db79bc-24f2-47d5-9d3b-f0a2c9da754f could not be found. Mar 08 04:53:41.036263 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d44819e8-220a-46dc-b604-f85a4c2de9d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Returning 404 to user: Instance 94db79bc-24f2-47d5-9d3b-f0a2c9da754f could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:53:41.037083 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d44819e8-220a-46dc-b604-f85a4c2de9d1 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 404 len: 111 microversion: 2.1 time: 0.027754 Mar 08 04:53:41.037588 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1565/3074] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:53:41 2022] DELETE /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:53:41.046224 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c3b83192-c4dc-4dca-8e4c-3ec24ae58973 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:41.046841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c3b83192-c4dc-4dca-8e4c-3ec24ae58973 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] [instance: 94db79bc-24f2-47d5-9d3b-f0a2c9da754f] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:53:41.053029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3b83192-c4dc-4dca-8e4c-3ec24ae58973 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:41.053484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3b83192-c4dc-4dca-8e4c-3ec24ae58973 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:41.054284 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3b83192-c4dc-4dca-8e4c-3ec24ae58973 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:53:41.054725 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3b83192-c4dc-4dca-8e4c-3ec24ae58973 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:53:41.067629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-c3b83192-c4dc-4dca-8e4c-3ec24ae58973 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] HTTP exception thrown: Instance 94db79bc-24f2-47d5-9d3b-f0a2c9da754f could not be found. Mar 08 04:53:41.068242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c3b83192-c4dc-4dca-8e4c-3ec24ae58973 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] Returning 404 to user: Instance 94db79bc-24f2-47d5-9d3b-f0a2c9da754f could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:53:41.069045 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c3b83192-c4dc-4dca-8e4c-3ec24ae58973 tempest-AttachVolumeTestJSON-1734819536 tempest-AttachVolumeTestJSON-1734819536-project] 10.222.0.30 "GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f" status: 404 len: 111 microversion: 2.1 time: 0.027565 Mar 08 04:53:41.069555 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1510/3075] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:53:41 2022] GET /compute/v2.1/servers/94db79bc-24f2-47d5-9d3b-f0a2c9da754f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:53:46.549151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e46a3f1c-75d5-4d6c-b20f-da5f645319bd tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe8325e4790>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:46.595913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e46a3f1c-75d5-4d6c-b20f-da5f645319bd tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f1f93d1f-0001-4f28-863d-9ea93d0a5b16" status: 200 len: 350 microversion: 2.1 time: 0.050573 Mar 08 04:53:46.596462 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1566/3076] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:53:46 2022] GET /compute/v2.1/os-volumes/f1f93d1f-0001-4f28-863d-9ea93d0a5b16 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:47.898878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-71218cf0-10cd-460e-b9e4-435b9ae09985 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe8370759d0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:47.944223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-71218cf0-10cd-460e-b9e4-435b9ae09985 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/07f25f6a-b76d-415e-a02e-5f297e019045" status: 200 len: 350 microversion: 2.1 time: 0.049080 Mar 08 04:53:47.944878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1511/3077] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:53:47 2022] GET /compute/v2.1/os-volumes/07f25f6a-b76d-415e-a02e-5f297e019045 => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:49.242637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c0e9d6a9-73ed-4c8d-9728-577c44ac9eff tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe8370ce5e0>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:49.290104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c0e9d6a9-73ed-4c8d-9728-577c44ac9eff tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/94950da5-f91b-4c80-acba-301eae6d416b" status: 200 len: 351 microversion: 2.1 time: 0.051524 Mar 08 04:53:49.290662 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1567/3078] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 04:53:49 2022] GET /compute/v2.1/os-volumes/94950da5-f91b-4c80-acba-301eae6d416b => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:49.302718 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-919b69e9-bd71-47a0-8c60-a2a9b6d89422 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe837039e50>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:49.381476 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-919b69e9-bd71-47a0-8c60-a2a9b6d89422 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082845 Mar 08 04:53:49.382069 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1512/3079] 10.222.0.30 () {58 vars in 1133 bytes} [Tue Mar 8 04:53:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:49.393888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ef71eef1-8fa3-4000-aad2-0f3066048743 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe8325e4a60>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:49.471801 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ef71eef1-8fa3-4000-aad2-0f3066048743 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081861 Mar 08 04:53:49.472357 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1568/3080] 10.222.0.30 () {58 vars in 1148 bytes} [Tue Mar 8 04:53:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:49.484168 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-56fad69a-cdb2-49d4-85ea-4e0daa124fdf tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe837159ee0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:49.562144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-56fad69a-cdb2-49d4-85ea-4e0daa124fdf tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082210 Mar 08 04:53:49.562704 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1513/3081] 10.222.0.30 () {58 vars in 1133 bytes} [Tue Mar 8 04:53:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:49.573456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1249e0eb-0f1d-4327-a3d5-88d5d4f25ba4 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe8324ae310>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:49.654866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1249e0eb-0f1d-4327-a3d5-88d5d4f25ba4 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085089 Mar 08 04:53:49.655427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1569/3082] 10.222.0.30 () {58 vars in 1166 bytes} [Tue Mar 8 04:53:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:49.666656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4c4e889d-591e-45d7-a6db-112736710a96 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe837075040>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:49.743401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4c4e889d-591e-45d7-a6db-112736710a96 tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.080398 Mar 08 04:53:49.743991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1514/3083] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Mar 8 04:53:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:49.758213 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f535eff0-06cb-4fbc-8a5d-aece02aaae0c tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe8370ce790>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:49.840186 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f535eff0-06cb-4fbc-8a5d-aece02aaae0c tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085042 Mar 08 04:53:49.840754 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1570/3084] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Mar 8 04:53:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:49.851540 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7adb59b5-b83d-4f96-92d2-842127ab41cd tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe8370ac790>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:49.932169 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7adb59b5-b83d-4f96-92d2-842127ab41cd tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084318 Mar 08 04:53:49.932730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1515/3085] 10.222.0.30 () {58 vars in 1187 bytes} [Tue Mar 8 04:53:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:53:49.944101 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-63c7cb37-af2b-4983-b0d5-107493a5d5ad tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] Calling method '.version_select at 0x7fe8370ce820>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:53:50.021944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-63c7cb37-af2b-4983-b0d5-107493a5d5ad tempest-VolumesTestJSON-1587807273 tempest-VolumesTestJSON-1587807273-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.081476 Mar 08 04:53:50.022512 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1571/3086] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Mar 8 04:53:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:53:59.994008 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:53:59.994604 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:53:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:54:06.599070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5f26690a-221c-48df-9165-8b05beafe3b7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:06.599605 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5f26690a-221c-48df-9165-8b05beafe3b7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:06.605551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f26690a-221c-48df-9165-8b05beafe3b7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:06.606048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f26690a-221c-48df-9165-8b05beafe3b7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:06.606801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f26690a-221c-48df-9165-8b05beafe3b7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:06.607229 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f26690a-221c-48df-9165-8b05beafe3b7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:06.629231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5f26690a-221c-48df-9165-8b05beafe3b7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/ips" status: 200 len: 152 microversion: 2.20 time: 0.034522 Mar 08 04:54:06.629972 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1516/3087] 10.222.0.30 () {60 vars in 1288 bytes} [Tue Mar 8 04:54:06 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:54:08.727379 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3f058df0-f4d5-4804-87cb-1e000b444519 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:54:08.727919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3f058df0-f4d5-4804-87cb-1e000b444519 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:08.734803 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f058df0-f4d5-4804-87cb-1e000b444519 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:08.735255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f058df0-f4d5-4804-87cb-1e000b444519 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:08.736022 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f058df0-f4d5-4804-87cb-1e000b444519 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:08.736454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3f058df0-f4d5-4804-87cb-1e000b444519 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:08.757095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-3f058df0-f4d5-4804-87cb-1e000b444519 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lazy-loading 'flavor' on Instance uuid d893a718-bf02-4bf4-a648-27ae785dbfdb {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:54:09.012802 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3f058df0-f4d5-4804-87cb-1e000b444519 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/action" status: 202 len: 0 microversion: 2.20 time: 0.289606 Mar 08 04:54:09.016881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1572/3088] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Mar 8 04:54:08 2022] POST /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:54:09.023076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:09.023621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:09.031958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:09.032483 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:09.033365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:09.033912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:09.363073 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:09.371182 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:09.372675 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:09.373839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5e01a7f8-cf0f-48c4-ac60-7d4e03b69267 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.355131 Mar 08 04:54:09.374386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1517/3089] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:09 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:10.394044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:10.394747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:10.400931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:10.401390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:10.402672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:10.403111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:10.594734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:10.602411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:10.603900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:10.605203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-cdc6a715-91da-4781-a7f3-a6264a078ab4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.216085 Mar 08 04:54:10.605793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1573/3090] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:10 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:11.624203 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:11.624774 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:11.631115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:11.631568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:11.632344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:11.632777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:11.763247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:11.771072 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:11.772563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:11.773724 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2ebab8b0-a8e8-4825-8ad7-9a69a964dd20 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.154279 Mar 08 04:54:11.774271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1518/3091] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:11 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:12.791725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:12.792545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:12.798748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:12.799191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:12.799950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:12.800380 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:12.932362 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:12.940023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:12.941507 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:12.942671 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0bbdd58b-912d-47eb-b711-58929fb8b777 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.154847 Mar 08 04:54:12.943221 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1574/3092] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:12 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:13.960830 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:13.961438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:13.968240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:13.968689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:13.969453 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:13.969931 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:14.101308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:14.109611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:14.111208 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:14.112348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-356cd115-434e-4736-915c-f924266c65d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.155356 Mar 08 04:54:14.112898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1519/3093] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:13 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:15.130326 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:15.130887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:15.137153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:15.137598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:15.138377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:15.138809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:15.267394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:15.275449 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:15.277413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:15.278657 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-07b7c6f3-38a2-4262-b077-6b746dd515f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.152298 Mar 08 04:54:15.279203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1575/3094] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:15 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:16.296818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:16.297399 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:16.303619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:16.304068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:16.304831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:16.305268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:16.439743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:16.447407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:16.449549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:16.450717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-df2b98ec-a5d0-4486-91f7-c87f45b8ba79 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.157860 Mar 08 04:54:16.451268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1520/3095] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:16 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:54:17.469084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:17.469719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:17.475940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:17.476381 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:17.477138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:17.477569 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:17.608523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:17.616051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:17.617555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:17.618717 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bdc3dece-c741-4617-8e4d-62d2f003654a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.154379 Mar 08 04:54:17.619321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1576/3096] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:17 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:18.638700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:18.639324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:18.645854 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:18.646305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:18.647066 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:18.647505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:18.781122 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:18.788879 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:18.790431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:18.791577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c3cac214-b520-4144-bb8c-06ab8c6d8621 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.157761 Mar 08 04:54:18.792695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1521/3097] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:18 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:19.810581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:19.811269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:19.817225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:19.817694 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:19.818467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:19.818896 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:19.948718 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:19.957024 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:19.958540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:19.959667 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e8e73acd-402f-4dd3-be25-eb2a648797be tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1746 microversion: 2.20 time: 0.153693 Mar 08 04:54:19.960210 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1577/3098] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:19 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:20.977787 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:20.978397 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:20.985161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:20.985610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:20.986437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:20.986906 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:21.115126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:21.123610 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:21.125126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:21.126316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5292e969-ecfa-4a67-9810-025c0693dec2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1746 microversion: 2.20 time: 0.152413 Mar 08 04:54:21.126902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1522/3099] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:20 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:22.144810 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:22.145615 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:22.153494 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:22.157216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:22.173251 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:22.173979 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:22.366331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:22.384229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:22.385788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:22.387004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5c532b87-2911-4d38-a364-81eefdd953b9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1741 microversion: 2.20 time: 0.246073 Mar 08 04:54:22.390720 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1578/3100] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:22 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1741 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:54:23.412624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:23.414013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:23.422479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:23.422927 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:23.423702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:23.424137 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:23.655237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:23.670482 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:23.672259 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:23.673751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-484c9f80-50d7-4d5c-9e6d-b64a901487a0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1741 microversion: 2.20 time: 0.269251 Mar 08 04:54:23.685431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1523/3101] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:23 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1741 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:24.693034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:24.693735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:24.701268 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:24.701986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:24.703214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:24.704034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:24.897642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:24.910207 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:24.911728 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:24.912886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e6a36969-ec82-4d4f-ba05-7cf785c7b058 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1741 microversion: 2.20 time: 0.224135 Mar 08 04:54:24.913457 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1579/3102] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:24 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:25.734144 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-897b1415-4b98-4310-b602-7b129b555bb1 req-200c518a-f3f1-4565-bb82-5f22b16923b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893a718-bf02-4bf4-a648-27ae785dbfdb", "name": "network-vif-plugged", "status": "completed", "tag": "c0a86271-cf56-4114-916f-e0a180245907"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:54:25.750745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-897b1415-4b98-4310-b602-7b129b555bb1 req-200c518a-f3f1-4565-bb82-5f22b16923b2 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:25.752646 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-897b1415-4b98-4310-b602-7b129b555bb1 req-200c518a-f3f1-4565-bb82-5f22b16923b2 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:25.770166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-897b1415-4b98-4310-b602-7b129b555bb1 req-200c518a-f3f1-4565-bb82-5f22b16923b2 service nova] Creating event network-vif-plugged:c0a86271-cf56-4114-916f-e0a180245907 for instance d893a718-bf02-4bf4-a648-27ae785dbfdb on hv-cinder-73306 Mar 08 04:54:25.778521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-897b1415-4b98-4310-b602-7b129b555bb1 req-200c518a-f3f1-4565-bb82-5f22b16923b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048687 Mar 08 04:54:25.779161 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1524/3103] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:54:25.938084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:25.939468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:25.947238 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:25.948121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:25.949098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:25.950401 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:26.143840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:26.153426 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:26.156442 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:26.157624 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9e72ddae-c263-4353-afeb-d92127e9963f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1741 microversion: 2.20 time: 0.224565 Mar 08 04:54:26.158205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1580/3104] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:25 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:54:27.179153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:27.179887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:27.186847 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:27.187524 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:27.188582 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:27.189296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:27.366793 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:27.375332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:27.377332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:27.378655 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-bf2c8cb9-ef5a-4256-9f1b-858bfd5ac7f0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1741 microversion: 2.20 time: 0.204229 Mar 08 04:54:27.379209 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1525/3105] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:27 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:28.403313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:28.405146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:28.413147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:28.423982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:28.425111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:28.425748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:28.604953 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:28.617500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:28.620056 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:28.621522 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3d9c5f37-2c80-4b7c-940a-5360bafd7ebc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1741 microversion: 2.20 time: 0.222760 Mar 08 04:54:28.622582 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1581/3106] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:28 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:29.644141 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:29.644789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:29.657071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:29.657531 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:29.658563 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:29.659134 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:29.875512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:29.888528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:29.890663 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:29.892054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-adcefc9a-9467-4ec4-a572-b1a2e80ea788 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1741 microversion: 2.20 time: 0.254572 Mar 08 04:54:29.892604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1526/3107] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:29 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:30.919019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:30.919701 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:30.926708 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:30.927121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:30.928409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:30.928409 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:31.098356 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:31.107398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:31.108962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:31.110247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-538f9d23-063c-4aa0-b96c-826c44e7d3ea tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1741 microversion: 2.20 time: 0.196209 Mar 08 04:54:31.124151 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1582/3108] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:30 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:32.129192 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:32.129945 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:32.136215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:32.137336 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:32.138128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:32.138566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:32.280316 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:32.294330 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:32.297267 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:32.299440 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-cf12ad46-88e9-453f-a00d-8c86001d6148 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1723 microversion: 2.20 time: 0.174052 Mar 08 04:54:32.300469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1527/3109] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:32 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:33.327926 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:33.328536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:33.335421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:33.335878 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:33.336656 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:33.337179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:33.473645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:33.482179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:33.483784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:33.484822 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2a1c327c-9a6e-496a-bfc9-dd4dce5ebd2c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1723 microversion: 2.20 time: 0.163067 Mar 08 04:54:33.485765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1583/3110] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:33 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:34.503083 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:34.503676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:34.509898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:34.510344 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:34.511095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:34.511545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:34.666822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:34.675231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:34.676742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:34.677940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fa2247c7-98b6-46be-bea1-ad15547a2438 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1723 microversion: 2.20 time: 0.178668 Mar 08 04:54:34.678493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1528/3111] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:34 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:35.698867 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:35.699599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:35.705642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:35.706113 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:35.706865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:35.707296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:35.841905 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:35.849768 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:35.851286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:35.852452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1dc66227-cd8a-4b36-8236-921a6c7b294a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1666 microversion: 2.20 time: 0.157475 Mar 08 04:54:35.852992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1584/3112] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:35 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:35.871030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a5066b3f-ce8a-4171-b80f-ae7d7e9b07e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a54feb34-4885-4041-aa47-e41bf6b04e13"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:54:35.872185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a5066b3f-ce8a-4171-b80f-ae7d7e9b07e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:35.878126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5066b3f-ce8a-4171-b80f-ae7d7e9b07e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:35.878572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5066b3f-ce8a-4171-b80f-ae7d7e9b07e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:35.879324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5066b3f-ce8a-4171-b80f-ae7d7e9b07e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:35.879779 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a5066b3f-ce8a-4171-b80f-ae7d7e9b07e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:36.160875 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a5066b3f-ce8a-4171-b80f-ae7d7e9b07e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294084 Mar 08 04:54:36.161493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1529/3113] 10.222.0.30 () {62 vars in 1363 bytes} [Tue Mar 8 04:54:35 2022] POST /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments => generated 188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:54:36.279448 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-3b3b6d41-11f8-437c-82a2-e4c02eaf04e4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:54:36.280290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-3b3b6d41-11f8-437c-82a2-e4c02eaf04e4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:36.286420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b3b6d41-11f8-437c-82a2-e4c02eaf04e4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:36.286871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b3b6d41-11f8-437c-82a2-e4c02eaf04e4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:36.287644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b3b6d41-11f8-437c-82a2-e4c02eaf04e4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:36.288081 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-3b3b6d41-11f8-437c-82a2-e4c02eaf04e4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:36.485215 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-3b3b6d41-11f8-437c-82a2-e4c02eaf04e4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/action" status: 202 len: 0 microversion: 2.20 time: 0.209810 Mar 08 04:54:36.486032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1585/3114] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Mar 8 04:54:36 2022] POST /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:54:36.496051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:36.498371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:36.504963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:36.505409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:36.506218 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:36.506663 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:36.656146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:36.668755 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:36.670427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:36.678104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-557233ad-1a3e-45a7-94b8-6be7be47bfa5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1752 microversion: 2.20 time: 0.181457 Mar 08 04:54:36.678104 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1530/3115] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:36 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:37.640752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-c8542ea3-c1dd-47dc-bdba-fe003e0ceb87 req-ff691a53-ed4d-42d3-83ee-cb634c1a61e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893a718-bf02-4bf4-a648-27ae785dbfdb", "name": "network-vif-unplugged", "status": "completed", "tag": "c0a86271-cf56-4114-916f-e0a180245907"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:54:37.652220 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-c8542ea3-c1dd-47dc-bdba-fe003e0ceb87 req-ff691a53-ed4d-42d3-83ee-cb634c1a61e7 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:37.653227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-c8542ea3-c1dd-47dc-bdba-fe003e0ceb87 req-ff691a53-ed4d-42d3-83ee-cb634c1a61e7 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:37.664530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.compute.server_external_events [req-c8542ea3-c1dd-47dc-bdba-fe003e0ceb87 req-ff691a53-ed4d-42d3-83ee-cb634c1a61e7 service nova] Unable to find a host for instance d893a718-bf02-4bf4-a648-27ae785dbfdb. Dropping event network-vif-unplugged {{(pid=116774) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 08 04:54:37.665475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-c8542ea3-c1dd-47dc-bdba-fe003e0ceb87 req-ff691a53-ed4d-42d3-83ee-cb634c1a61e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029865 Mar 08 04:54:37.666074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1586/3116] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 08 04:54:37.694048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:37.694898 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:37.702044 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:37.702568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:37.703431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:37.703956 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:37.841866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:37.850581 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:37.852132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:37.853296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a648c588-0510-408d-aeae-a4848354470a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1754 microversion: 2.20 time: 0.164526 Mar 08 04:54:37.853889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1531/3117] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:37 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:38.872571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:38.873273 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:38.879597 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:38.880129 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:38.880961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:38.881466 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:39.018811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:39.027112 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:39.029285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:39.030477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ba012e23-a8b2-44a5-a29d-00c634876cd4 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.161956 Mar 08 04:54:39.031044 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1587/3118] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:38 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:40.049983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:40.050717 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:40.057619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:40.058271 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:40.061815 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:40.062279 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:40.205374 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:40.215365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:40.216855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:40.218291 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-79d5a2ca-adf4-4602-9c86-d35ceccb27e0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.172225 Mar 08 04:54:40.229222 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1532/3119] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:40 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:41.237341 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:41.238049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:41.244271 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:41.244727 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:41.245500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:41.246005 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:41.398602 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:41.407088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:41.408591 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:41.409767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-da76d85e-7705-4a6a-b9d3-5f19669f81ed tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.176519 Mar 08 04:54:41.410314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1588/3120] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:41 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:42.428261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:42.429011 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:42.435532 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:42.435976 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:42.436743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:42.437172 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:42.586632 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:42.596170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:42.597638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:42.601067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2ad1b94c-1b3f-4a7c-b801-3f95a660048e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.176499 Mar 08 04:54:42.610302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1533/3121] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:42 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:43.623944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:43.624738 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:43.631035 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:43.631427 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:43.632214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:43.632657 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:43.778039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:43.786798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:43.788312 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:43.789469 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-8a17da55-f008-4d89-8eee-e16ca3f9a24d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.170533 Mar 08 04:54:43.797704 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1589/3122] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:43 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:44.808613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:44.809357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:44.815823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:44.816275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:44.817049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:44.817484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:45.209121 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:45.217934 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:45.219702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:45.221171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d5d7edd9-9cd0-4841-94d0-69c6c1525fa3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.416770 Mar 08 04:54:45.222300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1534/3123] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:44 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:46.239530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:46.240249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:46.247285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:46.247735 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:46.248536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:46.248995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:46.401497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:46.411447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:46.412950 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:46.414365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ae32a154-cdc9-4d56-aec9-cc25f48e67b8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.178986 Mar 08 04:54:46.415088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1590/3124] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:46 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:47.432362 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:47.432988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:47.439780 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:47.440225 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:47.440977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:47.441410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:47.571980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:47.580428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:47.581882 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:47.583028 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3f8668e4-e42d-417a-a605-fae5e9acde76 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.154609 Mar 08 04:54:47.583572 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1535/3125] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:47 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:54:48.600680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:48.601398 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:48.607981 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:48.608429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:48.609198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:48.609635 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:48.739455 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:48.747796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:48.749332 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:48.750498 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-040bd402-0c09-40d5-ada8-0fb9815865e3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.153867 Mar 08 04:54:48.751045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1591/3126] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:48 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:49.768887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:49.769958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:49.775674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:49.776114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:49.776866 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:49.777966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:49.915220 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:49.923387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:49.924887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:49.926114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-6679ff7e-aca5-40c8-805a-804ad189da37 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.161131 Mar 08 04:54:49.926667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1536/3127] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:49 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:50.945117 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:50.945756 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:50.952691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:50.953136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:50.953957 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:50.954394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:51.087493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:51.096203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:51.097725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:51.098869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a17bb9d0-3b83-4db8-a493-417eb36b0dc9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.157676 Mar 08 04:54:51.099417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1592/3128] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:50 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:52.119392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:52.119981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:52.126442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:52.126884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:52.127633 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:52.128061 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:52.260836 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:52.269221 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:52.270736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:52.271872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-138e7723-1b11-44f9-a0cb-40cc3c0561fd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.158005 Mar 08 04:54:52.272426 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1537/3129] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:52 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:53.290311 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:53.291187 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:53.297617 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:53.298104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:53.298866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:53.299301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:53.441790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:53.452453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:53.453978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:53.455152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1ba9fdce-3ba1-4339-af66-1b5e41d1a7c8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.168740 Mar 08 04:54:53.455709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1593/3130] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:53 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:54.472801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:54.473403 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:54.479678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:54.480150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:54.480902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:54.481335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:54.614681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:54.622928 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:54.624473 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:54.625622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0ece6dbb-2c13-48f0-ac19-4fff94933ffc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.156677 Mar 08 04:54:54.626205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1538/3131] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:54 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:55.643080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:55.643675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:55.649940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:55.650395 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:55.651144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:55.651573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:55.785525 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:55.794233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:55.795772 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:55.796920 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-122a1ef9-b07c-4867-a449-3a11fa595e1d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.157975 Mar 08 04:54:55.797480 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1594/3132] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:55 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:56.814963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:56.815513 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:56.821826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:56.822278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:56.823051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:56.823518 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:56.953490 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:56.961686 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:56.963196 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:56.965025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-36b7b0bd-afb7-4d98-94b1-92eaa191752a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.153441 Mar 08 04:54:56.965537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1539/3133] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:56 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:57.983369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:57.983968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:57.990181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:57.990629 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:57.991384 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:57.991816 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:58.128333 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:58.136418 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:58.138116 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:58.139532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a74a91ea-5ccd-4c37-ae21-79a117ac1503 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.160375 Mar 08 04:54:58.140087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1595/3134] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:57 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:54:59.156761 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:54:59.157361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:54:59.163573 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:59.164015 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:59.164828 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:54:59.165265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:54:59.296263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:59.304338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:59.306021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:54:59.307363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-61332cb8-f0cb-4970-ab06-fbad65ac5649 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.154415 Mar 08 04:54:59.308624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1540/3135] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:54:59 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:00.325228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:00.325784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:00.332552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:00.333001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:00.333798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:00.334237 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:00.465102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:00.473219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:00.474751 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:00.475898 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-afa29abb-fdbc-49ae-889a-8b82a74cdc95 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.154680 Mar 08 04:55:00.476453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1596/3136] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:00 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:01.493422 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:01.493995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:01.500283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:01.500731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:01.501488 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:01.501955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:01.634968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:01.644331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:01.645868 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:01.647175 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4507fec6-31b0-4913-a724-6069c8b6fa08 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.157714 Mar 08 04:55:01.647735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1541/3137] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:01 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:02.665105 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:02.665769 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:02.673164 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:02.673875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:02.674660 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:02.675104 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:02.815849 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:02.824977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:02.826931 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:02.828094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0f804658-3473-4217-ae94-7d6d2de816b5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.166939 Mar 08 04:55:02.828648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1597/3138] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:02 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:55:03.847512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:03.848652 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:03.855731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:03.856722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:03.857264 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:03.857797 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:03.934012 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-0a126d05-ea25-47da-b553-7fa309b21b37 req-024850c3-3d00-49c3-9485-792661103e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893a718-bf02-4bf4-a648-27ae785dbfdb", "name": "network-vif-plugged", "status": "completed", "tag": "c0a86271-cf56-4114-916f-e0a180245907"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:55:03.943696 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-0a126d05-ea25-47da-b553-7fa309b21b37 req-024850c3-3d00-49c3-9485-792661103e3a service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:03.944303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-0a126d05-ea25-47da-b553-7fa309b21b37 req-024850c3-3d00-49c3-9485-792661103e3a service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:03.961500 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-0a126d05-ea25-47da-b553-7fa309b21b37 req-024850c3-3d00-49c3-9485-792661103e3a service nova] Creating event network-vif-plugged:c0a86271-cf56-4114-916f-e0a180245907 for instance d893a718-bf02-4bf4-a648-27ae785dbfdb on hv-cinder-73306 Mar 08 04:55:03.967282 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-0a126d05-ea25-47da-b553-7fa309b21b37 req-024850c3-3d00-49c3-9485-792661103e3a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038228 Mar 08 04:55:03.968766 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1598/3139] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:55:04.010370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:04.020088 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:04.022089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:04.023253 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c8413948-cf4c-4c0b-b39d-4a1ad74653fc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.180389 Mar 08 04:55:04.023880 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1542/3140] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:03 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:05.042174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:05.042790 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:05.049134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:05.049584 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:05.050368 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:05.050807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:05.186285 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:05.194421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:05.195907 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:05.197169 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-59fe2586-f491-4cab-a0e0-86e7a6ab4556 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.159402 Mar 08 04:55:05.197746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1599/3141] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:05 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:06.215904 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:06.216752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:06.222736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:06.223177 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:06.223935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:06.224365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:06.356585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:06.364791 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:06.366320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:06.367456 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c7782b5b-ca5a-4cfb-9a6a-6cc042cf7d6c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1810 microversion: 2.20 time: 0.156374 Mar 08 04:55:06.368003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1543/3142] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:06 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:07.386256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:07.387446 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:07.394149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:07.394669 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:07.395433 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:07.395869 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:07.570509 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:07.579445 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:07.580983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:07.582160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-77490286-9a62-494f-a13e-3cd6c752799b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1797 microversion: 2.20 time: 0.199942 Mar 08 04:55:07.582716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1600/3143] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:07 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1797 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:45.190200 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 04:55:45.190903 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 04:55:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 04:55:45.865294 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-29306373-61ce-43f7-869d-cfa0cb3d28c7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:45.865843 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-29306373-61ce-43f7-869d-cfa0cb3d28c7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:45.871808 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-29306373-61ce-43f7-869d-cfa0cb3d28c7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:45.872252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-29306373-61ce-43f7-869d-cfa0cb3d28c7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:45.873001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-29306373-61ce-43f7-869d-cfa0cb3d28c7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:45.873434 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-29306373-61ce-43f7-869d-cfa0cb3d28c7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:45.903592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-29306373-61ce-43f7-869d-cfa0cb3d28c7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments/a54feb34-4885-4041-aa47-e41bf6b04e13" status: 200 len: 194 microversion: 2.20 time: 0.042325 Mar 08 04:55:45.904159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1544/3144] 10.222.0.30 () {60 vars in 1453 bytes} [Tue Mar 8 04:55:45 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments/a54feb34-4885-4041-aa47-e41bf6b04e13 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:55:45.965856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b62769d3-f0b0-4237-a01b-6019bfc4a9c6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:45.966348 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b62769d3-f0b0-4237-a01b-6019bfc4a9c6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:45.972196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b62769d3-f0b0-4237-a01b-6019bfc4a9c6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:45.972645 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b62769d3-f0b0-4237-a01b-6019bfc4a9c6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:45.973404 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b62769d3-f0b0-4237-a01b-6019bfc4a9c6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:45.973876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b62769d3-f0b0-4237-a01b-6019bfc4a9c6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:46.049651 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-b62769d3-f0b0-4237-a01b-6019bfc4a9c6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lazy-loading 'services' on Instance uuid d893a718-bf02-4bf4-a648-27ae785dbfdb {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:55:46.117937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b62769d3-f0b0-4237-a01b-6019bfc4a9c6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments/a54feb34-4885-4041-aa47-e41bf6b04e13" status: 202 len: 0 microversion: 2.20 time: 0.156068 Mar 08 04:55:46.118573 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1601/3145] 10.222.0.30 () {60 vars in 1456 bytes} [Tue Mar 8 04:55:45 2022] DELETE /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments/a54feb34-4885-4041-aa47-e41bf6b04e13 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:55:46.127689 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a2967ec8-eca5-46c0-88ad-348d325bd972 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:46.128677 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a2967ec8-eca5-46c0-88ad-348d325bd972 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:46.134493 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2967ec8-eca5-46c0-88ad-348d325bd972 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:46.134943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2967ec8-eca5-46c0-88ad-348d325bd972 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:46.135720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2967ec8-eca5-46c0-88ad-348d325bd972 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:46.136159 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a2967ec8-eca5-46c0-88ad-348d325bd972 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:46.165640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a2967ec8-eca5-46c0-88ad-348d325bd972 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042628 Mar 08 04:55:46.166214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1545/3146] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 04:55:46 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:55:47.178897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d7e0c100-b4bc-4985-a50e-2890fa2a2cf1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:47.179937 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d7e0c100-b4bc-4985-a50e-2890fa2a2cf1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:47.186087 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7e0c100-b4bc-4985-a50e-2890fa2a2cf1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:47.186538 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7e0c100-b4bc-4985-a50e-2890fa2a2cf1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:47.187302 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7e0c100-b4bc-4985-a50e-2890fa2a2cf1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:47.187771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d7e0c100-b4bc-4985-a50e-2890fa2a2cf1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:47.215468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d7e0c100-b4bc-4985-a50e-2890fa2a2cf1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041548 Mar 08 04:55:47.216023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1602/3147] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 04:55:47 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:55:47.272638 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4dcf1229-2768-4f35-965c-feb7be37477e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:47.273187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4dcf1229-2768-4f35-965c-feb7be37477e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:47.284126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4dcf1229-2768-4f35-965c-feb7be37477e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:47.284564 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4dcf1229-2768-4f35-965c-feb7be37477e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:47.285313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4dcf1229-2768-4f35-965c-feb7be37477e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:47.285776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4dcf1229-2768-4f35-965c-feb7be37477e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:47.310312 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4dcf1229-2768-4f35-965c-feb7be37477e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:55:47.385986 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4dcf1229-2768-4f35-965c-feb7be37477e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 204 len: 0 microversion: 2.20 time: 0.117693 Mar 08 04:55:47.386594 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1546/3148] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 04:55:47 2022] DELETE /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 04:55:47.395327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:47.395918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:47.401929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:47.402377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:47.403138 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:47.403574 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:47.535394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:47.543585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:47.545078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:47.546245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6dcdaa65-1d43-4250-8469-6e1fe13c5a74 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.154963 Mar 08 04:55:47.546791 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1603/3149] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:47 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:48.567163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:48.567858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:48.574057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:48.574505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:48.575265 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:48.575702 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:48.707404 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:48.715110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:48.716617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:48.717803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-62133ec5-7366-4265-85cf-119e3c6a6a09 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1725 microversion: 2.20 time: 0.155194 Mar 08 04:55:48.718367 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1547/3150] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:48 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:49.719403 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-68e8fad6-ac8d-4130-8185-8741d50b32d3 req-a49e5ed5-bf9c-4953-a4f0-108a4db14d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893a718-bf02-4bf4-a648-27ae785dbfdb", "name": "network-vif-deleted", "tag": "c0a86271-cf56-4114-916f-e0a180245907"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:55:49.730547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-68e8fad6-ac8d-4130-8185-8741d50b32d3 req-a49e5ed5-bf9c-4953-a4f0-108a4db14d6c service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:49.731166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-68e8fad6-ac8d-4130-8185-8741d50b32d3 req-a49e5ed5-bf9c-4953-a4f0-108a4db14d6c service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:49.737711 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:49.739127 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:49.745782 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-68e8fad6-ac8d-4130-8185-8741d50b32d3 req-a49e5ed5-bf9c-4953-a4f0-108a4db14d6c service nova] Creating event network-vif-deleted:c0a86271-cf56-4114-916f-e0a180245907 for instance d893a718-bf02-4bf4-a648-27ae785dbfdb on hv-cinder-73306 Mar 08 04:55:49.747627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:49.748289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:49.749349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:49.750022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:49.751390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-68e8fad6-ac8d-4130-8185-8741d50b32d3 req-a49e5ed5-bf9c-4953-a4f0-108a4db14d6c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036839 Mar 08 04:55:49.752250 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1604/3151] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:55:49.830242 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:49.840436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:49.843071 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:49.845307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8e92dbe3-3688-4e8f-96e8-2cff1ecfde2a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 200 len: 1367 microversion: 2.20 time: 0.112384 Mar 08 04:55:49.846048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1548/3152] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:49 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 1367 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:50.865014 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-19aea20a-c3be-475e-a6de-6c5153901123 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:50.865742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-19aea20a-c3be-475e-a6de-6c5153901123 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:50.871834 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19aea20a-c3be-475e-a6de-6c5153901123 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:50.872286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19aea20a-c3be-475e-a6de-6c5153901123 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:50.873054 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19aea20a-c3be-475e-a6de-6c5153901123 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:50.873493 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-19aea20a-c3be-475e-a6de-6c5153901123 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:50.887120 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-19aea20a-c3be-475e-a6de-6c5153901123 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] HTTP exception thrown: Instance d893a718-bf02-4bf4-a648-27ae785dbfdb could not be found. Mar 08 04:55:50.887712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-19aea20a-c3be-475e-a6de-6c5153901123 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Returning 404 to user: Instance d893a718-bf02-4bf4-a648-27ae785dbfdb could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:55:50.888796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-19aea20a-c3be-475e-a6de-6c5153901123 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 404 len: 111 microversion: 2.20 time: 0.029059 Mar 08 04:55:50.889323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1605/3153] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:50 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:55:50.897919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b22fe196-b7cd-43e7-b134-eaf50c6db1e9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '.version_select at 0x7fe832492670>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:50.915276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b22fe196-b7cd-43e7-b134-eaf50c6db1e9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292408308" status: 204 len: 0 microversion: 2.20 time: 0.021161 Mar 08 04:55:50.915822 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1549/3154] 10.222.0.30 () {60 vars in 1261 bytes} [Tue Mar 8 04:55:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292408308 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 04:55:51.516887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-1365f383-c860-42c2-8d99-97874b9fb82c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'create', calling method: .version_select at 0x7fe8325905e0>, body: {"keypair": {"name": "tempest-keypair-1912814052"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:55:51.532497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-1365f383-c860-42c2-8d99-97874b9fb82c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for project 151b2e10af2e44ae84b8846b557c2833. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:55:51.536293 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-1365f383-c860-42c2-8d99-97874b9fb82c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for user bde776f1a50e4d87ad153df6f6f8d315 and project 151b2e10af2e44ae84b8846b557c2833. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:55:51.898156 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-1365f383-c860-42c2-8d99-97874b9fb82c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for project 151b2e10af2e44ae84b8846b557c2833. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:55:51.901870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-1365f383-c860-42c2-8d99-97874b9fb82c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for user bde776f1a50e4d87ad153df6f6f8d315 and project 151b2e10af2e44ae84b8846b557c2833. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:55:51.914686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-1365f383-c860-42c2-8d99-97874b9fb82c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.402461 Mar 08 04:55:51.915277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1606/3155] 10.222.0.30 () {62 vars in 1198 bytes} [Tue Mar 8 04:55:51 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 404 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 08 04:55:53.147194 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-83451228", "imageRef": "224d5263-d080-40c1-8114-c5e84e961908", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e25b776-a7fe-4fc1-8a46-a03e164be347"}], "security_groups": [{"name": "tempest-securitygroup--1328259585"}], "key_name": "tempest-keypair-1912814052", "user_data": "}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:55:53.244795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.network.neutron [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] validate_networks() for [('4e25b776-a7fe-4fc1-8a46-a03e164be347', None, None, None, None, None)] {{(pid=116775) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:55:53.706200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Flavor limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:55:53.706626 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Image limits 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:55:53.707095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Flavor pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:55:53.707503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Image pref 0:0:0 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:55:53.707913 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.virt.hardware [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:55:53.716386 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:53.716835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:53.717630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:53.718095 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:53.733958 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for project 151b2e10af2e44ae84b8846b557c2833. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:55:53.738452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.quota [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Getting quotas for user bde776f1a50e4d87ad153df6f6f8d315 and project 151b2e10af2e44ae84b8846b557c2833. Resources: {'cores', 'ram', 'instances'} {{(pid=116775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:55:53.748987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Going to run 1 instances... {{(pid=116775) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:55:53.751923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='224d5263-d080-40c1-8114-c5e84e961908',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:55:53.794537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [a6a3c46d-7c3a-4257-97af-e06cf1da94f2] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 04:55:54.801795 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [a6a3c46d-7c3a-4257-97af-e06cf1da94f2] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 53194. Mar 08 04:55:54.805580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c1b01ced-3d6b-46f9-b967-d456f2aa7533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.663762 Mar 08 04:55:54.806258 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1550/3156] 10.222.0.30 () {62 vars in 1187 bytes} [Tue Mar 8 04:55:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 04:55:54.817043 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-40a1f68b-e946-4be1-8bc2-570047669256 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:54.817680 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-40a1f68b-e946-4be1-8bc2-570047669256 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:54.884749 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-40a1f68b-e946-4be1-8bc2-570047669256 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:54.892461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-40a1f68b-e946-4be1-8bc2-570047669256 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:54.894053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-40a1f68b-e946-4be1-8bc2-570047669256 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:54.895148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-40a1f68b-e946-4be1-8bc2-570047669256 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1280 microversion: 2.20 time: 0.082762 Mar 08 04:55:54.895705 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1607/3157] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:54 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:55:55.913963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:55.914560 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:55.921026 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:55.921479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:55.922292 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:55.922758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:55.981897 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:55.990266 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:55.991776 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:55.992864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-05400176-cde8-4b85-872e-8a67ea8ed7b6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1338 microversion: 2.20 time: 0.083505 Mar 08 04:55:55.993406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1551/3158] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:55 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1338 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:56.954892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-52c9a574-7093-459a-8294-3ab32946e1c9 req-4ac15f54-78a1-49e0-baa4-b2a820c9aff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47a6e54b-157c-4655-86c9-3d4eefd8f3df", "tag": "a6d6ba40-651b-43e3-88d5-293a9a5486de"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:55:56.967993 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-52c9a574-7093-459a-8294-3ab32946e1c9 req-4ac15f54-78a1-49e0-baa4-b2a820c9aff9 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:56.968122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-52c9a574-7093-459a-8294-3ab32946e1c9 req-4ac15f54-78a1-49e0-baa4-b2a820c9aff9 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:56.981208 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-52c9a574-7093-459a-8294-3ab32946e1c9 req-4ac15f54-78a1-49e0-baa4-b2a820c9aff9 service nova] Creating event network-changed:a6d6ba40-651b-43e3-88d5-293a9a5486de for instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df on hv-cinder-73306 Mar 08 04:55:56.986865 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-52c9a574-7093-459a-8294-3ab32946e1c9 req-4ac15f54-78a1-49e0-baa4-b2a820c9aff9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036652 Mar 08 04:55:56.987510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1608/3159] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:55:57.011660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:57.012558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:57.021059 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:57.021597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:57.022498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:57.023007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:57.167049 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:57.176215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:57.178019 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:57.179268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7bcb0e06-6a71-492e-9e2d-be53ef29ada1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1406 microversion: 2.20 time: 0.171556 Mar 08 04:55:57.179922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1552/3160] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:57 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:58.198021 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:58.198713 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:58.205408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:58.205884 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:58.206640 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:58.207072 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:58.339913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:58.348464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:58.349995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:58.351068 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f9c493a8-78e9-4254-85e8-cb497651026f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1406 microversion: 2.20 time: 0.157770 Mar 08 04:55:58.351612 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1609/3161] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:58 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:55:59.368567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:55:59.369170 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:55:59.375447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:59.376387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:59.377163 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:55:59.377597 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:55:59.505263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:59.512912 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:59.514715 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:55:59.515804 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3a42e025-6969-4ef6-b840-e9a3228d62a6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1406 microversion: 2.20 time: 0.151146 Mar 08 04:55:59.516355 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1553/3162] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:55:59 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:00.534716 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:00.535274 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:00.541468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:00.541945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:00.542710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:00.543154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:00.670065 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:00.677871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:00.679385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:00.680478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a74317a5-93d3-4440-b481-b3c747aa347b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1406 microversion: 2.20 time: 0.150515 Mar 08 04:56:00.681036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1610/3163] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:00 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:01.698217 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:01.698827 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:01.705268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:01.705759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:01.706529 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:01.706974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:01.839858 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:01.847995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:01.849507 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:01.850627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-996bc7b0-9439-41b0-916e-46bd3928ba2f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1406 microversion: 2.20 time: 0.156401 Mar 08 04:56:01.851211 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1554/3164] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:01 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:02.148365 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-7990d226-084d-4732-8dae-c4bd8b761ba7 req-6f007e28-511f-43c3-9d29-c444217225f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a6e54b-157c-4655-86c9-3d4eefd8f3df", "name": "network-vif-plugged", "status": "completed", "tag": "a6d6ba40-651b-43e3-88d5-293a9a5486de"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:56:02.156439 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7990d226-084d-4732-8dae-c4bd8b761ba7 req-6f007e28-511f-43c3-9d29-c444217225f7 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:02.156891 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-7990d226-084d-4732-8dae-c4bd8b761ba7 req-6f007e28-511f-43c3-9d29-c444217225f7 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:02.169781 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-7990d226-084d-4732-8dae-c4bd8b761ba7 req-6f007e28-511f-43c3-9d29-c444217225f7 service nova] Creating event network-vif-plugged:a6d6ba40-651b-43e3-88d5-293a9a5486de for instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df on hv-cinder-73306 Mar 08 04:56:02.175416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-7990d226-084d-4732-8dae-c4bd8b761ba7 req-6f007e28-511f-43c3-9d29-c444217225f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030598 Mar 08 04:56:02.176009 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1611/3165] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:56:02.869477 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:02.870110 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:02.876450 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:02.876903 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:02.877685 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:02.878112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:03.015280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:03.023363 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:03.024855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:03.025975 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a585870f-4ca8-4165-9e98-292ad1ce6765 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1406 microversion: 2.20 time: 0.160393 Mar 08 04:56:03.026523 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1555/3166] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:02 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:04.045071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:04.045807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:04.052402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:04.052846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:04.053598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:04.054053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:04.186168 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:04.193923 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:04.195429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:04.196555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-e85effe2-79d1-4af9-8cba-1dd63d4e6a3d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1598 microversion: 2.20 time: 0.156193 Mar 08 04:56:04.197108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1612/3167] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:04 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:04.214678 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c3b8cf0c-61b4-49bc-8f08-a51295cadd29 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:04.217347 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c3b8cf0c-61b4-49bc-8f08-a51295cadd29 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:04.221617 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3b8cf0c-61b4-49bc-8f08-a51295cadd29 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:04.222084 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3b8cf0c-61b4-49bc-8f08-a51295cadd29 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:04.222841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3b8cf0c-61b4-49bc-8f08-a51295cadd29 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:04.223278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c3b8cf0c-61b4-49bc-8f08-a51295cadd29 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:04.310878 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c3b8cf0c-61b4-49bc-8f08-a51295cadd29 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100573 Mar 08 04:56:04.311468 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1556/3168] 10.222.0.30 () {60 vars in 1315 bytes} [Tue Mar 8 04:56:04 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 04:56:05.611492 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-034cb8e4-c348-4e32-83d0-f5675374a570 req-b8269803-46e6-45f2-8090-406d9a346f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47a6e54b-157c-4655-86c9-3d4eefd8f3df", "tag": "a6d6ba40-651b-43e3-88d5-293a9a5486de"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:56:05.623686 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-034cb8e4-c348-4e32-83d0-f5675374a570 req-b8269803-46e6-45f2-8090-406d9a346f54 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:05.624198 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-034cb8e4-c348-4e32-83d0-f5675374a570 req-b8269803-46e6-45f2-8090-406d9a346f54 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:05.636369 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-034cb8e4-c348-4e32-83d0-f5675374a570 req-b8269803-46e6-45f2-8090-406d9a346f54 service nova] Creating event network-changed:a6d6ba40-651b-43e3-88d5-293a9a5486de for instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df on hv-cinder-73306 Mar 08 04:56:05.642386 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-034cb8e4-c348-4e32-83d0-f5675374a570 req-b8269803-46e6-45f2-8090-406d9a346f54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157830 Mar 08 04:56:05.642975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1613/3169] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:56:39.420810 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-109d09c6-31d1-4c67-959c-8a03c5d602c3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:39.421444 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-109d09c6-31d1-4c67-959c-8a03c5d602c3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:39.428023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-109d09c6-31d1-4c67-959c-8a03c5d602c3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:39.428474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-109d09c6-31d1-4c67-959c-8a03c5d602c3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:39.429231 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-109d09c6-31d1-4c67-959c-8a03c5d602c3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:39.429679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-109d09c6-31d1-4c67-959c-8a03c5d602c3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:39.452212 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-109d09c6-31d1-4c67-959c-8a03c5d602c3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/ips" status: 200 len: 152 microversion: 2.20 time: 0.035758 Mar 08 04:56:39.452770 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1557/3170] 10.222.0.30 () {60 vars in 1288 bytes} [Tue Mar 8 04:56:39 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:56:41.250199 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-d183e12c-3f10-4f6e-88e7-469bcc5df8d1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:56:41.251399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-d183e12c-3f10-4f6e-88e7-469bcc5df8d1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:41.257330 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d183e12c-3f10-4f6e-88e7-469bcc5df8d1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:41.257811 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d183e12c-3f10-4f6e-88e7-469bcc5df8d1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:41.258565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d183e12c-3f10-4f6e-88e7-469bcc5df8d1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:41.258999 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-d183e12c-3f10-4f6e-88e7-469bcc5df8d1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:41.281353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-d183e12c-3f10-4f6e-88e7-469bcc5df8d1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lazy-loading 'flavor' on Instance uuid 47a6e54b-157c-4655-86c9-3d4eefd8f3df {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:56:41.530770 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-d183e12c-3f10-4f6e-88e7-469bcc5df8d1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/action" status: 202 len: 0 microversion: 2.20 time: 0.285677 Mar 08 04:56:41.531490 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1614/3171] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Mar 8 04:56:41 2022] POST /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:56:41.539454 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:41.540058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:41.546276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:41.546839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:41.547757 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:41.548421 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:41.679769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:41.687371 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:41.688966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:41.690119 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b9b90797-6afe-4dca-9db8-ba8f84144a06 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.154547 Mar 08 04:56:41.690670 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1558/3172] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:41 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:56:42.709095 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:42.709843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:42.715971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:42.716416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:42.717170 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:42.717603 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:42.855328 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:42.863753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:42.865233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:42.866400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-98a99efa-1e74-4187-8c9e-71b0118c9414 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.162110 Mar 08 04:56:42.866955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1615/3173] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:42 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:43.884495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:43.885097 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:43.891603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:43.892048 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:43.892796 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:43.893236 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:44.021998 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:44.029481 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:44.031006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:44.032861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ecbf7109-3fea-42dd-ab88-b32ce1a1b949 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.152253 Mar 08 04:56:44.033415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1559/3174] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:43 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:45.052016 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:45.052653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:45.058836 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:45.059310 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:45.060069 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:45.060504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:45.194960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:45.202542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:45.204097 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:45.205234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7b332ec2-5f19-4ddb-aff4-c1b75ff97da7 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.157231 Mar 08 04:56:45.205805 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1616/3175] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:45 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:46.223653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:46.224394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:46.230590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:46.231173 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:46.231935 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:46.232368 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:46.359189 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:46.366943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:46.368435 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:46.369567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a88526fe-dffd-4619-a5dd-d16d2856a1e6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.150597 Mar 08 04:56:46.370149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1560/3176] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:46 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:47.387225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:47.388090 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:47.394351 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:47.394797 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:47.395552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:47.395980 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:47.526477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:47.534631 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:47.536135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:47.537279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-224d2f2b-5c6f-4dfe-93d6-ac05fa2b835b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.153933 Mar 08 04:56:47.537857 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1617/3177] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:47 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:48.556150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:48.556756 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:48.563705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:48.564158 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:48.564915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:48.565349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:48.697382 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:48.705166 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:48.706731 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:48.707873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b9f8d030-38f4-4f96-a1e7-ca2a3a57b6b1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.155667 Mar 08 04:56:48.708429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1561/3178] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:48 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:49.725912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:49.726508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:49.732472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:49.732919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:49.733709 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:49.734148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:49.865423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:49.873038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:49.874565 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:49.875919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-308a7ce4-1601-4aa7-995f-c04334017c30 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.154001 Mar 08 04:56:49.876468 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1618/3179] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:49 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:50.894200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:50.894802 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:50.901043 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:50.901489 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:50.902309 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:50.902742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:51.038431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:51.046233 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:51.048541 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:51.049722 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-31d44ffd-dc78-44ef-a477-9ae654603822 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.159519 Mar 08 04:56:51.050298 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1562/3180] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:50 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:52.068467 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:52.069158 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:52.075675 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:52.076121 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:52.076883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:52.077321 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:52.210228 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:52.217871 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:52.219549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:52.220697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7317c815-8d4e-4b7d-a050-723bb2084948 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.156328 Mar 08 04:56:52.221252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1619/3181] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:52 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:53.238629 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:53.239342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:53.245742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:53.246190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:53.246957 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:53.247392 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:53.383370 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:53.391348 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:53.392849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:53.394022 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-4a82313d-0482-4197-bbd0-d37b67d1c31c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.159312 Mar 08 04:56:53.394577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1563/3182] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:53 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:54.412132 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:54.412771 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:54.419060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:54.419515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:54.420275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:54.420710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:54.561174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:54.569551 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:54.571084 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:54.572230 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c41e2422-d85d-4093-9a61-ad1f09dfd465 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.164031 Mar 08 04:56:54.572778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1620/3183] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:54 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:55.590165 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:55.590801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:55.597845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:55.598300 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:55.599063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:55.599503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:55.728296 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:55.736607 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:55.738157 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:55.739320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5a8b6e94-daef-4257-ad2a-94cd261cf8d6 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.153021 Mar 08 04:56:55.739870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1564/3184] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:55 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:56.756946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:56.757566 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:56.764039 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:56.764485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:56.765913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:56.766422 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:56.902246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:56.911548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:56.913134 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:56.914353 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-264038d8-6872-4867-97c0-dde4c78d4cbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.161236 Mar 08 04:56:56.915232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1621/3185] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:56 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:57.932112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:57.932719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:57.939637 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:57.940021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:57.940784 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:57.941219 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:58.068877 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:58.076459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:58.078590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:58.079740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-61a1cbc3-9b49-4f91-804d-8a8feb24e29c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1744 microversion: 2.20 time: 0.151512 Mar 08 04:56:58.080302 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1565/3186] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:57 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:56:59.098725 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:56:59.099361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:56:59.105434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:59.106118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:59.106707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:56:59.107148 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:56:59.250596 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:59.259421 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:59.260934 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:56:59.262124 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-48fe43c7-d608-4d6f-902a-9cc1c5357af0 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1739 microversion: 2.20 time: 0.167531 Mar 08 04:56:59.273785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1622/3187] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:56:59 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:00.281922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:00.283562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:00.290634 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:00.291446 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:00.292467 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:00.294062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:00.467417 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:00.478833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:00.482612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:00.485647 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d454664f-b498-4b1c-a5b1-e20a02922737 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1739 microversion: 2.20 time: 0.208146 Mar 08 04:57:00.496388 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1566/3188] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:00 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:01.504643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:01.505261 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:01.511793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:01.512242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:01.513264 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:01.513712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:01.664722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:01.673327 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:01.674893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:01.676111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-681d2ade-6ea5-461f-9b43-1946ec0918d3 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1739 microversion: 2.20 time: 0.175965 Mar 08 04:57:01.676691 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1623/3189] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:01 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:02.404364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-ea8cf297-2217-46a2-9216-9770aa02a995 req-eb33627e-c551-4dac-86e8-d3fdacbe6a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a6e54b-157c-4655-86c9-3d4eefd8f3df", "name": "network-vif-plugged", "status": "completed", "tag": "a6d6ba40-651b-43e3-88d5-293a9a5486de"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:57:02.414974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-ea8cf297-2217-46a2-9216-9770aa02a995 req-eb33627e-c551-4dac-86e8-d3fdacbe6a98 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:02.416905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-ea8cf297-2217-46a2-9216-9770aa02a995 req-eb33627e-c551-4dac-86e8-d3fdacbe6a98 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:02.431578 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-ea8cf297-2217-46a2-9216-9770aa02a995 req-eb33627e-c551-4dac-86e8-d3fdacbe6a98 service nova] Creating event network-vif-plugged:a6d6ba40-651b-43e3-88d5-293a9a5486de for instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df on hv-cinder-73306 Mar 08 04:57:02.438361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-ea8cf297-2217-46a2-9216-9770aa02a995 req-eb33627e-c551-4dac-86e8-d3fdacbe6a98 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037588 Mar 08 04:57:02.439484 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1567/3190] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:57:02.694323 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:02.695183 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:02.701888 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:02.702118 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:02.703843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:02.704314 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:02.862977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:02.883876 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:02.885982 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:02.887153 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-38d34305-fe8c-4175-9549-ace2aa1bd6cf tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1739 microversion: 2.20 time: 0.196778 Mar 08 04:57:02.887978 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1624/3191] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:02 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:03.907745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:03.908694 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:03.916395 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:03.916947 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:03.918030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:03.918576 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:04.087627 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:04.095823 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:04.097343 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:04.098552 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-933f95a9-b5a7-4af0-8303-fa0963146f52 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1739 microversion: 2.20 time: 0.196608 Mar 08 04:57:04.099112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1568/3192] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:03 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:05.117364 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:05.118643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:05.126516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:05.127277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:05.128182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:05.128689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:05.286516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:05.296447 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:05.299192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:05.300750 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-9548c79a-c51e-4b7e-b245-3a89fe1dd61a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1739 microversion: 2.20 time: 0.188413 Mar 08 04:57:05.301303 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1625/3193] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:05 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:06.318667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:06.320200 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:06.326660 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:06.327268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:06.328174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:06.328864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:06.470536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:06.479447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:06.480995 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:06.482202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-91a426e8-9d28-4432-ab2d-65bd3a763c49 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1739 microversion: 2.20 time: 0.167645 Mar 08 04:57:06.483272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1569/3194] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:06 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:07.501245 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:07.502246 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:07.508400 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:07.509085 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:07.509881 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:07.510504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:07.667288 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:07.678366 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:07.680396 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:07.681955 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-199943d3-da04-4e8e-a6a8-f6de9e27abde tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1739 microversion: 2.20 time: 0.185282 Mar 08 04:57:07.693517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1626/3195] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:07 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:08.700353 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:08.700965 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:08.707420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:08.707873 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:08.708644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:08.709081 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:08.841789 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:08.849614 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:08.851150 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:08.852301 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dc7cb350-6404-4e89-b438-49c3def39a17 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1721 microversion: 2.20 time: 0.155824 Mar 08 04:57:08.852857 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1570/3196] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:08 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:09.871410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:09.872017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:09.878349 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:09.878793 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:09.879545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:09.879992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:10.011796 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:10.019952 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:10.021502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:10.022692 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-005102bc-ddcd-4601-a1be-b05965b5164a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1721 microversion: 2.20 time: 0.155243 Mar 08 04:57:10.023255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1627/3197] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:09 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:10.392464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e738f510-5d68-4f16-87c5-236e30d3378d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:10.393062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e738f510-5d68-4f16-87c5-236e30d3378d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:10.399915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e738f510-5d68-4f16-87c5-236e30d3378d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:10.400372 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e738f510-5d68-4f16-87c5-236e30d3378d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:10.401146 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e738f510-5d68-4f16-87c5-236e30d3378d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:10.401579 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e738f510-5d68-4f16-87c5-236e30d3378d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:10.416728 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-e738f510-5d68-4f16-87c5-236e30d3378d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 could not be found. Mar 08 04:57:10.417495 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e738f510-5d68-4f16-87c5-236e30d3378d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:57:10.418542 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e738f510-5d68-4f16-87c5-236e30d3378d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 404 len: 111 microversion: 2.1 time: 0.030463 Mar 08 04:57:10.419102 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1571/3198] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:57:10 2022] DELETE /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:57:10.429325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2002216f-48d7-44d9-9df9-627048f59227 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:10.430048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-2002216f-48d7-44d9-9df9-627048f59227 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: b9b7df88-e3f5-4a15-9f5f-499bb4a48194] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:10.437374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2002216f-48d7-44d9-9df9-627048f59227 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:10.438225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2002216f-48d7-44d9-9df9-627048f59227 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:10.439555 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2002216f-48d7-44d9-9df9-627048f59227 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:10.440225 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-2002216f-48d7-44d9-9df9-627048f59227 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:10.456061 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-2002216f-48d7-44d9-9df9-627048f59227 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 could not be found. Mar 08 04:57:10.456452 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-2002216f-48d7-44d9-9df9-627048f59227 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance b9b7df88-e3f5-4a15-9f5f-499bb4a48194 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:57:10.457272 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-2002216f-48d7-44d9-9df9-627048f59227 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194" status: 404 len: 111 microversion: 2.1 time: 0.033705 Mar 08 04:57:10.457860 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1628/3199] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:57:10 2022] GET /compute/v2.1/servers/b9b7df88-e3f5-4a15-9f5f-499bb4a48194 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:57:10.468346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0cf5b382-10d2-4eae-a2eb-7ac0efe2c170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:10.468892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0cf5b382-10d2-4eae-a2eb-7ac0efe2c170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:10.475521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cf5b382-10d2-4eae-a2eb-7ac0efe2c170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:10.475974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cf5b382-10d2-4eae-a2eb-7ac0efe2c170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:10.476849 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cf5b382-10d2-4eae-a2eb-7ac0efe2c170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:10.477251 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0cf5b382-10d2-4eae-a2eb-7ac0efe2c170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:10.493948 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-0cf5b382-10d2-4eae-a2eb-7ac0efe2c170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance 46c4a684-9cf2-4913-8f00-3833940f7184 could not be found. Mar 08 04:57:10.494545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0cf5b382-10d2-4eae-a2eb-7ac0efe2c170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance 46c4a684-9cf2-4913-8f00-3833940f7184 could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:57:10.495439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0cf5b382-10d2-4eae-a2eb-7ac0efe2c170 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 404 len: 111 microversion: 2.1 time: 0.031809 Mar 08 04:57:10.496437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1572/3200] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:57:10 2022] DELETE /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:57:10.509046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-905e3d00-7c99-42b3-a710-046a03ed88b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:10.509685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-905e3d00-7c99-42b3-a710-046a03ed88b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 46c4a684-9cf2-4913-8f00-3833940f7184] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:10.517370 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-905e3d00-7c99-42b3-a710-046a03ed88b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:10.517861 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-905e3d00-7c99-42b3-a710-046a03ed88b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:10.519048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-905e3d00-7c99-42b3-a710-046a03ed88b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:10.519475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-905e3d00-7c99-42b3-a710-046a03ed88b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:10.540502 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-905e3d00-7c99-42b3-a710-046a03ed88b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance 46c4a684-9cf2-4913-8f00-3833940f7184 could not be found. Mar 08 04:57:10.541227 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-905e3d00-7c99-42b3-a710-046a03ed88b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance 46c4a684-9cf2-4913-8f00-3833940f7184 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:57:10.542160 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-905e3d00-7c99-42b3-a710-046a03ed88b4 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184" status: 404 len: 111 microversion: 2.1 time: 0.040941 Mar 08 04:57:10.543107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1629/3201] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:57:10 2022] GET /compute/v2.1/servers/46c4a684-9cf2-4913-8f00-3833940f7184 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:57:11.041549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:11.042180 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:11.048852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.049290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.050109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.050537 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.187577 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:11.195695 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:11.197278 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:11.198439 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b20f6dd8-a154-4a04-a03c-79da18b4eafc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1664 microversion: 2.20 time: 0.160838 Mar 08 04:57:11.198991 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1573/3202] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:11 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:11.216510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0f3b8ff9-e3c1-4d69-8476-4128ae50e477 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47209f26-5cae-4628-aa41-c30d113b40ab"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:57:11.217614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0f3b8ff9-e3c1-4d69-8476-4128ae50e477 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:11.224614 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f3b8ff9-e3c1-4d69-8476-4128ae50e477 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.225094 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f3b8ff9-e3c1-4d69-8476-4128ae50e477 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.225879 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f3b8ff9-e3c1-4d69-8476-4128ae50e477 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.226309 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f3b8ff9-e3c1-4d69-8476-4128ae50e477 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.494204 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0f3b8ff9-e3c1-4d69-8476-4128ae50e477 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.281553 Mar 08 04:57:11.494788 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1630/3203] 10.222.0.30 () {62 vars in 1363 bytes} [Tue Mar 8 04:57:11 2022] POST /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 04:57:11.603324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-41acff79-b34d-47ed-ba9e-2e1e1b8fdd8c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:11.603832 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-41acff79-b34d-47ed-ba9e-2e1e1b8fdd8c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:11.610667 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41acff79-b34d-47ed-ba9e-2e1e1b8fdd8c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.611116 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41acff79-b34d-47ed-ba9e-2e1e1b8fdd8c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.611872 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41acff79-b34d-47ed-ba9e-2e1e1b8fdd8c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.612308 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-41acff79-b34d-47ed-ba9e-2e1e1b8fdd8c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.693910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-da898e1e-42bd-4c3f-a988-4d393f6a822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:11.694550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-da898e1e-42bd-4c3f-a988-4d393f6a822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:11.701335 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da898e1e-42bd-4c3f-a988-4d393f6a822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.701833 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da898e1e-42bd-4c3f-a988-4d393f6a822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.703108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da898e1e-42bd-4c3f-a988-4d393f6a822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.703550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-da898e1e-42bd-4c3f-a988-4d393f6a822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.716883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-da898e1e-42bd-4c3f-a988-4d393f6a822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 could not be found. Mar 08 04:57:11.717482 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-da898e1e-42bd-4c3f-a988-4d393f6a822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:57:11.719224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-da898e1e-42bd-4c3f-a988-4d393f6a822d tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 404 len: 111 microversion: 2.1 time: 0.029428 Mar 08 04:57:11.719764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1631/3204] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:57:11 2022] DELETE /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 04:57:11.727478 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6c17ff7f-bf29-4bdc-a604-0bd434061f18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:11.728088 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6c17ff7f-bf29-4bdc-a604-0bd434061f18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] [instance: 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:11.734041 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c17ff7f-bf29-4bdc-a604-0bd434061f18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.734499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c17ff7f-bf29-4bdc-a604-0bd434061f18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.735269 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c17ff7f-bf29-4bdc-a604-0bd434061f18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.735882 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6c17ff7f-bf29-4bdc-a604-0bd434061f18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.748938 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-6c17ff7f-bf29-4bdc-a604-0bd434061f18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] HTTP exception thrown: Instance 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 could not be found. Mar 08 04:57:11.749579 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6c17ff7f-bf29-4bdc-a604-0bd434061f18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] Returning 404 to user: Instance 1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:57:11.750423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6c17ff7f-bf29-4bdc-a604-0bd434061f18 tempest-AttachVolumeNegativeTest-1195560284 tempest-AttachVolumeNegativeTest-1195560284-project] 10.222.0.30 "GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5" status: 404 len: 111 microversion: 2.1 time: 0.026588 Mar 08 04:57:11.751003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1632/3205] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:57:11 2022] GET /compute/v2.1/servers/1088612f-57f5-4e1a-bf1a-5f218b6f9eb5 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:57:11.828361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-41acff79-b34d-47ed-ba9e-2e1e1b8fdd8c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/os-volume_attachments/47209f26-5cae-4628-aa41-c30d113b40ab" status: 202 len: 0 microversion: 2.20 time: 0.227925 Mar 08 04:57:11.828969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1574/3206] 10.222.0.30 () {60 vars in 1456 bytes} [Tue Mar 8 04:57:11 2022] DELETE /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/os-volume_attachments/47209f26-5cae-4628-aa41-c30d113b40ab => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 08 04:57:11.886193 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b1b23de1-9b18-435a-ab81-6cd370ea62f8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:57:11.886904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b1b23de1-9b18-435a-ab81-6cd370ea62f8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:11.893818 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1b23de1-9b18-435a-ab81-6cd370ea62f8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.894315 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1b23de1-9b18-435a-ab81-6cd370ea62f8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.895079 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1b23de1-9b18-435a-ab81-6cd370ea62f8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:11.895540 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b1b23de1-9b18-435a-ab81-6cd370ea62f8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:11.971693 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b1b23de1-9b18-435a-ab81-6cd370ea62f8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [307a667b-c2ce-45d6-886d-e77bb23cdc66] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 04:57:12.392763 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-433bab7a-ad45-4fbb-b79e-ec745902b0b4 req-69e85691-6c17-49f5-ae03-480db925d626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a6e54b-157c-4655-86c9-3d4eefd8f3df", "name": "network-vif-unplugged", "status": "completed", "tag": "a6d6ba40-651b-43e3-88d5-293a9a5486de"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:57:12.401861 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-433bab7a-ad45-4fbb-b79e-ec745902b0b4 req-69e85691-6c17-49f5-ae03-480db925d626 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:12.403464 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-433bab7a-ad45-4fbb-b79e-ec745902b0b4 req-69e85691-6c17-49f5-ae03-480db925d626 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:12.414092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.compute.server_external_events [req-433bab7a-ad45-4fbb-b79e-ec745902b0b4 req-69e85691-6c17-49f5-ae03-480db925d626 service nova] Unable to find a host for instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df. Dropping event network-vif-unplugged {{(pid=116775) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 08 04:57:12.415096 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-433bab7a-ad45-4fbb-b79e-ec745902b0b4 req-69e85691-6c17-49f5-ae03-480db925d626 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026299 Mar 08 04:57:12.416007 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1575/3207] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 08 04:57:12.979267 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [None req-b1b23de1-9b18-435a-ab81-6cd370ea62f8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [307a667b-c2ce-45d6-886d-e77bb23cdc66] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 53574. Mar 08 04:57:12.982375 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b1b23de1-9b18-435a-ab81-6cd370ea62f8 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "POST /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/action" status: 202 len: 0 microversion: 2.20 time: 1.100315 Mar 08 04:57:12.983226 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1633/3208] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Mar 8 04:57:11 2022] POST /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/action => generated 0 bytes in 1101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 04:57:12.991516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:12.992720 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:13.000047 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:13.000511 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:13.001405 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:13.001864 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:13.168188 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:13.176923 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:13.178786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:13.179939 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-be4d50b3-4c8a-420a-a99d-9b49a9866e33 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1672 microversion: 2.20 time: 0.192274 Mar 08 04:57:13.180845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1576/3209] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:12 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1672 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:14.198910 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:14.200114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:14.219203 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:14.219924 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:14.220908 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:14.221513 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:14.439918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:14.448266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:14.449843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:14.450987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-78925e80-7639-46a2-98c1-14c09527912c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.256927 Mar 08 04:57:14.451536 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1634/3210] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:14 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:57:15.470306 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:15.471001 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:15.478115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:15.479012 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:15.479845 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:15.480411 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:15.633496 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:15.642585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:15.644921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:15.646346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-78bfa2cf-b0b2-4ba2-938e-0f5ed29b0b5a tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.180377 Mar 08 04:57:15.647447 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1577/3211] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:15 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:16.666209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:16.666821 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:16.673746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:16.675961 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:16.676975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:16.677518 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:16.856777 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:16.865748 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:16.867514 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:16.868897 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6ecd89e8-4c32-48bc-8ad9-1643d26ee8a2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.206788 Mar 08 04:57:16.869960 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1635/3212] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:16 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:17.887920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:17.888723 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:17.895888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:17.896341 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:17.897120 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:17.897566 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:18.048606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:18.056963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:18.058508 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:18.059674 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fda469b0-7d60-44e3-ab39-629c2bafc715 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.176144 Mar 08 04:57:18.060228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1578/3213] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:17 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:19.077698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:19.078483 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:19.084724 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:19.085305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:19.086181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:19.086734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:19.228019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:19.236885 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:19.238462 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:19.239918 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-c9bec766-ba21-4661-9ccf-96b754f74dad tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.166418 Mar 08 04:57:19.241313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1636/3214] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:19 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:20.259029 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:20.259630 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:20.267323 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:20.267769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:20.268640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:20.269065 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:20.432050 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:20.442228 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:20.443863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:20.445129 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-97ca3a0b-23eb-493e-a043-e5b2c1bae295 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.190302 Mar 08 04:57:20.453285 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1579/3215] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:20 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:21.466279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:21.468078 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:21.485929 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:21.486377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:21.487162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:21.487598 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:21.671775 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:21.684102 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:21.687051 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:21.688472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4907569d-a294-424d-b40e-a5dddc3fcd5b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.226036 Mar 08 04:57:21.698438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1637/3216] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:21 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:22.712092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:22.712092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:22.715528 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:22.716046 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:22.716885 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:22.717980 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:22.896418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:22.905503 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:22.907138 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:22.908427 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e5c31560-cb9b-4fe0-8708-19492cc1aadb tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.205403 Mar 08 04:57:22.909215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1580/3217] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:22 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:23.927255 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:23.927995 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:23.934224 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:23.934747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:23.935581 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:23.936154 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:24.070472 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:24.078152 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:24.079765 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:24.080917 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-93d053f5-2023-4f55-8a9a-bd00f936e79f tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.157656 Mar 08 04:57:24.081475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1638/3218] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:23 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:25.100010 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:25.100771 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:25.107512 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:25.108076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:25.109295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:25.109839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:25.253974 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:25.261955 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:25.263735 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:25.265801 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-12d95fc2-5b03-446d-a6c3-b4e4d55352f2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.170692 Mar 08 04:57:25.266550 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1581/3219] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:25 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:57:26.283424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:26.284038 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:26.290391 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:26.290847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:26.291625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:26.292067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:26.429298 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:26.437625 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:26.439147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:26.440300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-703ce12d-8425-4f27-bedf-b8876b449451 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.161286 Mar 08 04:57:26.441023 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1639/3220] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:26 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:27.458329 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:27.458925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:27.465342 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:27.465830 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:27.466596 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:27.467681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:27.601486 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:27.609339 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:27.610888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:27.612070 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-22848aed-8aba-4626-9abc-89754b7c06bd tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.157590 Mar 08 04:57:27.612625 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1582/3221] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:27 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:28.629887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:28.630516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:28.636633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:28.637343 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:28.638256 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:28.638668 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:28.777242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:28.785547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:28.787453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:28.788594 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-586c9e07-9eef-4916-9e1b-4f256655a533 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.162669 Mar 08 04:57:28.789434 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1640/3222] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:28 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:29.807297 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:29.808013 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:29.815732 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:29.816190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:29.816977 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:29.817418 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:29.957842 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:29.965408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:29.967241 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:29.968389 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fa64e16d-e5c1-4c21-9364-46b43838fe68 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.165176 Mar 08 04:57:29.968940 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1583/3223] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:29 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:57:30.540126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-747fb7c1-9d39-4643-b5d4-015d453b75c7 req-ddc5da7c-42b1-4f63-8d91-5eef85bc0102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a6e54b-157c-4655-86c9-3d4eefd8f3df", "name": "network-vif-plugged", "status": "completed", "tag": "a6d6ba40-651b-43e3-88d5-293a9a5486de"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:57:30.550875 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-747fb7c1-9d39-4643-b5d4-015d453b75c7 req-ddc5da7c-42b1-4f63-8d91-5eef85bc0102 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:30.552150 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-747fb7c1-9d39-4643-b5d4-015d453b75c7 req-ddc5da7c-42b1-4f63-8d91-5eef85bc0102 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:30.565143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-747fb7c1-9d39-4643-b5d4-015d453b75c7 req-ddc5da7c-42b1-4f63-8d91-5eef85bc0102 service nova] Creating event network-vif-plugged:a6d6ba40-651b-43e3-88d5-293a9a5486de for instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df on hv-cinder-73306 Mar 08 04:57:30.570785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-747fb7c1-9d39-4643-b5d4-015d453b75c7 req-ddc5da7c-42b1-4f63-8d91-5eef85bc0102 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034664 Mar 08 04:57:30.572049 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1641/3224] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:57:30.987745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:30.988280 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:30.994567 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:30.995017 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:30.996145 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:30.996585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:31.135465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:31.143890 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:31.145391 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:31.146551 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-8d244290-d16a-4b43-83bc-9d8378a006ca tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.164134 Mar 08 04:57:31.147101 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1584/3225] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:30 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:57:32.165894 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:32.166904 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:32.174553 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:32.175098 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:32.176010 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:32.176643 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:32.320723 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:32.329761 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:32.331283 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:32.332552 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6f0f5906-de0f-4883-ad6d-408b36949bee tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1730 microversion: 2.20 time: 0.171820 Mar 08 04:57:32.333424 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1642/3226] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:32 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:57:33.351803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:57:33.352522 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:57:33.359215 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:33.359740 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:33.360516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:57:33.360950 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:57:33.506124 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:33.514803 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:33.516310 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:57:33.517448 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d4059787-56df-4afa-aa10-fd10c0ccebbc tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1717 microversion: 2.20 time: 0.169587 Mar 08 04:57:33.518031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1585/3227] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:57:33 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:58:03.776219 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-64807793-a08e-4966-9884-29f36a755ea6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Action: 'create', calling method: .version_select at 0x7fe83249c3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-538163327"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:58:03.790067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-64807793-a08e-4966-9884-29f36a755ea6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Getting quotas for project 807ac91ba3104c2dbaf341f434162817. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:58:03.794247 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-64807793-a08e-4966-9884-29f36a755ea6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Getting quotas for user b73ba65b532b4bf98c7ed393be343713 and project 807ac91ba3104c2dbaf341f434162817. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:58:04.057992 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-64807793-a08e-4966-9884-29f36a755ea6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Getting quotas for project 807ac91ba3104c2dbaf341f434162817. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:58:04.062423 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-64807793-a08e-4966-9884-29f36a755ea6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Getting quotas for user b73ba65b532b4bf98c7ed393be343713 and project 807ac91ba3104c2dbaf341f434162817. Resources: {'key_pairs'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:58:04.078644 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-64807793-a08e-4966-9884-29f36a755ea6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.306361 Mar 08 04:58:04.079239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1643/3228] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 04:58:03 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:04.090276 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-179d2ee7-bd68-4ba6-812e-bb6cb2f87051 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:04.091461 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-179d2ee7-bd68-4ba6-812e-bb6cb2f87051 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:04.097777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-179d2ee7-bd68-4ba6-812e-bb6cb2f87051 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:04.098225 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-179d2ee7-bd68-4ba6-812e-bb6cb2f87051 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:04.098988 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-179d2ee7-bd68-4ba6-812e-bb6cb2f87051 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:04.099442 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-179d2ee7-bd68-4ba6-812e-bb6cb2f87051 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:04.126887 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1967514798", "imageRef": "f1cf1c60-1d76-47ac-bfba-21e8b5eca99d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-538163327", "networks": [{"uuid": "c0cd9cb0-6938-456f-b7e5-be10b1a09a32"}]}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:58:04.127806 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-179d2ee7-bd68-4ba6-812e-bb6cb2f87051 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041638 Mar 08 04:58:04.128494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1586/3229] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 04:58:04 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:58:04.180286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.network.neutron [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] validate_networks() for [('c0cd9cb0-6938-456f-b7e5-be10b1a09a32', None, None, None, None, None)] {{(pid=116774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 04:58:04.187147 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5dd77f11-0ca9-451c-938b-32bc71d7f6c2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:04.187758 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5dd77f11-0ca9-451c-938b-32bc71d7f6c2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:04.193863 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5dd77f11-0ca9-451c-938b-32bc71d7f6c2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:04.194408 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5dd77f11-0ca9-451c-938b-32bc71d7f6c2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:04.195247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5dd77f11-0ca9-451c-938b-32bc71d7f6c2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:04.195761 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5dd77f11-0ca9-451c-938b-32bc71d7f6c2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:04.220075 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5dd77f11-0ca9-451c-938b-32bc71d7f6c2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:58:04.304038 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5dd77f11-0ca9-451c-938b-32bc71d7f6c2 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 204 len: 0 microversion: 2.20 time: 0.121359 Mar 08 04:58:04.304745 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1587/3230] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 04:58:04 2022] DELETE /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 08 04:58:04.314862 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:04.315648 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:04.321747 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:04.322283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:04.323135 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:04.323656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:04.565942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:04.573640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:04.575886 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:04.577041 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-e8cf7f2e-8811-4d8c-922e-32a53784097d tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.268074 Mar 08 04:58:04.577602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1588/3231] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:04 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:58:04.869517 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Flavor limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 04:58:04.870139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Image limits 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 04:58:04.870451 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Flavor pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 04:58:04.870856 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Image pref 0:0:0 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 04:58:04.871290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.virt.hardware [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 04:58:04.880698 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:04.881969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:04.881969 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:04.883340 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:04.899216 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Getting quotas for project 807ac91ba3104c2dbaf341f434162817. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 04:58:04.903243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.quota [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Getting quotas for user b73ba65b532b4bf98c7ed393be343713 and project 807ac91ba3104c2dbaf341f434162817. Resources: {'cores', 'ram', 'instances'} {{(pid=116774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 04:58:04.913844 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Going to run 1 instances... {{(pid=116774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 04:58:04.916017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1cf1c60-1d76-47ac-bfba-21e8b5eca99d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 04:58:04.961807 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0b1d9a06-d6fa-46cd-9140-ea75c8631fbb tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838788 Mar 08 04:58:04.962444 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1644/3232] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 04:58:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 04:58:04.972114 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0e7256ba-4b4d-4efe-b5c3-175dd8671f6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:04.972723 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0e7256ba-4b4d-4efe-b5c3-175dd8671f6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:05.024499 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0e7256ba-4b4d-4efe-b5c3-175dd8671f6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:05.032295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0e7256ba-4b4d-4efe-b5c3-175dd8671f6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1258 microversion: 2.1 time: 0.063868 Mar 08 04:58:05.033156 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1589/3233] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:04 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:05.595336 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:05.595954 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:05.601900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:05.602361 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:05.603130 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:05.603571 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:05.734971 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:05.742753 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:05.744266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:05.745420 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-92217858-4e52-4fa6-adbf-75846f4fa292 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1723 microversion: 2.20 time: 0.154082 Mar 08 04:58:05.746003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1645/3234] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:05 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:58:06.049978 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5f4bbc62-45be-47fe-91c9-6255fa0ad7e7 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:06.050665 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5f4bbc62-45be-47fe-91c9-6255fa0ad7e7 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:06.056738 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f4bbc62-45be-47fe-91c9-6255fa0ad7e7 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:06.057115 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f4bbc62-45be-47fe-91c9-6255fa0ad7e7 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:06.057928 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f4bbc62-45be-47fe-91c9-6255fa0ad7e7 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:06.058414 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5f4bbc62-45be-47fe-91c9-6255fa0ad7e7 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:06.119993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5f4bbc62-45be-47fe-91c9-6255fa0ad7e7 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:06.127505 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5f4bbc62-45be-47fe-91c9-6255fa0ad7e7 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1316 microversion: 2.1 time: 0.081429 Mar 08 04:58:06.128079 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1590/3235] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:06 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1316 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:06.764646 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:06.765244 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:06.772166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:06.772642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:06.779674 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:06.780142 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:06.929139 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:06.950847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:06.956174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:06.957456 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-5b41674c-04a1-4c77-a13b-c50773902c9c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1655 microversion: 2.20 time: 0.197994 Mar 08 04:58:06.958053 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1646/3236] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:06 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1655 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:58:07.151736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-f5d17142-b10d-4a93-915e-429102db4a2c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:07.156199 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-f5d17142-b10d-4a93-915e-429102db4a2c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:07.171307 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5d17142-b10d-4a93-915e-429102db4a2c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:07.172951 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5d17142-b10d-4a93-915e-429102db4a2c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:07.176082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5d17142-b10d-4a93-915e-429102db4a2c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:07.177126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-f5d17142-b10d-4a93-915e-429102db4a2c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:07.490331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-f5d17142-b10d-4a93-915e-429102db4a2c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:07.501825 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-f5d17142-b10d-4a93-915e-429102db4a2c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.357430 Mar 08 04:58:07.504963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1591/3237] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:07 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:07.538948 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-47015106-ca08-4de5-b1c8-38ea6a74cfa1 req-5f5ea6bf-70e5-45ff-acd1-bf138b959224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a6e54b-157c-4655-86c9-3d4eefd8f3df", "name": "network-vif-deleted", "tag": "a6d6ba40-651b-43e3-88d5-293a9a5486de"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:58:07.562757 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-47015106-ca08-4de5-b1c8-38ea6a74cfa1 req-5f5ea6bf-70e5-45ff-acd1-bf138b959224 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:07.567845 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-47015106-ca08-4de5-b1c8-38ea6a74cfa1 req-5f5ea6bf-70e5-45ff-acd1-bf138b959224 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:07.593731 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-47015106-ca08-4de5-b1c8-38ea6a74cfa1 req-5f5ea6bf-70e5-45ff-acd1-bf138b959224 service nova] Creating event network-vif-deleted:a6d6ba40-651b-43e3-88d5-293a9a5486de for instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df on hv-cinder-73306 Mar 08 04:58:07.610243 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-47015106-ca08-4de5-b1c8-38ea6a74cfa1 req-5f5ea6bf-70e5-45ff-acd1-bf138b959224 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.400720 Mar 08 04:58:07.614883 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1647/3238] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:58:07.977004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:07.978558 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:07.991364 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:07.991936 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:07.992788 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:07.994257 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:08.075485 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:08.083840 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:08.085351 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:08.086700 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-d3acef48-a9ad-4f06-8823-c122a9847ae1 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1655 microversion: 2.20 time: 0.114233 Mar 08 04:58:08.087429 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1592/3239] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:07 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:58:08.519930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f86027ee-4ead-450a-a676-f37cec404388 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:08.521206 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f86027ee-4ead-450a-a676-f37cec404388 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:08.541599 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f86027ee-4ead-450a-a676-f37cec404388 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:08.542464 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f86027ee-4ead-450a-a676-f37cec404388 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:08.543914 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f86027ee-4ead-450a-a676-f37cec404388 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:08.544653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f86027ee-4ead-450a-a676-f37cec404388 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:08.726229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f86027ee-4ead-450a-a676-f37cec404388 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:08.735144 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f86027ee-4ead-450a-a676-f37cec404388 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.219347 Mar 08 04:58:08.739001 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1648/3240] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:08 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:09.110981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:09.111561 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:09.118062 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:09.118580 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:09.119349 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:09.119785 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:09.193946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:09.205415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:09.207920 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:09.209089 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a8135532-3c85-4993-88dd-3d9383bd7171 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1655 microversion: 2.20 time: 0.107153 Mar 08 04:58:09.209887 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1593/3241] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:09 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:58:09.755677 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-dd3eddb6-3b30-4113-b711-9c95fed4c7c6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:09.756275 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-dd3eddb6-3b30-4113-b711-9c95fed4c7c6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:09.764233 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd3eddb6-3b30-4113-b711-9c95fed4c7c6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:09.764676 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd3eddb6-3b30-4113-b711-9c95fed4c7c6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:09.765508 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd3eddb6-3b30-4113-b711-9c95fed4c7c6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:09.765966 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-dd3eddb6-3b30-4113-b711-9c95fed4c7c6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:09.908231 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-dd3eddb6-3b30-4113-b711-9c95fed4c7c6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:09.915411 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-dd3eddb6-3b30-4113-b711-9c95fed4c7c6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.163731 Mar 08 04:58:09.915964 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1649/3242] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:09 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:10.228133 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:10.228729 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:10.235240 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:10.235690 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:10.236452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:10.236892 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:10.302929 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:10.312213 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:10.314409 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:10.316201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-3ff28110-6f6f-4759-8a7c-265e06cd41ef tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1655 microversion: 2.20 time: 0.091718 Mar 08 04:58:10.317653 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1594/3243] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:10 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:58:10.934661 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f8de78e6-682b-4fad-908c-5dc510b20e6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:10.935281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f8de78e6-682b-4fad-908c-5dc510b20e6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:10.941545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8de78e6-682b-4fad-908c-5dc510b20e6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:10.942036 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8de78e6-682b-4fad-908c-5dc510b20e6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:10.942809 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8de78e6-682b-4fad-908c-5dc510b20e6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:10.943266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f8de78e6-682b-4fad-908c-5dc510b20e6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:11.088196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f8de78e6-682b-4fad-908c-5dc510b20e6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:11.096707 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f8de78e6-682b-4fad-908c-5dc510b20e6f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.165979 Mar 08 04:58:11.097281 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1650/3244] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:10 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:11.335962 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:11.337544 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:11.345786 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:11.346237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:11.347261 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:11.348055 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:11.429176 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:11.438247 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:11.439753 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:11.441474 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dd8ce5d6-b28c-49fc-bdda-09c3ad4cf4a5 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1655 microversion: 2.20 time: 0.109226 Mar 08 04:58:11.442087 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1595/3245] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:11 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:58:12.113866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-debac0c7-71ed-4c15-8830-5f142b758c4e tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:12.114410 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-debac0c7-71ed-4c15-8830-5f142b758c4e tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:12.120576 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-debac0c7-71ed-4c15-8830-5f142b758c4e tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:12.121017 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-debac0c7-71ed-4c15-8830-5f142b758c4e tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:12.122329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-debac0c7-71ed-4c15-8830-5f142b758c4e tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:12.122759 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-debac0c7-71ed-4c15-8830-5f142b758c4e tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:12.257986 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-debac0c7-71ed-4c15-8830-5f142b758c4e tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:12.267630 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-debac0c7-71ed-4c15-8830-5f142b758c4e tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.157559 Mar 08 04:58:12.268289 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1651/3246] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:12 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:12.460380 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:12.460993 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:12.467990 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:12.468431 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:12.469185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:12.469615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:12.526889 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:12.534996 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:12.536491 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:12.537615 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5cb02b75-ae83-40aa-a36d-0055a02dbe12 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1655 microversion: 2.20 time: 0.081093 Mar 08 04:58:12.538190 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1596/3247] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:12 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1655 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:58:13.287253 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-ec703b66-acb1-4cbc-b90a-9c2c42f85cb8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:13.287848 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-ec703b66-acb1-4cbc-b90a-9c2c42f85cb8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:13.294331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec703b66-acb1-4cbc-b90a-9c2c42f85cb8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:13.294778 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec703b66-acb1-4cbc-b90a-9c2c42f85cb8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:13.295545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec703b66-acb1-4cbc-b90a-9c2c42f85cb8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:13.295983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-ec703b66-acb1-4cbc-b90a-9c2c42f85cb8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:13.438824 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-ec703b66-acb1-4cbc-b90a-9c2c42f85cb8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:13.446205 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-ec703b66-acb1-4cbc-b90a-9c2c42f85cb8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.162796 Mar 08 04:58:13.446773 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1652/3248] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:13 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:13.557859 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:13.558479 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:13.566415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:13.567051 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:13.567841 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:13.568314 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:13.630407 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:13.638759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:13.640255 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:13.641383 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-811c6533-7272-4da2-8167-9c1ea2cb15de tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1655 microversion: 2.20 time: 0.088880 Mar 08 04:58:13.641981 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1597/3249] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:13 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:58:14.464290 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-764b45a6-6b25-4ff1-b2c4-6a8e509a84a1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:14.465746 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-764b45a6-6b25-4ff1-b2c4-6a8e509a84a1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:14.471740 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-764b45a6-6b25-4ff1-b2c4-6a8e509a84a1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:14.472174 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-764b45a6-6b25-4ff1-b2c4-6a8e509a84a1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:14.472944 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-764b45a6-6b25-4ff1-b2c4-6a8e509a84a1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:14.473377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-764b45a6-6b25-4ff1-b2c4-6a8e509a84a1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:14.608305 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-764b45a6-6b25-4ff1-b2c4-6a8e509a84a1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:14.615405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-764b45a6-6b25-4ff1-b2c4-6a8e509a84a1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.155030 Mar 08 04:58:14.615970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1653/3250] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:14 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:14.659400 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:14.660005 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:14.666289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:14.666752 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:14.667516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:14.668603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:14.736521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:14.744621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:14.746335 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:14.747519 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-9d313a2b-9ea9-4b51-a636-440014aee54b tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1655 microversion: 2.20 time: 0.092043 Mar 08 04:58:14.754436 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1598/3251] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:14 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 04:58:15.632122 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-0f40da13-0e54-4909-a999-ebdf42b7d9f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:15.632733 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-0f40da13-0e54-4909-a999-ebdf42b7d9f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:15.639196 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f40da13-0e54-4909-a999-ebdf42b7d9f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:15.639642 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f40da13-0e54-4909-a999-ebdf42b7d9f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:15.640408 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f40da13-0e54-4909-a999-ebdf42b7d9f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:15.640843 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-0f40da13-0e54-4909-a999-ebdf42b7d9f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:15.765973 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:15.766613 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:15.772752 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-0f40da13-0e54-4909-a999-ebdf42b7d9f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:15.772922 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:15.773338 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:15.774130 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:15.774705 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:15.780416 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-0f40da13-0e54-4909-a999-ebdf42b7d9f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.152152 Mar 08 04:58:15.780977 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1654/3252] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:15 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:15.834003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:15.842275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:15.843798 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bde776f1a50e4d87ad153df6f6f8d315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151b2e10af2e44ae84b8846b557c2833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:15.844943 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-fdadce51-dedf-4ac1-96b3-2e5582d25d3c tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 200 len: 1655 microversion: 2.20 time: 0.082997 Mar 08 04:58:15.845494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1599/3253] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:15 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 1655 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 04:58:16.662877 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-17c8be4f-39ae-489b-870f-a3ce5a9d9b67 req-277e42a1-b486-4e98-91bf-ab3949f028ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d454cf-c4e3-45fe-9407-cb49752bfa71", "tag": "6fa8be19-cf26-4273-b6fc-a50481196e32"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:58:16.704096 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-17c8be4f-39ae-489b-870f-a3ce5a9d9b67 req-277e42a1-b486-4e98-91bf-ab3949f028ad service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:16.704554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-17c8be4f-39ae-489b-870f-a3ce5a9d9b67 req-277e42a1-b486-4e98-91bf-ab3949f028ad service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:16.716900 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-17c8be4f-39ae-489b-870f-a3ce5a9d9b67 req-277e42a1-b486-4e98-91bf-ab3949f028ad service nova] Creating event network-changed:6fa8be19-cf26-4273-b6fc-a50481196e32 for instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 on hv-cinder-73306 Mar 08 04:58:16.722296 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-17c8be4f-39ae-489b-870f-a3ce5a9d9b67 req-277e42a1-b486-4e98-91bf-ab3949f028ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065616 Mar 08 04:58:16.723194 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1655/3254] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:58:16.797290 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-2388963e-c6ec-49fe-9372-924f83756038 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:16.798202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-2388963e-c6ec-49fe-9372-924f83756038 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:16.805252 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2388963e-c6ec-49fe-9372-924f83756038 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:16.806057 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2388963e-c6ec-49fe-9372-924f83756038 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:16.806946 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2388963e-c6ec-49fe-9372-924f83756038 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:16.807769 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-2388963e-c6ec-49fe-9372-924f83756038 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:16.962967 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-2388963e-c6ec-49fe-9372-924f83756038 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:16.970983 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-2388963e-c6ec-49fe-9372-924f83756038 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.178308 Mar 08 04:58:16.971554 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1600/3255] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:16 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:16.986549 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b2e53759-11c3-494d-816e-9e354e797b96 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:16.987242 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-b2e53759-11c3-494d-816e-9e354e797b96 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:16.993171 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b2e53759-11c3-494d-816e-9e354e797b96 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:16.993616 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b2e53759-11c3-494d-816e-9e354e797b96 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:16.994402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b2e53759-11c3-494d-816e-9e354e797b96 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:16.994839 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-b2e53759-11c3-494d-816e-9e354e797b96 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:17.008489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-b2e53759-11c3-494d-816e-9e354e797b96 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] HTTP exception thrown: Instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df could not be found. Mar 08 04:58:17.009071 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-b2e53759-11c3-494d-816e-9e354e797b96 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Returning 404 to user: Instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:58:17.009919 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-b2e53759-11c3-494d-816e-9e354e797b96 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 404 len: 111 microversion: 2.20 time: 0.150584 Mar 08 04:58:17.010454 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1656/3256] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:16 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:58:17.019024 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-81debdaa-7ba7-4e03-bd3e-939642de2513 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '.version_select at 0x7fe83387f0d0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:17.022428 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: ERROR oslo.messaging._drivers.impl_rabbit [None req-81debdaa-7ba7-4e03-bd3e-939642de2513 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [92a85ae7-aee2-40fa-9144-c4983af3aace] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 04:58:17.987925 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-339df947-21f5-46e8-8a64-b46e70a784ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:17.988557 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-339df947-21f5-46e8-8a64-b46e70a784ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:17.994504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-339df947-21f5-46e8-8a64-b46e70a784ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:17.994956 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-339df947-21f5-46e8-8a64-b46e70a784ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:17.995710 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-339df947-21f5-46e8-8a64-b46e70a784ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:17.996143 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-339df947-21f5-46e8-8a64-b46e70a784ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:18.030773 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [None req-81debdaa-7ba7-4e03-bd3e-939642de2513 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [92a85ae7-aee2-40fa-9144-c4983af3aace] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 54470. Mar 08 04:58:18.049716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-81debdaa-7ba7-4e03-bd3e-939642de2513 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912814052" status: 204 len: 0 microversion: 2.20 time: 1.034354 Mar 08 04:58:18.050311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1601/3257] 10.222.0.30 () {60 vars in 1261 bytes} [Tue Mar 8 04:58:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912814052 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 04:58:18.134249 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-339df947-21f5-46e8-8a64-b46e70a784ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:18.142968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-339df947-21f5-46e8-8a64-b46e70a784ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.158853 Mar 08 04:58:18.143545 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1657/3258] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:17 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:19.159283 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ac7b4a7a-2573-4829-a920-a36f9c744bd4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:19.159884 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ac7b4a7a-2573-4829-a920-a36f9c744bd4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:19.166932 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac7b4a7a-2573-4829-a920-a36f9c744bd4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:19.167375 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac7b4a7a-2573-4829-a920-a36f9c744bd4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:19.168833 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac7b4a7a-2573-4829-a920-a36f9c744bd4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:19.169268 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac7b4a7a-2573-4829-a920-a36f9c744bd4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:19.298074 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ac7b4a7a-2573-4829-a920-a36f9c744bd4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:19.305160 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ac7b4a7a-2573-4829-a920-a36f9c744bd4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.149810 Mar 08 04:58:19.305736 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1602/3259] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:19 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:19.797974 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-738b58d9-0bd6-45d3-b3a2-e0a8fdb1b306 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:19.798489 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-738b58d9-0bd6-45d3-b3a2-e0a8fdb1b306 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:19.804685 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-738b58d9-0bd6-45d3-b3a2-e0a8fdb1b306 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:19.805140 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-738b58d9-0bd6-45d3-b3a2-e0a8fdb1b306 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:19.805962 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-738b58d9-0bd6-45d3-b3a2-e0a8fdb1b306 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:19.806405 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-738b58d9-0bd6-45d3-b3a2-e0a8fdb1b306 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:19.820080 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-738b58d9-0bd6-45d3-b3a2-e0a8fdb1b306 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] HTTP exception thrown: Instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df could not be found. Mar 08 04:58:19.820672 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-738b58d9-0bd6-45d3-b3a2-e0a8fdb1b306 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Returning 404 to user: Instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:58:19.821485 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-738b58d9-0bd6-45d3-b3a2-e0a8fdb1b306 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 404 len: 111 microversion: 2.20 time: 0.027475 Mar 08 04:58:19.822067 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1658/3260] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 04:58:19 2022] DELETE /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:58:19.830452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-85ab8f19-fa85-4528-95f7-cb7566dc77ac tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:19.831054 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-85ab8f19-fa85-4528-95f7-cb7566dc77ac tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: 47a6e54b-157c-4655-86c9-3d4eefd8f3df] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:19.836741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85ab8f19-fa85-4528-95f7-cb7566dc77ac tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:19.837187 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85ab8f19-fa85-4528-95f7-cb7566dc77ac tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:19.837970 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85ab8f19-fa85-4528-95f7-cb7566dc77ac tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:19.838401 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-85ab8f19-fa85-4528-95f7-cb7566dc77ac tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:19.851742 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-85ab8f19-fa85-4528-95f7-cb7566dc77ac tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] HTTP exception thrown: Instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df could not be found. Mar 08 04:58:19.852326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-85ab8f19-fa85-4528-95f7-cb7566dc77ac tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Returning 404 to user: Instance 47a6e54b-157c-4655-86c9-3d4eefd8f3df could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:58:19.853140 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-85ab8f19-fa85-4528-95f7-cb7566dc77ac tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df" status: 404 len: 111 microversion: 2.20 time: 0.026518 Mar 08 04:58:19.853699 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1603/3261] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:19 2022] GET /compute/v2.1/servers/47a6e54b-157c-4655-86c9-3d4eefd8f3df => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:58:20.322329 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-05e3c415-2546-403c-adbf-96a04f2c7b64 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:20.322930 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-05e3c415-2546-403c-adbf-96a04f2c7b64 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:20.329475 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05e3c415-2546-403c-adbf-96a04f2c7b64 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:20.329942 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05e3c415-2546-403c-adbf-96a04f2c7b64 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:20.330697 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05e3c415-2546-403c-adbf-96a04f2c7b64 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:20.331126 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-05e3c415-2546-403c-adbf-96a04f2c7b64 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:20.458595 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-05e3c415-2546-403c-adbf-96a04f2c7b64 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:20.466413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-05e3c415-2546-403c-adbf-96a04f2c7b64 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.148005 Mar 08 04:58:20.466973 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1659/3262] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:20 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:20.990149 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-585bfd43-bd6a-4066-a555-acfccf6e0a6e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:20.990640 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-585bfd43-bd6a-4066-a555-acfccf6e0a6e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:20.997437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-585bfd43-bd6a-4066-a555-acfccf6e0a6e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:20.997905 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-585bfd43-bd6a-4066-a555-acfccf6e0a6e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:20.998656 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-585bfd43-bd6a-4066-a555-acfccf6e0a6e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:20.999088 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-585bfd43-bd6a-4066-a555-acfccf6e0a6e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:21.012230 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.wsgi [None req-585bfd43-bd6a-4066-a555-acfccf6e0a6e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] HTTP exception thrown: Instance d893a718-bf02-4bf4-a648-27ae785dbfdb could not be found. Mar 08 04:58:21.012805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-585bfd43-bd6a-4066-a555-acfccf6e0a6e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Returning 404 to user: Instance d893a718-bf02-4bf4-a648-27ae785dbfdb could not be found. {{(pid=116775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:58:21.013604 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-585bfd43-bd6a-4066-a555-acfccf6e0a6e tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 404 len: 111 microversion: 2.20 time: 0.027334 Mar 08 04:58:21.014142 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1604/3263] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 04:58:20 2022] DELETE /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:58:21.022308 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-08d5aa06-7099-4748-9cbc-6704e73722d9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:21.022913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-08d5aa06-7099-4748-9cbc-6704e73722d9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] [instance: d893a718-bf02-4bf4-a648-27ae785dbfdb] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:21.029133 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-08d5aa06-7099-4748-9cbc-6704e73722d9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:21.029575 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-08d5aa06-7099-4748-9cbc-6704e73722d9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:21.030359 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-08d5aa06-7099-4748-9cbc-6704e73722d9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:21.030792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-08d5aa06-7099-4748-9cbc-6704e73722d9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:21.044286 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-08d5aa06-7099-4748-9cbc-6704e73722d9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] HTTP exception thrown: Instance d893a718-bf02-4bf4-a648-27ae785dbfdb could not be found. Mar 08 04:58:21.044892 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-08d5aa06-7099-4748-9cbc-6704e73722d9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] Returning 404 to user: Instance d893a718-bf02-4bf4-a648-27ae785dbfdb could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:58:21.045719 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-08d5aa06-7099-4748-9cbc-6704e73722d9 tempest-AttachVolumeShelveTestJSON-1990039571 tempest-AttachVolumeShelveTestJSON-1990039571-project] 10.222.0.30 "GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb" status: 404 len: 111 microversion: 2.20 time: 0.027433 Mar 08 04:58:21.046232 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1660/3264] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 04:58:21 2022] GET /compute/v2.1/servers/d893a718-bf02-4bf4-a648-27ae785dbfdb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 04:58:21.483394 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-809b551f-6b5b-4165-909c-91e513b046fe tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:21.484003 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-809b551f-6b5b-4165-909c-91e513b046fe tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:21.489751 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-809b551f-6b5b-4165-909c-91e513b046fe tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:21.490205 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-809b551f-6b5b-4165-909c-91e513b046fe tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:21.490969 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-809b551f-6b5b-4165-909c-91e513b046fe tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:21.491410 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-809b551f-6b5b-4165-909c-91e513b046fe tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:21.707214 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-809b551f-6b5b-4165-909c-91e513b046fe tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:21.714538 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-809b551f-6b5b-4165-909c-91e513b046fe tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.235140 Mar 08 04:58:21.715651 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1605/3265] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:21 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:22.732180 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-958de807-0954-452f-8542-f820269e8b2b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:22.732828 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-958de807-0954-452f-8542-f820269e8b2b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:22.739345 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-958de807-0954-452f-8542-f820269e8b2b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:22.740032 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-958de807-0954-452f-8542-f820269e8b2b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:22.740946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-958de807-0954-452f-8542-f820269e8b2b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:22.741529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-958de807-0954-452f-8542-f820269e8b2b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:22.897550 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-958de807-0954-452f-8542-f820269e8b2b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:22.906589 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-958de807-0954-452f-8542-f820269e8b2b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.178548 Mar 08 04:58:22.907173 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1661/3266] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:22 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:23.230839 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-30b0f103-961f-463d-b56d-425f35ea359b req-f5dcc849-99b3-460b-90ec-c413540957d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d454cf-c4e3-45fe-9407-cb49752bfa71", "name": "network-vif-plugged", "status": "completed", "tag": "6fa8be19-cf26-4273-b6fc-a50481196e32"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:58:23.240562 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-30b0f103-961f-463d-b56d-425f35ea359b req-f5dcc849-99b3-460b-90ec-c413540957d5 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:23.241737 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-30b0f103-961f-463d-b56d-425f35ea359b req-f5dcc849-99b3-460b-90ec-c413540957d5 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:23.258067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-30b0f103-961f-463d-b56d-425f35ea359b req-f5dcc849-99b3-460b-90ec-c413540957d5 service nova] Creating event network-vif-plugged:6fa8be19-cf26-4273-b6fc-a50481196e32 for instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 on hv-cinder-73306 Mar 08 04:58:23.264040 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-30b0f103-961f-463d-b56d-425f35ea359b req-f5dcc849-99b3-460b-90ec-c413540957d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037715 Mar 08 04:58:23.265324 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1606/3267] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:58:23.924181 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-33dced6c-4d97-4b11-9fdb-84f74c70081b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:23.924792 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-33dced6c-4d97-4b11-9fdb-84f74c70081b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:23.931092 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33dced6c-4d97-4b11-9fdb-84f74c70081b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:23.931523 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33dced6c-4d97-4b11-9fdb-84f74c70081b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:23.932300 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33dced6c-4d97-4b11-9fdb-84f74c70081b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:23.932734 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-33dced6c-4d97-4b11-9fdb-84f74c70081b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:24.074529 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-33dced6c-4d97-4b11-9fdb-84f74c70081b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:24.082279 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-33dced6c-4d97-4b11-9fdb-84f74c70081b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1358 microversion: 2.1 time: 0.162223 Mar 08 04:58:24.083163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1662/3268] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:23 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:25.100437 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-ac6f6450-a1e1-4e57-b736-7519bd8cbcbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:25.101129 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-ac6f6450-a1e1-4e57-b736-7519bd8cbcbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:25.107175 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac6f6450-a1e1-4e57-b736-7519bd8cbcbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:25.107622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac6f6450-a1e1-4e57-b736-7519bd8cbcbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:25.108378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac6f6450-a1e1-4e57-b736-7519bd8cbcbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:25.108809 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-ac6f6450-a1e1-4e57-b736-7519bd8cbcbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:25.244852 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-ac6f6450-a1e1-4e57-b736-7519bd8cbcbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:25.252681 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-ac6f6450-a1e1-4e57-b736-7519bd8cbcbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1549 microversion: 2.1 time: 0.156852 Mar 08 04:58:25.253320 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1607/3269] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:25 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:25.269128 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-594a0aa5-31d8-4234-b5e9-6e0300865541 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:25.269762 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-594a0aa5-31d8-4234-b5e9-6e0300865541 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:25.276107 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-594a0aa5-31d8-4234-b5e9-6e0300865541 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:25.276558 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-594a0aa5-31d8-4234-b5e9-6e0300865541 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:25.277653 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-594a0aa5-31d8-4234-b5e9-6e0300865541 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:25.278114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-594a0aa5-31d8-4234-b5e9-6e0300865541 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:25.417127 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-594a0aa5-31d8-4234-b5e9-6e0300865541 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:25.426002 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-594a0aa5-31d8-4234-b5e9-6e0300865541 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1549 microversion: 2.1 time: 0.160634 Mar 08 04:58:25.426984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1663/3270] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:25 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:25.443126 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-13eab225-20e2-42fa-a7d2-830ba8d73b22 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:25.446568 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-13eab225-20e2-42fa-a7d2-830ba8d73b22 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:25.447378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-13eab225-20e2-42fa-a7d2-830ba8d73b22 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Searching by: {'deleted': False, 'project_id': '807ac91ba3104c2dbaf341f434162817'} {{(pid=116775) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 08 04:58:25.453855 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13eab225-20e2-42fa-a7d2-830ba8d73b22 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:25.454272 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13eab225-20e2-42fa-a7d2-830ba8d73b22 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:25.455068 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13eab225-20e2-42fa-a7d2-830ba8d73b22 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:25.455502 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-13eab225-20e2-42fa-a7d2-830ba8d73b22 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:25.551100 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.multi_cell_list [None req-13eab225-20e2-42fa-a7d2-830ba8d73b22 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116775) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 08 04:58:25.645644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-13eab225-20e2-42fa-a7d2-830ba8d73b22 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206311 Mar 08 04:58:25.646243 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1608/3271] 10.222.0.30 () {58 vars in 1124 bytes} [Tue Mar 8 04:58:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:58:25.658866 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7a6e714b-b301-49db-aac2-7ed166a7c0ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:25.659547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7a6e714b-b301-49db-aac2-7ed166a7c0ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:25.665402 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a6e714b-b301-49db-aac2-7ed166a7c0ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:25.665976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a6e714b-b301-49db-aac2-7ed166a7c0ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:25.666840 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a6e714b-b301-49db-aac2-7ed166a7c0ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:25.668086 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7a6e714b-b301-49db-aac2-7ed166a7c0ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:25.814530 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7a6e714b-b301-49db-aac2-7ed166a7c0ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:25.826252 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7a6e714b-b301-49db-aac2-7ed166a7c0ee tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1549 microversion: 2.1 time: 0.171184 Mar 08 04:58:25.827108 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1664/3272] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:25 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:27.375155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-5417656d-c5cc-4f49-b2fb-a21c0c91710d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a715480-8a5f-45dc-b097-b65f41652631"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:58:27.376263 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-5417656d-c5cc-4f49-b2fb-a21c0c91710d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:27.382406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5417656d-c5cc-4f49-b2fb-a21c0c91710d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:27.383092 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5417656d-c5cc-4f49-b2fb-a21c0c91710d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:27.383853 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5417656d-c5cc-4f49-b2fb-a21c0c91710d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:27.384282 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-5417656d-c5cc-4f49-b2fb-a21c0c91710d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:27.626942 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-5417656d-c5cc-4f49-b2fb-a21c0c91710d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "POST /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255627 Mar 08 04:58:27.627636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1609/3273] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 04:58:27 2022] POST /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:58:34.120503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-afc63d02-d693-4dea-966b-db27bb227086 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:34.121747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-afc63d02-d693-4dea-966b-db27bb227086 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:34.128074 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afc63d02-d693-4dea-966b-db27bb227086 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:34.128515 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afc63d02-d693-4dea-966b-db27bb227086 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:34.129266 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afc63d02-d693-4dea-966b-db27bb227086 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:34.129715 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-afc63d02-d693-4dea-966b-db27bb227086 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:34.261313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-afc63d02-d693-4dea-966b-db27bb227086 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:34.269082 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-afc63d02-d693-4dea-966b-db27bb227086 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1595 microversion: 2.1 time: 0.152710 Mar 08 04:58:34.269637 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1665/3274] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:34 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:36.239063 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-38341d88-91c4-4b3f-8760-c4828583ab61 req-5631e08b-96be-4cb6-bdae-445ceb5f0946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d454cf-c4e3-45fe-9407-cb49752bfa71", "tag": "6fa8be19-cf26-4273-b6fc-a50481196e32"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:58:36.248565 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-38341d88-91c4-4b3f-8760-c4828583ab61 req-5631e08b-96be-4cb6-bdae-445ceb5f0946 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:36.249295 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-38341d88-91c4-4b3f-8760-c4828583ab61 req-5631e08b-96be-4cb6-bdae-445ceb5f0946 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:36.260415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-38341d88-91c4-4b3f-8760-c4828583ab61 req-5631e08b-96be-4cb6-bdae-445ceb5f0946 service nova] Creating event network-changed:6fa8be19-cf26-4273-b6fc-a50481196e32 for instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 on hv-cinder-73306 Mar 08 04:58:36.266592 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-38341d88-91c4-4b3f-8760-c4828583ab61 req-5631e08b-96be-4cb6-bdae-445ceb5f0946 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032616 Mar 08 04:58:36.267223 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1610/3275] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:58:37.456767 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-27ac1f95-9d8e-43bb-82b6-c75db90387c4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1913470066"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:58:37.457397 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-27ac1f95-9d8e-43bb-82b6-c75db90387c4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:37.463495 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27ac1f95-9d8e-43bb-82b6-c75db90387c4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:37.463945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27ac1f95-9d8e-43bb-82b6-c75db90387c4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:37.464760 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27ac1f95-9d8e-43bb-82b6-c75db90387c4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:37.465344 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-27ac1f95-9d8e-43bb-82b6-c75db90387c4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:37.602583 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.network.security_group_api [None req-27ac1f95-9d8e-43bb-82b6-c75db90387c4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Adding security group 602d4f7d-86a1-4aae-84c0-2de461066625 to port 6fa8be19-cf26-4273-b6fc-a50481196e32 Mar 08 04:58:37.998587 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-27ac1f95-9d8e-43bb-82b6-c75db90387c4 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "POST /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/action" status: 202 len: 0 microversion: 2.1 time: 0.545583 Mar 08 04:58:37.999192 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1666/3276] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:58:37 2022] POST /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:58:38.008716 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7f51e080-3784-4cfa-9517-0c3aa0cf7f0b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:58:38.010006 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7f51e080-3784-4cfa-9517-0c3aa0cf7f0b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:58:38.018321 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f51e080-3784-4cfa-9517-0c3aa0cf7f0b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:38.018762 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f51e080-3784-4cfa-9517-0c3aa0cf7f0b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:38.019741 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f51e080-3784-4cfa-9517-0c3aa0cf7f0b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:38.020171 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7f51e080-3784-4cfa-9517-0c3aa0cf7f0b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:38.212287 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7f51e080-3784-4cfa-9517-0c3aa0cf7f0b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:58:38.224870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7f51e080-3784-4cfa-9517-0c3aa0cf7f0b tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1761 microversion: 2.1 time: 0.221155 Mar 08 04:58:38.225452 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1611/3277] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:58:38 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1761 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:58:38.282847 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-12dbda89-1996-4c0c-889d-ba87af18355d req-727557c1-b249-4b18-97e3-9154bbe7c89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d454cf-c4e3-45fe-9407-cb49752bfa71", "tag": "6fa8be19-cf26-4273-b6fc-a50481196e32"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:58:38.290863 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-12dbda89-1996-4c0c-889d-ba87af18355d req-727557c1-b249-4b18-97e3-9154bbe7c89f service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:58:38.291325 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-12dbda89-1996-4c0c-889d-ba87af18355d req-727557c1-b249-4b18-97e3-9154bbe7c89f service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:58:38.302394 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-12dbda89-1996-4c0c-889d-ba87af18355d req-727557c1-b249-4b18-97e3-9154bbe7c89f service nova] Creating event network-changed:6fa8be19-cf26-4273-b6fc-a50481196e32 for instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 on hv-cinder-73306 Mar 08 04:58:38.307438 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-12dbda89-1996-4c0c-889d-ba87af18355d req-727557c1-b249-4b18-97e3-9154bbe7c89f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028370 Mar 08 04:58:38.308149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1667/3278] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:59:00.763611 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-02af233e-74d9-4ccb-a4a9-6c24a21891c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:59:00.764545 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-02af233e-74d9-4ccb-a4a9-6c24a21891c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:00.770712 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-02af233e-74d9-4ccb-a4a9-6c24a21891c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:00.771153 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-02af233e-74d9-4ccb-a4a9-6c24a21891c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:00.771902 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-02af233e-74d9-4ccb-a4a9-6c24a21891c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:00.772331 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-02af233e-74d9-4ccb-a4a9-6c24a21891c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:00.840350 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-02af233e-74d9-4ccb-a4a9-6c24a21891c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "POST /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/action" status: 202 len: 0 microversion: 2.1 time: 0.080811 Mar 08 04:59:00.840963 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1612/3279] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:59:00 2022] POST /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:59:00.850214 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-14cb76b3-c482-42c1-bdac-919621b4ee5c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:00.851747 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-14cb76b3-c482-42c1-bdac-919621b4ee5c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:00.858785 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14cb76b3-c482-42c1-bdac-919621b4ee5c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:00.859229 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14cb76b3-c482-42c1-bdac-919621b4ee5c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:00.860004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14cb76b3-c482-42c1-bdac-919621b4ee5c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:00.860417 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-14cb76b3-c482-42c1-bdac-919621b4ee5c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:01.012864 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-14cb76b3-c482-42c1-bdac-919621b4ee5c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:01.020722 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-14cb76b3-c482-42c1-bdac-919621b4ee5c tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1753 microversion: 2.1 time: 0.175275 Mar 08 04:59:01.021429 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1668/3280] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:00 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:02.038818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-b4f84d12-37dd-432e-8ca2-a97025f4c06a tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:02.039506 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-b4f84d12-37dd-432e-8ca2-a97025f4c06a tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:02.046900 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4f84d12-37dd-432e-8ca2-a97025f4c06a tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:02.047345 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4f84d12-37dd-432e-8ca2-a97025f4c06a tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:02.078639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4f84d12-37dd-432e-8ca2-a97025f4c06a tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:02.078639 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-b4f84d12-37dd-432e-8ca2-a97025f4c06a tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:02.199759 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-b4f84d12-37dd-432e-8ca2-a97025f4c06a tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:02.207378 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-b4f84d12-37dd-432e-8ca2-a97025f4c06a tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.173165 Mar 08 04:59:02.207941 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1613/3281] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:02 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:03.225510 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-7d67aa69-96c8-41d7-97e2-151f82b424e6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:03.226166 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-7d67aa69-96c8-41d7-97e2-151f82b424e6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:03.232968 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d67aa69-96c8-41d7-97e2-151f82b424e6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:03.233413 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d67aa69-96c8-41d7-97e2-151f82b424e6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:03.234191 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d67aa69-96c8-41d7-97e2-151f82b424e6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:03.234634 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-7d67aa69-96c8-41d7-97e2-151f82b424e6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:03.377787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-7d67aa69-96c8-41d7-97e2-151f82b424e6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:03.385814 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-7d67aa69-96c8-41d7-97e2-151f82b424e6 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.163755 Mar 08 04:59:03.386385 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1669/3282] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:03 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:04.402915 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-eb6e59e8-c482-45cc-aa8b-50c03071b0c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:04.403515 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-eb6e59e8-c482-45cc-aa8b-50c03071b0c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:04.409621 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb6e59e8-c482-45cc-aa8b-50c03071b0c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:04.410112 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb6e59e8-c482-45cc-aa8b-50c03071b0c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:04.410870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb6e59e8-c482-45cc-aa8b-50c03071b0c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:04.411303 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-eb6e59e8-c482-45cc-aa8b-50c03071b0c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:04.615938 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-eb6e59e8-c482-45cc-aa8b-50c03071b0c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:04.624152 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-eb6e59e8-c482-45cc-aa8b-50c03071b0c9 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.225013 Mar 08 04:59:04.624730 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1614/3283] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:04 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:05.640915 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-67743f79-c3ed-42d6-b5b4-957199799392 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:05.641514 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-67743f79-c3ed-42d6-b5b4-957199799392 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:05.652412 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67743f79-c3ed-42d6-b5b4-957199799392 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:05.652859 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67743f79-c3ed-42d6-b5b4-957199799392 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:05.653689 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67743f79-c3ed-42d6-b5b4-957199799392 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:05.654136 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-67743f79-c3ed-42d6-b5b4-957199799392 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:05.806453 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-67743f79-c3ed-42d6-b5b4-957199799392 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:05.817758 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-67743f79-c3ed-42d6-b5b4-957199799392 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.180590 Mar 08 04:59:05.827342 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1670/3284] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:05 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:06.834925 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0f1dd8a8-25f9-48d4-8102-f86e209e6160 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:06.835536 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0f1dd8a8-25f9-48d4-8102-f86e209e6160 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:06.841749 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f1dd8a8-25f9-48d4-8102-f86e209e6160 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:06.842415 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f1dd8a8-25f9-48d4-8102-f86e209e6160 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:06.843181 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f1dd8a8-25f9-48d4-8102-f86e209e6160 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:06.843619 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0f1dd8a8-25f9-48d4-8102-f86e209e6160 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:06.995202 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0f1dd8a8-25f9-48d4-8102-f86e209e6160 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:07.003225 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0f1dd8a8-25f9-48d4-8102-f86e209e6160 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.172229 Mar 08 04:59:07.004030 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1615/3285] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:06 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:08.020745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bd3acda2-8d7f-4e38-84eb-6193b9e512e8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:08.021299 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bd3acda2-8d7f-4e38-84eb-6193b9e512e8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:08.027889 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd3acda2-8d7f-4e38-84eb-6193b9e512e8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:08.028347 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd3acda2-8d7f-4e38-84eb-6193b9e512e8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:08.029111 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd3acda2-8d7f-4e38-84eb-6193b9e512e8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:08.029548 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bd3acda2-8d7f-4e38-84eb-6193b9e512e8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:08.195784 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bd3acda2-8d7f-4e38-84eb-6193b9e512e8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:08.204431 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bd3acda2-8d7f-4e38-84eb-6193b9e512e8 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.187601 Mar 08 04:59:08.205162 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1671/3286] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:08 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:09.221701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-28654eae-0a40-4007-8b13-d822249cac4f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:09.222387 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-28654eae-0a40-4007-8b13-d822249cac4f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:09.228719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28654eae-0a40-4007-8b13-d822249cac4f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:09.229469 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28654eae-0a40-4007-8b13-d822249cac4f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:09.230269 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28654eae-0a40-4007-8b13-d822249cac4f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:09.230701 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-28654eae-0a40-4007-8b13-d822249cac4f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:09.544870 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-28654eae-0a40-4007-8b13-d822249cac4f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:09.552466 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-28654eae-0a40-4007-8b13-d822249cac4f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.334589 Mar 08 04:59:09.553025 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1616/3287] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:09 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:10.570146 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-bb68ea04-c2d0-4b0f-927b-44734e6943f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:10.570779 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-bb68ea04-c2d0-4b0f-927b-44734e6943f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:10.577060 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb68ea04-c2d0-4b0f-927b-44734e6943f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:10.577504 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb68ea04-c2d0-4b0f-927b-44734e6943f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:10.578301 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb68ea04-c2d0-4b0f-927b-44734e6943f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:10.578736 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-bb68ea04-c2d0-4b0f-927b-44734e6943f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:10.779374 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-bb68ea04-c2d0-4b0f-927b-44734e6943f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:10.786991 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-bb68ea04-c2d0-4b0f-927b-44734e6943f2 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.220672 Mar 08 04:59:10.787556 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1672/3288] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:10 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:11.804498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-dc2516e0-e3d0-4b69-b876-64344b8472e0 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:11.805076 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-dc2516e0-e3d0-4b69-b876-64344b8472e0 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:11.811305 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc2516e0-e3d0-4b69-b876-64344b8472e0 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:11.811743 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc2516e0-e3d0-4b69-b876-64344b8472e0 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:11.812494 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc2516e0-e3d0-4b69-b876-64344b8472e0 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:11.812919 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-dc2516e0-e3d0-4b69-b876-64344b8472e0 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:11.958406 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-dc2516e0-e3d0-4b69-b876-64344b8472e0 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:11.966794 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-dc2516e0-e3d0-4b69-b876-64344b8472e0 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.166138 Mar 08 04:59:11.967356 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1617/3289] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:11 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:12.984547 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-161ded0b-01fd-47a9-85f7-36b7f897d5cf tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:12.985157 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-161ded0b-01fd-47a9-85f7-36b7f897d5cf tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:12.991533 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-161ded0b-01fd-47a9-85f7-36b7f897d5cf tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:12.991984 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-161ded0b-01fd-47a9-85f7-36b7f897d5cf tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:12.992742 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-161ded0b-01fd-47a9-85f7-36b7f897d5cf tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:12.993178 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-161ded0b-01fd-47a9-85f7-36b7f897d5cf tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:13.137355 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-161ded0b-01fd-47a9-85f7-36b7f897d5cf tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:13.145114 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-161ded0b-01fd-47a9-85f7-36b7f897d5cf tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.164419 Mar 08 04:59:13.145695 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1673/3290] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:12 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:14.165248 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-0dfe061d-984a-43e0-be50-10e5abebec84 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:14.165888 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-0dfe061d-984a-43e0-be50-10e5abebec84 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:14.172909 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0dfe061d-984a-43e0-be50-10e5abebec84 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:14.173357 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0dfe061d-984a-43e0-be50-10e5abebec84 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:14.174155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0dfe061d-984a-43e0-be50-10e5abebec84 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:14.174590 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-0dfe061d-984a-43e0-be50-10e5abebec84 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:14.320009 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-0dfe061d-984a-43e0-be50-10e5abebec84 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:14.328459 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-0dfe061d-984a-43e0-be50-10e5abebec84 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.167073 Mar 08 04:59:14.329021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1618/3291] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:14 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:15.346295 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-f42c88c7-af30-415e-bc79-54fec7eba986 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:15.346912 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-f42c88c7-af30-415e-bc79-54fec7eba986 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:15.353188 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f42c88c7-af30-415e-bc79-54fec7eba986 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:15.354278 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f42c88c7-af30-415e-bc79-54fec7eba986 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:15.355045 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f42c88c7-af30-415e-bc79-54fec7eba986 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:15.355477 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-f42c88c7-af30-415e-bc79-54fec7eba986 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:15.495163 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-f42c88c7-af30-415e-bc79-54fec7eba986 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:15.502812 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-f42c88c7-af30-415e-bc79-54fec7eba986 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.161124 Mar 08 04:59:15.503367 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1674/3292] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:15 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:16.523299 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-7e0665b3-bb1c-43ca-bc36-471d51792a41 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:16.523907 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-7e0665b3-bb1c-43ca-bc36-471d51792a41 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:16.530831 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e0665b3-bb1c-43ca-bc36-471d51792a41 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:16.531275 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e0665b3-bb1c-43ca-bc36-471d51792a41 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:16.532031 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e0665b3-bb1c-43ca-bc36-471d51792a41 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:16.532463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-7e0665b3-bb1c-43ca-bc36-471d51792a41 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:16.674498 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-7e0665b3-bb1c-43ca-bc36-471d51792a41 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:16.682777 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-7e0665b3-bb1c-43ca-bc36-471d51792a41 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.163326 Mar 08 04:59:16.683332 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1619/3293] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:16 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:17.700019 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-308dee81-6b11-4349-baba-162b7b8de1a5 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:17.700627 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-308dee81-6b11-4349-baba-162b7b8de1a5 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:17.706945 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-308dee81-6b11-4349-baba-162b7b8de1a5 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:17.707390 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-308dee81-6b11-4349-baba-162b7b8de1a5 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:17.708149 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-308dee81-6b11-4349-baba-162b7b8de1a5 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:17.708585 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-308dee81-6b11-4349-baba-162b7b8de1a5 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:17.862740 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-308dee81-6b11-4349-baba-162b7b8de1a5 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:17.871021 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-308dee81-6b11-4349-baba-162b7b8de1a5 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1758 microversion: 2.1 time: 0.174790 Mar 08 04:59:17.871745 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1675/3294] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:17 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:18.891021 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-683c2053-5fd7-4bf7-88cb-142d00981133 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:18.891624 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-683c2053-5fd7-4bf7-88cb-142d00981133 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:18.897966 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-683c2053-5fd7-4bf7-88cb-142d00981133 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:18.898420 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-683c2053-5fd7-4bf7-88cb-142d00981133 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:18.899174 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-683c2053-5fd7-4bf7-88cb-142d00981133 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:18.899606 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-683c2053-5fd7-4bf7-88cb-142d00981133 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:19.041396 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-683c2053-5fd7-4bf7-88cb-142d00981133 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:19.049713 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-683c2053-5fd7-4bf7-88cb-142d00981133 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1761 microversion: 2.1 time: 0.162494 Mar 08 04:59:19.050286 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1620/3295] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:18 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1761 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:51.105633 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-6ca31581-887a-47d6-8bcf-5a7593596ead tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1913470066"}} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:59:51.106189 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-6ca31581-887a-47d6-8bcf-5a7593596ead tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:51.112179 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ca31581-887a-47d6-8bcf-5a7593596ead tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:51.112632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ca31581-887a-47d6-8bcf-5a7593596ead tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:51.113399 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ca31581-887a-47d6-8bcf-5a7593596ead tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:51.114003 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-6ca31581-887a-47d6-8bcf-5a7593596ead tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:51.246461 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.network.security_group_api [None req-6ca31581-887a-47d6-8bcf-5a7593596ead tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Removing security group 602d4f7d-86a1-4aae-84c0-2de461066625 from port 6fa8be19-cf26-4273-b6fc-a50481196e32 Mar 08 04:59:51.576239 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-6ca31581-887a-47d6-8bcf-5a7593596ead tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "POST /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/action" status: 202 len: 0 microversion: 2.1 time: 0.474713 Mar 08 04:59:51.576846 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1676/3296] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 04:59:51 2022] POST /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:59:51.586109 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [req-a9863425-dfa9-442f-a19f-234e48723e14 req-8c554e9e-b105-4be3-a913-2ca102c5df44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d454cf-c4e3-45fe-9407-cb49752bfa71", "tag": "6fa8be19-cf26-4273-b6fc-a50481196e32"}]} {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:59:51.607346 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-a9863425-dfa9-442f-a19f-234e48723e14 req-8c554e9e-b105-4be3-a913-2ca102c5df44 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:51.608058 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [req-a9863425-dfa9-442f-a19f-234e48723e14 req-8c554e9e-b105-4be3-a913-2ca102c5df44 service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:51.623612 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.compute.server_external_events [req-a9863425-dfa9-442f-a19f-234e48723e14 req-8c554e9e-b105-4be3-a913-2ca102c5df44 service nova] Creating event network-changed:6fa8be19-cf26-4273-b6fc-a50481196e32 for instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 on hv-cinder-73306 Mar 08 04:59:51.629465 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [req-a9863425-dfa9-442f-a19f-234e48723e14 req-8c554e9e-b105-4be3-a913-2ca102c5df44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046860 Mar 08 04:59:51.630644 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1621/3297] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:59:52.995972 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-76d9190b-2fba-4ead-9478-d2e8893c413d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:52.996554 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-76d9190b-2fba-4ead-9478-d2e8893c413d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:53.002497 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76d9190b-2fba-4ead-9478-d2e8893c413d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:53.002946 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76d9190b-2fba-4ead-9478-d2e8893c413d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:53.003712 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76d9190b-2fba-4ead-9478-d2e8893c413d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:53.004147 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-76d9190b-2fba-4ead-9478-d2e8893c413d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:53.082331 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.objects.instance [None req-76d9190b-2fba-4ead-9478-d2e8893c413d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lazy-loading 'services' on Instance uuid f0d454cf-c4e3-45fe-9407-cb49752bfa71 {{(pid=116774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:59:53.153046 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-76d9190b-2fba-4ead-9478-d2e8893c413d tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments/2a715480-8a5f-45dc-b097-b65f41652631" status: 202 len: 0 microversion: 2.1 time: 0.161526 Mar 08 04:59:53.153632 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1677/3298] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:59:52 2022] DELETE /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments/2a715480-8a5f-45dc-b097-b65f41652631 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 04:59:53.163570 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-30f36f6a-aec1-4ec5-9a04-73ebb1121dbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:53.164591 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-30f36f6a-aec1-4ec5-9a04-73ebb1121dbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:53.180082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-30f36f6a-aec1-4ec5-9a04-73ebb1121dbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:53.180082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-30f36f6a-aec1-4ec5-9a04-73ebb1121dbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:53.180082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-30f36f6a-aec1-4ec5-9a04-73ebb1121dbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:53.180082 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-30f36f6a-aec1-4ec5-9a04-73ebb1121dbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:53.210023 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-30f36f6a-aec1-4ec5-9a04-73ebb1121dbc tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051564 Mar 08 04:59:53.216080 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1622/3299] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:59:53 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 04:59:53.645744 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-34faa907-a4bb-4930-a7f6-ffa3214de8f7 req-8cda7147-f065-4205-8ddf-4bdda44ab0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d454cf-c4e3-45fe-9407-cb49752bfa71", "tag": "6fa8be19-cf26-4273-b6fc-a50481196e32"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:59:53.654798 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-34faa907-a4bb-4930-a7f6-ffa3214de8f7 req-8cda7147-f065-4205-8ddf-4bdda44ab0cf service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:53.655376 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-34faa907-a4bb-4930-a7f6-ffa3214de8f7 req-8cda7147-f065-4205-8ddf-4bdda44ab0cf service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:53.667034 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-34faa907-a4bb-4930-a7f6-ffa3214de8f7 req-8cda7147-f065-4205-8ddf-4bdda44ab0cf service nova] Creating event network-changed:6fa8be19-cf26-4273-b6fc-a50481196e32 for instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 on hv-cinder-73306 Mar 08 04:59:53.672182 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-34faa907-a4bb-4930-a7f6-ffa3214de8f7 req-8cda7147-f065-4205-8ddf-4bdda44ab0cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030613 Mar 08 04:59:53.672976 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1678/3300] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:59:54.223987 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-95389ce6-ed64-4376-9ca6-a979f1d3f095 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:54.224921 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-95389ce6-ed64-4376-9ca6-a979f1d3f095 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:54.231289 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95389ce6-ed64-4376-9ca6-a979f1d3f095 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:54.231679 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95389ce6-ed64-4376-9ca6-a979f1d3f095 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:54.232438 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95389ce6-ed64-4376-9ca6-a979f1d3f095 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:54.232869 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-95389ce6-ed64-4376-9ca6-a979f1d3f095 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:54.259744 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-95389ce6-ed64-4376-9ca6-a979f1d3f095 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039748 Mar 08 04:59:54.260549 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1623/3301] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 04:59:54 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 04:59:54.271983 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a601bfd7-bbe2-4369-a6f1-2d0306f7e0d3 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:54.272641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-a601bfd7-bbe2-4369-a6f1-2d0306f7e0d3 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:54.279277 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a601bfd7-bbe2-4369-a6f1-2d0306f7e0d3 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:54.279731 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a601bfd7-bbe2-4369-a6f1-2d0306f7e0d3 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:54.280503 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a601bfd7-bbe2-4369-a6f1-2d0306f7e0d3 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:54.280943 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-a601bfd7-bbe2-4369-a6f1-2d0306f7e0d3 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:54.353234 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-a601bfd7-bbe2-4369-a6f1-2d0306f7e0d3 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] HTTP exception thrown: Instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 is not attached to volume 2a715480-8a5f-45dc-b097-b65f41652631 Mar 08 04:59:54.353893 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-a601bfd7-bbe2-4369-a6f1-2d0306f7e0d3 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Returning 404 to user: Instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 is not attached to volume 2a715480-8a5f-45dc-b097-b65f41652631 {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:59:54.355354 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-a601bfd7-bbe2-4369-a6f1-2d0306f7e0d3 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments/2a715480-8a5f-45dc-b097-b65f41652631" status: 404 len: 154 microversion: 2.1 time: 0.087605 Mar 08 04:59:54.355913 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1679/3302] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 04:59:54 2022] DELETE /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71/os-volume_attachments/2a715480-8a5f-45dc-b097-b65f41652631 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:59:55.486622 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-c5810845-9eb6-4717-854f-f86f25d26c24 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:55.487128 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c5810845-9eb6-4717-854f-f86f25d26c24 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:55.493155 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5810845-9eb6-4717-854f-f86f25d26c24 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:55.493602 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5810845-9eb6-4717-854f-f86f25d26c24 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:55.494379 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5810845-9eb6-4717-854f-f86f25d26c24 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:55.494805 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-c5810845-9eb6-4717-854f-f86f25d26c24 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:55.517818 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-c5810845-9eb6-4717-854f-f86f25d26c24 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Going to try to terminate instance {{(pid=116775) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 04:59:55.589924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-c5810845-9eb6-4717-854f-f86f25d26c24 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 204 len: 0 microversion: 2.1 time: 0.106049 Mar 08 04:59:55.590719 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1624/3303] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 04:59:55 2022] DELETE /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 04:59:55.598764 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-84ae1fd8-bd9c-4d3c-97cb-9b662f0087ba tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:55.599376 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-84ae1fd8-bd9c-4d3c-97cb-9b662f0087ba tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:55.606360 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-84ae1fd8-bd9c-4d3c-97cb-9b662f0087ba tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:55.606808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-84ae1fd8-bd9c-4d3c-97cb-9b662f0087ba tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:55.607568 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-84ae1fd8-bd9c-4d3c-97cb-9b662f0087ba tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:55.608004 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-84ae1fd8-bd9c-4d3c-97cb-9b662f0087ba tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:55.741787 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.policy [None req-84ae1fd8-bd9c-4d3c-97cb-9b662f0087ba tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116774) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:55.749377 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-84ae1fd8-bd9c-4d3c-97cb-9b662f0087ba tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1555 microversion: 2.1 time: 0.154447 Mar 08 04:59:55.749975 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1680/3304] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:55 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:56.767313 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-533b7b04-901d-4433-857a-805a065ad5df tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:56.768311 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-533b7b04-901d-4433-857a-805a065ad5df tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:56.774676 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-533b7b04-901d-4433-857a-805a065ad5df tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:56.775132 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-533b7b04-901d-4433-857a-805a065ad5df tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:56.775896 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-533b7b04-901d-4433-857a-805a065ad5df tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:56.776365 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-533b7b04-901d-4433-857a-805a065ad5df tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:56.906326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-533b7b04-901d-4433-857a-805a065ad5df tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:56.913585 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-533b7b04-901d-4433-857a-805a065ad5df tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1555 microversion: 2.1 time: 0.150532 Mar 08 04:59:56.914185 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1625/3305] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:56 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 04:59:57.751819 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [req-79dd5285-7271-477b-8ae6-81ea4dcb92d6 req-6262f33d-428b-413c-a0cc-10f3b1a8effe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d454cf-c4e3-45fe-9407-cb49752bfa71", "name": "network-vif-deleted", "tag": "6fa8be19-cf26-4273-b6fc-a50481196e32"}]} {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 04:59:57.760532 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-79dd5285-7271-477b-8ae6-81ea4dcb92d6 req-6262f33d-428b-413c-a0cc-10f3b1a8effe service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:57.760970 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [req-79dd5285-7271-477b-8ae6-81ea4dcb92d6 req-6262f33d-428b-413c-a0cc-10f3b1a8effe service nova] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:57.772940 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.compute.server_external_events [req-79dd5285-7271-477b-8ae6-81ea4dcb92d6 req-6262f33d-428b-413c-a0cc-10f3b1a8effe service nova] Creating event network-vif-deleted:6fa8be19-cf26-4273-b6fc-a50481196e32 for instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 on hv-cinder-73306 Mar 08 04:59:57.778534 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [req-79dd5285-7271-477b-8ae6-81ea4dcb92d6 req-6262f33d-428b-413c-a0cc-10f3b1a8effe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030339 Mar 08 04:59:57.779209 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1681/3306] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 04:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 04:59:57.932521 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:57.933226 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.compute.api [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116775) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:57.940516 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:57.940968 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:57.941760 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:57.942201 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:57.971004 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:57.971377 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG oslo_concurrency.lockutils [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:57.971826 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.objects.instance [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lazy-loading 'fault' on Instance uuid f0d454cf-c4e3-45fe-9407-cb49752bfa71 {{(pid=116775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 04:59:58.010361 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.policy [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73ba65b532b4bf98c7ed393be343713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807ac91ba3104c2dbaf341f434162817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116775) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 04:59:58.018398 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-31ca2dd4-2768-41b5-8bb1-03a76bf97ed1 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 200 len: 1348 microversion: 2.1 time: 0.090324 Mar 08 04:59:58.019326 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1626/3307] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:57 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 04:59:59.036516 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4c7179e7-ec7d-43a4-adf5-3d689d41858f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '>' {{(pid=116774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:59.037175 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.compute.api [None req-4c7179e7-ec7d-43a4-adf5-3d689d41858f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] [instance: f0d454cf-c4e3-45fe-9407-cb49752bfa71] Fetching instance by UUID {{(pid=116774) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 04:59:59.043641 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c7179e7-ec7d-43a4-adf5-3d689d41858f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:59.044099 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c7179e7-ec7d-43a4-adf5-3d689d41858f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:59.044870 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c7179e7-ec7d-43a4-adf5-3d689d41858f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 04:59:59.045313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG oslo_concurrency.lockutils [None req-4c7179e7-ec7d-43a4-adf5-3d689d41858f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Lock "33a7eb4f-1be8-4bb2-b607-698804ce5c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 04:59:59.058048 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.wsgi [None req-4c7179e7-ec7d-43a4-adf5-3d689d41858f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] HTTP exception thrown: Instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 could not be found. Mar 08 04:59:59.058808 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: DEBUG nova.api.openstack.wsgi [None req-4c7179e7-ec7d-43a4-adf5-3d689d41858f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Returning 404 to user: Instance f0d454cf-c4e3-45fe-9407-cb49752bfa71 could not be found. {{(pid=116774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 04:59:59.059620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO nova.api.openstack.requestlog [None req-4c7179e7-ec7d-43a4-adf5-3d689d41858f tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71" status: 404 len: 111 microversion: 2.1 time: 0.027903 Mar 08 04:59:59.060135 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: [pid: 116774|app: 0|req: 1682/3308] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 04:59:59 2022] GET /compute/v2.1/servers/f0d454cf-c4e3-45fe-9407-cb49752bfa71 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 04:59:59.068237 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: DEBUG nova.api.openstack.wsgi [None req-a60b627f-ad6f-41a8-a52b-d4a3ecf78246 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] Calling method '.version_select at 0x7fe8370b4af0>' {{(pid=116775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 04:59:59.085067 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO nova.api.openstack.requestlog [None req-a60b627f-ad6f-41a8-a52b-d4a3ecf78246 tempest-TestMinimumBasicScenario-803213880 tempest-TestMinimumBasicScenario-803213880-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-538163327" status: 202 len: 0 microversion: 2.1 time: 0.020589 Mar 08 04:59:59.085603 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: [pid: 116775|app: 0|req: 1627/3309] 10.222.0.30 () {58 vars in 1268 bytes} [Tue Mar 8 04:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-538163327 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 05:00:40.006313 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 05:00:40.006886 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 05:00:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 05:00:45.200620 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 05:00:45.201236 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 05:00:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 05:00:58.744835 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 05:00:58.745413 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 05:00:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 05:02:37.168648 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 05:02:37.169212 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 05:02:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 05:02:55.399924 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 05:02:55.400463 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 05:02:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 05:04:00.014987 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 05:04:00.015499 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 05:04:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 05:04:05.208906 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 05:04:05.209542 dv-cinder-733062-29-iscsi devstack@n-api.service[116774]: Tue Mar 8 05:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 05:04:18.753111 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 05:04:18.753636 dv-cinder-733062-29-iscsi devstack@n-api.service[116775]: Tue Mar 8 05:04:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!